Live data from Hacker News

Give AI curiosity, and it will watch TV forever (2018)

qz.com

71–80 of 107 posts

Re: Give AI curiosity, and it will watch TV forever (2018)

#71

Earlier quoted context omitted.

Maybe someday the AI will be clever enough to predict the plotlines and get bored.

Why? You know the plotline of your life as well. You will become old, suffer and die at the end. Are you bored?

Maybe but with my life the plot twists don't have to be foreshadowed or make dramatic sense!

Re: Give AI curiosity, and it will watch TV forever (2018)

#72
post #49
post #31

This trait must serve us in some capacity. You see this with children and iPads. My kids know 3x what I did when I was their same age. It's as if something can finally fill their bandwidth, keep up with their thoughts, and answer those questions in real-time. No wonder they get angry when it's time to put away the iPad - they're engaged at a high level. Much like when I am programming on a sideproject and my focus is…

I actually researched writing a proxy that would intercept and rewrite Youtube's JSON API responses with pre-selected, educational videos. This is how much I hate their recommendation algorithm. That way, the Youtube app appears to work the same. It's just that those videos that are blacklisted in the recommendation response, e.g. all the videos with the word 'minecraft' in the title, would be replaced with Youtube s…

Have you considered YT kids?

Re: Give AI curiosity, and it will watch TV forever (2018)

#73
The important counterweight to this phenomenon is the brain's adaptability to noise. Some ML researchers like to think that noise is not predictable because this follows from the classic CS definition of noise. However in reality the brain quickly adapts to any noisy sensory input, it begins to predict higher level characteristics of the noisy input and no longer reacts with surprise or interest.

This happens at all levels of sensory processing, from single cell firing (which is noisy) to the boredom you feel with a 100 channels of TV that are all technically novel to you but contain nothing remotely interesting.

Basically if you've built an agent that can be perpetually distracted by noise or a "noisy" TV then you've forgotten an important piece of the puzzle.

Re: Give AI curiosity, and it will watch TV forever (2018)

#74
post #72
post #49

Earlier quoted context omitted.

I actually researched writing a proxy that would intercept and rewrite Youtube's JSON API responses with pre-selected, educational videos. This is how much I hate their recommendation algorithm. That way, the Youtube app appears to work the same. It's just that those videos that are blacklisted in the recommendation response, e.g. all the videos with the word 'minecraft' in the title, would be replaced with Youtube s…

Have you considered YT kids?

Still has the same issue.

If someone watches one Blue's Clues video, ten more are recommended afterwards.

I want a more diverse set of recommendations from a smaller set of educational channels.

And I want to filter entirely by keyword. Disabling individual channels for something like 'Minecraft' content is futile.

Re: Give AI curiosity, and it will watch TV forever (2018)

#75
post #16

With the definition of curiosity from the article, it’s not that surprising? A dynamic “screen” is always more interesting than the static map. Definition: The definition that OpenAI team used for artificial curiosity was relatively simple: The algorithm would try to predict what its environment would look like one frame into the future. When that next frame happened, the algorithm would be rewarded by how wrong it w…

There's clearly a sweet spot in the amount of entropy/unpredictability that is "interesting". Otherwise observing white noise would be the most interesting thing imaginable. I don't know the details, but probably you would want to seek unpredictability in a higher level representation of the observed state. White noise is highly unpredictable per pixel, but will get a very predictable representation after a layer or…

I think there's a gap between the human version of curiosity and the AI version. A machine can be told that something is interesting, where humans need to innately find something interesting or spend a long time sort of learning to find something interesting.

> White noise is highly unpredictable per pixel, but will get a very predictable representation after a layer or two of featurization if the features are trained/designed for real world observations.

Virtually anything that cannot be predicted is interesting by nature of being unpredictable. Is it truly random? How, or why? True randomness is rare, and its existence is interesting.

TV static is uninteresting because it isn't actually random, it's just too onerous to get the measurements to predict it for the value we would get. It's part of the large class of things that is random for practical purposes, but not truly random. I have no doubt that if humanity dumped all its resources into predicting static, NASA could measure inbound radio waves and/or model space to figure out what static would look like at a particular spot.

Notably, humans find the cause of static (partially various waves from space) fascinating because we can't predict them. We've just placed our interest down a layer of abstraction from static. Static is boring, the source of static is interesting.

I suspect it is truly random to the AI, though, because it has no means to "see" those radio waves. I would wager humans would be far more interested in static if we were also unable to see the causality between radio waves and static.

I would be interested to see if the AI was as interested in static if it was also provided a real-time feed of radio waves at the antenna. Would it figure out that those things are correlated and lose interest in static like humans have, or would it continue to find static fascinating despite knowing it's a basic causality?

Re: Give AI curiosity, and it will watch TV forever (2018)

#76
I observed this phenomena not too long ago while training an RL agent to play pokemon using an intrinsic novelty reward based on the number of unique screens the agent had seen. The goal was to get it to explore the map, but instead it became fixated watching animated water, flowers, and npcs in the starting town. I made an extensive video analyzing the experiments, you can find it by searching "ai plays pokemon" :)

Re: Give AI curiosity, and it will watch TV forever (2018)

#77

Earlier quoted context omitted.

> It's as if something can finally fill their bandwidth, keep up with their thoughts, and answer those questions in real-time. There's a problem with your line of thinking. E.g., I remember the epiphany when I realized that a particular C codebase was an implementation of a (more or less) object-oriented dynamic programming language. Ooh, here's the part that implements classes. Here's the part that instantiates the…

There's also a problem with your line of thinking: you are not a child. You do not have the neuroplasticity they do. Their brains are learning in ways that we simply cannot any longer; it' a real apples:oranges situation.

Maybe, but you seem to be suggesting instead that this is an apples : suspension bridges scenario...

Re: Give AI curiosity, and it will watch TV forever (2018)

#78
post #31

This trait must serve us in some capacity. You see this with children and iPads. My kids know 3x what I did when I was their same age. It's as if something can finally fill their bandwidth, keep up with their thoughts, and answer those questions in real-time. No wonder they get angry when it's time to put away the iPad - they're engaged at a high level. Much like when I am programming on a sideproject and my focus is…

> It's as if something can finally fill their bandwidth, keep up with their thoughts, and answer those questions in real-time. There's a problem with your line of thinking. E.g., I remember the epiphany when I realized that a particular C codebase was an implementation of a (more or less) object-oriented dynamic programming language. Ooh, here's the part that implements classes. Here's the part that instantiates the…

I've learned to really cherish those "bathroom break" epiphanies. I used to consider it to be better to put some educational poster on that wall, but now I think that a completely featureless door is actually better.

Re: Give AI curiosity, and it will watch TV forever (2018)

#79

Earlier quoted context omitted.

Short-form media is not necessarily bad. Like all forms of media, it can be a useful learning tool or it can be a massive time sink. Social media has just weaponized it to optimize for engagement at all costs.

it really depends on what you want to learn. personally I don't believe that 5 minute trivia is going to be worth a dime in the AI ridden world Og tomorrow.

Og loves trivia ! Og can recite plenty of them !

Re: Give AI curiosity, and it will watch TV forever (2018)

#80
post #49
post #31

This trait must serve us in some capacity. You see this with children and iPads. My kids know 3x what I did when I was their same age. It's as if something can finally fill their bandwidth, keep up with their thoughts, and answer those questions in real-time. No wonder they get angry when it's time to put away the iPad - they're engaged at a high level. Much like when I am programming on a sideproject and my focus is…

I actually researched writing a proxy that would intercept and rewrite Youtube's JSON API responses with pre-selected, educational videos. This is how much I hate their recommendation algorithm. That way, the Youtube app appears to work the same. It's just that those videos that are blacklisted in the recommendation response, e.g. all the videos with the word 'minecraft' in the title, would be replaced with Youtube s…

You prefer Neil deGrasse Tyson to Minecraft for your kids?
Post reply on HN