Live data from Hacker News

Inceptionism: Going Deeper into Neural Networks

googleresearch.blogspot.com

11–20 of 166 posts

Re: Inceptionism: Going Deeper into Neural Networks

#12
Am I the only person who is not entirely happy about the overuse of the pop-culture term 'inception' for everything that is remotely nested, recursive or strange-loop-like?

   In this paper, we will focus on an efficient deep neural network 
   architecture for computer vision, codenamed Inception, which derives 
   its name from the Network in network paper by Lin et al [12]
   in conjunction with the famous “we need to go deeper” internet meme [1]

Re: Inceptionism: Going Deeper into Neural Networks

#13
post #2

This appears to be the source of the mysterious image that showed up on Reddit's /r/machinelearning the other day too: https://www.reddit.com/r/MachineLearning/comments/3a1ebc/ima...

It reminds me of that parrot image that was said to crash human brains, only even more intense. I certainly experienced some effect, as while looking at it and trying to figure out what exactly it was, I felt my head heating up --- probably increased blood flow.

Re: Inceptionism: Going Deeper into Neural Networks

#14
I'll repeat what I posted on facebook because I thought it was clever: "Yes, but only if we tell them to dream about electric sheep."

So, tell the machine to think about bananas, and it will conjure up a mental image of bananas. Tell it to imagine a fish-dog and it'll do its best. What happens if/when we have enough storage to supply it a 24/7 video feed (aka eyes), give a robot some navigational logic (or strap it to someone's head), and give it the ability to ask questions, say, below some confidence interval (and us the ability to supply it answers)? What would this represent? What would come out on the other side? A fraction of a human being? Or perhaps just an artificial representation of "the human experience".

...what if we fed it books?

Re: Inceptionism: Going Deeper into Neural Networks

#15
The one generated after looking at completely random noise on the bottom row, second from the right:

http://googleresearch.blogspot.co.uk/2015/06/inceptionism-go...

Reminds me very heavily of The Starry Night https://www.google.com/culturalinstitute/asset-viewer/the-st...

Lovely imagery.

I never had much luck with generative networks. I did some work putting RBMs on a GPU partly because I'd seen Hinton talk showing starting with a low level description and feeding it forwards, but always ended up with highly unstable networks myself.

Re: Inceptionism: Going Deeper into Neural Networks

#18
Really cool. You could generate all kinds of interesting art with this.

I can't help but think of people who report seeing faces in their toast. Humans are biased towards seeing faces in randomness. A neural network trained on millions of puppy pictures will see dogs in clouds.

Re: Inceptionism: Going Deeper into Neural Networks

#19
post #2

This appears to be the source of the mysterious image that showed up on Reddit's /r/machinelearning the other day too: https://www.reddit.com/r/MachineLearning/comments/3a1ebc/ima...

It reminds me of that parrot image that was said to crash human brains, only even more intense. I certainly experienced some effect, as while looking at it and trying to figure out what exactly it was, I felt my head heating up --- probably increased blood flow.

I stopped after a few seconds of ocular recursion. A new category of warning label :)

Re: Inceptionism: Going Deeper into Neural Networks

#20

The fractal nature of many of the "hallucinated" images is kind of fascinating. The parallels to psychedelic drug-induced hallucinations are striking.

>If we choose higher-level layers, which identify more sophisticated features in images, complex features or even whole objects tend to emerge. Again, we just start with an existing image and give it to our neural net. We ask the network: “Whatever you see there, I want more of it!” This creates a feedback loop: if a cloud looks a little bit like a bird, the network will make it look more like a bird. This in turn will make the network recognize the bird even more strongly on the next pass and so forth, until a highly detailed bird appears, seemingly out of nowhere.

I would say that's a pretty good description of how many psychedelic hallucinations unfold. They start off as noise in your vision which turn into loose forms which turn into geometric patterns which turn into etc...

Post reply on HN