Live data from Hacker News

Inceptionism: Going Deeper into Neural Networks

googleresearch.blogspot.com

61–70 of 166 posts

Re: Inceptionism: Going Deeper into Neural Networks

#62

Earlier quoted context omitted.

In case anyone hasn't read the story this is referring to: "BLIT" by David Langford. http://www.infinityplus.co.uk/stories/blit.htm

There's also a few sequels: http://ansible.uk/writing/c-b-faq.html http://www.lightspeedmagazine.com/fiction/different-kinds-of... And What Happened at Cambridge IV , which I can't find online.

Here's What Happened at Cambridge IV:

https://books.google.co.uk/books?id=5d9hHvD-T7gC&lpg=PA264&o...

This last story makes the ML images even more disturbing!

Highly recommend these stories. They'd make a great black mirror episode.

Re: Inceptionism: Going Deeper into Neural Networks

#63
post #14

I'll repeat what I posted on facebook because I thought it was clever: "Yes, but only if we tell them to dream about electric sheep." So, tell the machine to think about bananas, and it will conjure up a mental image of bananas. Tell it to imagine a fish-dog and it'll do its best. What happens if/when we have enough storage to supply it a 24/7 video feed (aka eyes), give a robot some navigational logic (or strap it t…

Neural networks are a relatively simple mathematical model. They don't actually "think" or have a conscience. Neural networks are also regularly fed books, in order to model some properties of natural language.

Here's a good introduction: http://colah.github.io/posts/2014-07-NLP-RNNs-Representation...

Re: Inceptionism: Going Deeper into Neural Networks

#65
post #9
post #5

Tweak image urls for bigger images: Ibis: http://3.bp.blogspot.com/-4Uj3hPFupok/VYIT6s_c9OI/AAAAAAAAAl... Seurat: http://4.bp.blogspot.com/-PK_bEYY91cw/VYIVBYw63uI/AAAAAAAAAl... Clouds: http://4.bp.blogspot.com/-FPDgxlc-WPU/VYIV1bK50HI/AAAAAAAAAl... Buildings: http://1.bp.blogspot.com/-XZ0i0zXOhQk/VYIXdyIL9kI/AAAAAAAAAm... I'd love to experiment with this and video. I predict a nerdy music video soon, and a pop video…

As linked in the last figure caption, there's a Google Photos gallery with high-resolution downloadable versions: https://goo.gl/photos/fFcivHZ2CDhqCkZdA

There's a video, among them

https://photos.google.com/share/AF1QipPX0SCl7OzWilt9LnuQliat...

Re: Inceptionism: Going Deeper into Neural Networks

#66
post #15

The one generated after looking at completely random noise on the bottom row, second from the right: http://googleresearch.blogspot.co.uk/2015/06/inceptionism-go... Reminds me very heavily of The Starry Night https://www.google.com/culturalinstitute/asset-viewer/the-st... Lovely imagery. I never had much luck with generative networks. I did some work putting RBMs on a GPU partly because I'd seen Hinton talk showing s…

Neural networks are notoriously difficult to train due to the large number of hyper-parameters that need to be tuned. If your network never converged, it's possible your learning rate was too high, so it kept overshooting the minima of the loss function.

Re: Inceptionism: Going Deeper into Neural Networks

#67
This was recently posted to HN, http://tjake.github.io/blog/2013/02/18/resurgence-in-artific...

Which mentions running the NN in reverse, quote

    By far the most interesting thing I’ve learned about Deep Belief 
    Networks is their generative properties. Meaning you can look 
    inside the ‘mind’ of a DBN and see what it’s imagining. Since a 
    deep belief networks are two-way like restricted boltzmann 
    machines you can make hidden inputs generate valid visual 
    inputs. Continuing with our handwritten digit example you can 
    start with the label input say a ‘3’ label and activate it then 
    go reverse through the DBN and out the other end will pop out a 
    picture of a ‘3’ based on the features of the inner layers. This 
    is equivalent to our ability to visualize things using words, go 
    ahead imagine a ‘3’, now rotate it.

Re: Inceptionism: Going Deeper into Neural Networks

#69
post #32

Really nice. I'd be interested in seeing a more in-depth scientific description of how these images were actually generated. Are there any other publications related to this work?

There's four papers linked in the article. The last three (see below) were pretty good, haven't read the first.

http://arxiv.org/pdf/1412.0035v1.pdf

http://arxiv.org/pdf/1506.02753.pdf

http://arxiv.org/pdf/1312.6034v2.pdf

Post reply on HN