Live data from Hacker News

Inceptionism: Going Deeper into Neural Networks

googleresearch.blogspot.com

101–110 of 166 posts

Re: Inceptionism: Going Deeper into Neural Networks

#101
post #95

Does anyone have a good sense of what exactly they mean here: >Instead of exactly prescribing which feature we want the network to amplify, we can also let the network make that decision. In this case we simply feed the network an arbitrary image or photo and let the network analyze the picture. We then pick a layer and ask the network to enhance whatever it detected. Each layer of the network deals with features at…

[deleted]

Re: Inceptionism: Going Deeper into Neural Networks

#104
post #95

Does anyone have a good sense of what exactly they mean here: >Instead of exactly prescribing which feature we want the network to amplify, we can also let the network make that decision. In this case we simply feed the network an arbitrary image or photo and let the network analyze the picture. We then pick a layer and ask the network to enhance whatever it detected. Each layer of the network deals with features at…

The detection layer will detect very faint random signals. For example, if you have a unit that's supposed to detect dogs, it might be very faintly activated if by random chance there is a doggish quality to some part of the image. What they do is pick up that faint, random, signal and amplify it.

They say: oh you think that cloud is a tiny bit dog-like? Ok, well then find me a small modification to the image that would make it a little more dog like, then a little more, and so on.

Think of it as semantic contrast enhancement

Re: Inceptionism: Going Deeper into Neural Networks

#105
The level of resemblance with a psychotropics' trip is simply fascinating. It's definitely really close to how our brain reacts when is flooded with dopamine + serotonin.

I wonder if the engineers at Google can make the same experiment with audio... It'll be funny to listen the results.

Re: Inceptionism: Going Deeper into Neural Networks

#106
If anyone wants to send this to their non-dev friends, here's the write-up I sent to mine!

https://medium.com/@stripenight/seeing-how-computers-might-t...

---

tldr: To figure out how computers "think", Google asked one of its artificial intelligence algorithms to look at clouds and draw the things it saw!

There's this complex Artificial Intelligence algorithm called a neural network ( https://en.wikipedia.org/wiki/Artificial_neural_network ). It's essentially code which tries to simulate the neurons in a brain.

Over the last few years, there have been some really cool results, like using neural networks to read people's handwriting, or to figure what objects are in a picture.

To start your neural network, you give it a bunch of pictures of dogs, and tell it that those pictures contain dogs. Then you give it pictures of airplanes, and say those are airplanes, etc. Like a child learning for the first time, the neural network updates its neurons to recognize what makes up a dog or an airplane.

Afterwords, you can give it a picture and ask if the pic contains a dog or an airplane.

The problem is that WE DON'T NOW HOW IT KNOWS! It could be using the shape of a dog, or the color, or the distance between it's legs. We don't know! We just can't see what the neurons are doing. Like a brain, we don't quite know how it recognize things.

Google had a big neural network to figure out what's in an image, and they wanted to know what it did. So, they gave the neural net a picture, but stopped the neural net at different points, before it could finish deciding. When, they stopped it, they asked it to "enhance" what is just recognized. Eg. if it just saw the outline of a dog, the net would return the picture with the outline a bit thicker. Or, if it saw the colors similar to a banana, it would return the picture with those colors looking more like a banana's colors.

This seems like a simple idea, but it's actually really complex, and really insightful! Amazing images here - https://photos.google.com/share/AF1QipPX0SCl7OzWilt9LnuQliat...

Original article - http://googleresearch.blogspot.com/2015/06/inceptionism-goin...

Re: Inceptionism: Going Deeper into Neural Networks

#107
post #95

Does anyone have a good sense of what exactly they mean here: >Instead of exactly prescribing which feature we want the network to amplify, we can also let the network make that decision. In this case we simply feed the network an arbitrary image or photo and let the network analyze the picture. We then pick a layer and ask the network to enhance whatever it detected. Each layer of the network deals with features at…

The detection layer will detect very faint random signals. For example, if you have a unit that's supposed to detect dogs, it might be very faintly activated if by random chance there is a doggish quality to some part of the image. What they do is pick up that faint, random, signal and amplify it. They say: oh you think that cloud is a tiny bit dog-like? Ok, well then find me a small modification to the image that wo…

So in concrete terms, does this mean that we show the network an image, choose one layer's output vector, and then back-propagate gradients to the image such that the direction of that vector stays the same, but the magnitude increases?

Re: Inceptionism: Going Deeper into Neural Networks

#108

This is one of the most astounding things I've ever seen. Some of these images look positively like art. And not just art, but good art.

> And not just art, but good art

Makes me wonder what passes as good art nowadays. But yeah some of the renderings were particularly aesthetic.

Re: Inceptionism: Going Deeper into Neural Networks

#109
post #12

Am I the only person who is not entirely happy about the overuse of the pop-culture term 'inception' for everything that is remotely nested, recursive or strange-loop-like? In this paper, we will focus on an efficient deep neural network architecture for computer vision, codenamed Inception, which derives its name from the Network in network paper by Lin et al [12] in conjunction with the famous “we need to go deeper…

There is at least one major neuroscientific paper with similar title http://rstb.royalsocietypublishing.org/content/369/1633/2013...

Re: Inceptionism: Going Deeper into Neural Networks

#110
post #107

Earlier quoted context omitted.

The detection layer will detect very faint random signals. For example, if you have a unit that's supposed to detect dogs, it might be very faintly activated if by random chance there is a doggish quality to some part of the image. What they do is pick up that faint, random, signal and amplify it. They say: oh you think that cloud is a tiny bit dog-like? Ok, well then find me a small modification to the image that wo…

So in concrete terms, does this mean that we show the network an image, choose one layer's output vector, and then back-propagate gradients to the image such that the direction of that vector stays the same, but the magnitude increases?

That is my understanding of the blog post, yes.

That plus a prior on the input pixels to keep it image-like.

Post reply on HN