Live data from Hacker News

What a Deep Neural Network thinks about selfies

karpathy.github.io

11–20 of 56 posts

Re: What a Deep Neural Network thinks about selfies

#11
I think it's less about the head getting chopped than about having "the head take up about 1/3 of the image," as Karpathy says. So what the net is learning is composition, or balance in an image, which is really cool. The rule of thirds is actually pretty well know to people in photography:

https://en.wikipedia.org/wiki/Rule_of_thirds

(Our deep-learning framework http://deeplearning4j.org missed his list, but it's got working convnets, too.)

Re: What a Deep Neural Network thinks about selfies

#12

One thing I always found interesting is Lecun is credited with developing covnets, but Hinton is apparently credited with scaling them and showing the world how great they are in the paper from 2012 - why was Hinton's group (Toronto) able to publish these ground breaking results before Lecun's group (NYU)

Geoff Hinton answers this question in episode 6 of the Talking Machines podcast. http://www.thetalkingmachines.com/blog/2015/3/13/how-machine...

Geoff Hinton had grad students who wanted to work on the problem, but Yann LeCun didn't.

"In about 2012, it should have been Yann's group, but Yann was unlucky, he didn't have a student who really wanted to do it. But we had a couple of students who wanted to do it and we took all of Yann's techniques and added some of our own."

Re: What a Deep Neural Network thinks about selfies

#13

One thing I always found interesting is Lecun is credited with developing covnets, but Hinton is apparently credited with scaling them and showing the world how great they are in the paper from 2012 - why was Hinton's group (Toronto) able to publish these ground breaking results before Lecun's group (NYU)

IIRC the deep learning revolution started with pretraining and RBMs, which I believe Hinton invented.

Re: What a Deep Neural Network thinks about selfies

#14
One caveat with these machine inspired knowledge: they are prone to error, probably more than humans, at least for now.

For example, if you train a CNN directly with human faces, its recognition rate comes way below what a human is capable of. Only after you apply tons of handcrafted optimizations, which are mostly black art, will you get close to or surpass a human's capability. Without much domain specific tuning, an AI's insight is far from reliable.

Re: What a Deep Neural Network thinks about selfies

#15

Earlier quoted context omitted.

For me, this thing about having the top of your head cut from the picture is new. Who would have thought..

Makes a bit of sense, in combination with the "be female" advice, cutting off the forehead puts the center of the photograph closer to her cleavage, and typically shows off her entire chest.

Cleavage does not feature a lot in the top 100 actually, but I'm half way there, in a sense that I'm a female. I'll definitely try the half-forehead thing next time!

Re: What a Deep Neural Network thinks about selfies

#16
>Be female. Women are consistently ranked higher than men. In particular, notice that there is not a single guy in the top 100.

This sounds true, but it can't be the real reason—selfies are ranked relative to the other images by the same user. So unless users are taking a lot of #selfies of people of different genders, we can assume the dataset is already controlled for the gender of the person in the image, no? Unless there's some confounding factor at play, such as some demographic segment being more likely to optimize for good selfies occasionally but have boring feeds the rest of the time.

would be super interesting, if the data is available, to normalize this by exposure. Of the people that saw an image, how many clicked "like"?

Re: What a Deep Neural Network thinks about selfies

#17

>Be female. Women are consistently ranked higher than men. In particular, notice that there is not a single guy in the top 100. This sounds true, but it can't be the real reason—selfies are ranked relative to the other images by the same user . So unless users are taking a lot of #selfies of people of different genders, we can assume the dataset is already controlled for the gender of the person in the image, no? Unl…

Yeah, female users probably post more pictures and also probably have more friends.

Re: What a Deep Neural Network thinks about selfies

#19
post #17

>Be female. Women are consistently ranked higher than men. In particular, notice that there is not a single guy in the top 100. This sounds true, but it can't be the real reason—selfies are ranked relative to the other images by the same user . So unless users are taking a lot of #selfies of people of different genders, we can assume the dataset is already controlled for the gender of the person in the image, no? Unl…

Yeah, female users probably post more pictures and also probably have more friends.

This also would be controlled for by the tools the blog author used though—if a women has more friends, then they would also probably get more likes on all of the rest of their images. Not sure if posting more photos would drive the average up or down, but it would probably drive the "above the baseline" selfies in the same way.

Re: What a Deep Neural Network thinks about selfies

#20

Earlier quoted context omitted.

For me, this thing about having the top of your head cut from the picture is new. Who would have thought..

Makes a bit of sense, in combination with the "be female" advice, cutting off the forehead puts the center of the photograph closer to her cleavage, and typically shows off her entire chest.

I thought cutting off forehead happens when the target is closer to the camera, so it is more personal.
Post reply on HN