Live data from Hacker News

Facebook’s AI unlocks the ability to search photos by what’s in them

techcrunch.com

41–50 of 69 posts

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#41

Earlier quoted context omitted.

Interesting. I searched Google Photos for 'dog', and out of 5 results, one is my SO and I, and two are photos of my cats.

do you use google photos and/or drive regularly? Just curious if it is a training data set problem for "me"

I do use Google Photos - I set up automatic backup of the photos from my mobile phone.

It doesn't find anything for "me". I don't know what this classification is based on.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#42
post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8. Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me. Update : not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photo…

my mistake

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#43

Recently on my phone I tried to copy and paste a picture from Facebook to my messaging app. Instead of copying the picture, it copied a text message that read "picture of dog and three people." I'm sure this is nothing new, but I'd never seen it before and thought it was interesting.

This reminds me, (very unrelated) a few years ago (almost 10), when I dragged and dropped an image from Wikipedia with Google Chrome to my Windows XP desktop, and to my surprise it actually saved it with a file name that is the description of the picture, not some arbitrarily chosen name or the Wikipedia file name. Sometimes it was really long and descriptive, like "A man wearing red and a woman wearing blue are play…

AFAIR you can suggest a name for the file in response headers of HTTP request, so I'd suggest cURLing the image and looking at the response headers.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#44
post #42

Earlier quoted context omitted.

If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8. Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me. Update : not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photo…

my mistake

That's something very different: this is for searching your own photos, not all those on the web. It's fairly easy to find dog photos on the web, since the web contains lots of websites with text saying something like "dog photos" and then lots of dog photos. But to find it in user-taken photos with no annotations is a relatively recent success (and is clearly not entirely there).

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#46
post #16

Seriously, a 51.6MB "gif" that doesn't really add anything to the article?

Really off-topic, but: Are there (tech) news-sites which do not have this 10-100MB bloat with three js framweorks and gifs, ads and whatnot? I'd gladly pay for a minimalist news source...

It's kind of a PIA, but I enjoy using umatrix and ublock origin. Allows me to only turn on the stuff that I want.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#47
post #16

Seriously, a 51.6MB "gif" that doesn't really add anything to the article?

Really off-topic, but: Are there (tech) news-sites which do not have this 10-100MB bloat with three js framweorks and gifs, ads and whatnot? I'd gladly pay for a minimalist news source...

>Are there (tech) news-sites which do not have this 10-100MB bloat with three js framweorks and gifs, ads and whatnot?

The HackerNews comment section, with the added benefit of it being more informative.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#48
post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

Google never gets any credit. I used Google Now before Siri exploded the world. I listened to a machine learning series, which started like: "... applications include Facebook's facial recognition, Amazon's product recommendations, Google's image search, and Apple's self-driving car." Apple's car? Google is the world king of ML, and you gave them image search?

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#50

Recently on my phone I tried to copy and paste a picture from Facebook to my messaging app. Instead of copying the picture, it copied a text message that read "picture of dog and three people." I'm sure this is nothing new, but I'd never seen it before and thought it was interesting.

This reminds me, (very unrelated) a few years ago (almost 10), when I dragged and dropped an image from Wikipedia with Google Chrome to my Windows XP desktop, and to my surprise it actually saved it with a file name that is the description of the picture, not some arbitrarily chosen name or the Wikipedia file name. Sometimes it was really long and descriptive, like "A man wearing red and a woman wearing blue are play…

Could it have been the alt text for the image? I believe the grandparent comment was also pasting the alt text, since Facebook auto-generates alt text for blind users using ML (this is mentioned in the article).
Post reply on HN