Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook’s AI unlocks the ability to search photos by what’s in them

techcrunch.com

Post reply on HN
Print view View original

11–20 of 69 posts

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#11

Post by baby »

philsnow wrote: post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

same in iOS, you can search your photos like that.

Actually, if you looked at the source on facebook, you could see photos being tagged with things like "one person, two people, smiles"

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#13

Post by planetjones »

Must be unlocking the same thing that Amazon Prime Photos is doing. I have to say that scanning photos automatically and allowing me to search by what is in the photo is the only solution to cope with the proliferation of photos, especially from camera phones. I still curate my better photos in Lightroom and publish them to Flickr albums. But that approach just isn't scalable for all the "normal" photos I am taking with the iPhone; so privacy concerns aside, I am happy for a machine to help me find the photos I am interested in.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#14

Post by aptwebapps »

philsnow wrote: post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

I think the idea here is to find things by analyzing the pictures directly as opposed to just searching contextual data like captions and link text. No idea if Google does that or not.

Edit: Didn't know Google Photos was a thing and assumed parent meant Google Images. Carry on.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#15

Post by aylons »

aptwebapps wrote: post #14
philsnow wrote: post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

I think the idea here is to find things by analyzing the pictures directly as opposed to just searching contextual data like captions and link text. No idea if Google does that or not. Edit: Didn't know Google Photos was a thing and assumed parent meant Google Images. Carry on.

I don't think you understood what GP said: he is using Google Photos, which searches his private collection. Not Google images.

I personally find Google Photos usually helpful and use it all the time to locate specific pictures. I do not caption them at all

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#16

Post by iklos55 »

yunolisten wrote: post #12

Seriously, a 51.6MB "gif" that doesn't really add anything to the article?

Really off-topic, but: Are there (tech) news-sites which do not have this 10-100MB bloat with three js framweorks and gifs, ads and whatnot? I'd gladly pay for a minimalist news source...

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#17

Post by mbrookes »

philsnow wrote: post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

I'm assuming that the "I am not a robot" image captchas are being used as a massive source of training data. I've notice there are several tiers of question:

* Select the images containing a street sign

* Select the squares in an image containing a street sign

* Draw a polygon around the sign

Someone better informed than me might be able to comment on how that fits in to deep learning strategies.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#18

Post by [deleted] »

philsnow wrote: post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

[deleted]

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#20

Post by michaelt »

mbrookes wrote: post #17
philsnow wrote: post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

I'm assuming that the "I am not a robot" image captchas are being used as a massive source of training data. I've notice there are several tiers of question: * Select the images containing a street sign * Select the squares in an image containing a street sign * Draw a polygon around the sign Someone better informed than me might be able to comment on how that fits in to deep learning strategies.

Almost certainly those are signs from Street View images.

That contributes to Google Maps - and accurate map data could have obvious value for self-driving cars.

Post reply on HN