Thinking of just how difficult this is, I'm reminded of https://xkcd.com/1425/ .
And see http://parkorbird.flickr.com/
Facebook’s AI unlocks the ability to search photos by what’s in them
21–30 of 69 posts
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#22Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.
If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8.
Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me.
Update: not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photographed on the island of Barra in the Outer Hebrides.
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#23Seriously, a 51.6MB "gif" that doesn't really add anything to the article?
Really off-topic, but: Are there (tech) news-sites which do not have this 10-100MB bloat with three js framweorks and gifs, ads and whatnot? I'd gladly pay for a minimalist news source...
There's AMP, if you don't mind trading one set of problems for another.
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#24Thinking of just how difficult this is, I'm reminded of https://xkcd.com/1425/ .
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#25Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.
I'm assuming that the "I am not a robot" image captchas are being used as a massive source of training data. I've notice there are several tiers of question: * Select the images containing a street sign * Select the squares in an image containing a street sign * Draw a polygon around the sign Someone better informed than me might be able to comment on how that fits in to deep learning strategies.
Guy who invented it did a TED talk. Eventually used it to help translate books. Have noticed that it went to street addresses and now identifying stores, signs, and trees. So most likely for mapping applications.
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#26Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.
If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8. Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me. Update : not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photo…
[deleted]
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#27Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.
If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8. Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me. Update : not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photo…
Strange, I wonder why that is. I've got nothing but dogs on the full page. The first non-dog is a dog-collar on the 9th row. I don't get the ferry, either.
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#28Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.
If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8. Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me. Update : not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photo…
I never used this feature until despite using Google photos extensively (I have ~60 GB of photos on there, granted that's 60 GB on my computer which isn't with the same compression/quality that Google uses). I have to say that I'm extremely impressed. it took multiple attempts to even find a mistake ("mountains", "city", "cat", "guitar", "food"). Although I was a little disappointed to find no results when I searched for "me". Being a frog is better than not existing at all.
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#29Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.
same in iOS, you can search your photos like that. Actually, if you looked at the source on facebook, you could see photos being tagged with things like "one person, two people, smiles"
If you turn on VoiceOver on iOS (accessibility feature for the blind) and then tap on photos on the Photos app, it will read out whatever it found in that photo
Re: Facebook’s AI unlocks the ability to search photos by what’s in them
#30Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.
same in iOS, you can search your photos like that. Actually, if you looked at the source on facebook, you could see photos being tagged with things like "one person, two people, smiles"
The iOS version doesn't work very well for me. It often uses the location of when the picture was stored. If you receive a picture from someone showing Big Ben while you're in New York, it'll show the picture when you search for new york. So searching for places doesn't really work, searching in contents also seems to be much worse than Google.
Another point where Apple apparently lags behind in the AI game.