Live data from Hacker News

Facebook’s AI unlocks the ability to search photos by what’s in them

techcrunch.com

31–40 of 69 posts

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#32
post #19

Seriously, a 51.6MB "gif" that doesn't really add anything to the article?

The page would have cost me 60 euros worth of data in Cuba. If I pressed refresh, because something didn't load? 120 euros.

I wonder, how does one survive on the "modern" internet in a place like that? I feel i would die a little inside. Seems the only reliable way would be to navigate with everything disabled, even images, and manually (or automatically) allow images that are of certain types (no gifs) / size (not too big) and etc.

I mean, that sounds so bad that i would argue you shouldn't even see the 50mb gif in that page, at all - ie it's your own fault. If your browsing "the web" with such a restrictive data plan you're playing russian roulette. It's only a matter of time before some JS heavy site or some blog with a gif "takes you down". Sure, sites waste a ton of data all over the place, but it's not their responsibility to "protect" you imo. You can't trust others to do that job. The browser vendors should be, or something.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#33
post #19

Earlier quoted context omitted.

The page would have cost me 60 euros worth of data in Cuba. If I pressed refresh, because something didn't load? 120 euros.

I wonder, how does one survive on the "modern" internet in a place like that? I feel i would die a little inside. Seems the only reliable way would be to navigate with everything disabled, even images, and manually (or automatically) allow images that are of certain types (no gifs) / size (not too big) and etc. I mean, that sounds so bad that i would argue you shouldn't even see the 50mb gif in that page, at all - ie…

Yeah, mobile phone apps which care about data are what you need to use. eg. use the gmail app instead of the gmail website. The opera browser is the best for expensive data general web browsing. Then you set up traffic limits.

The main way to protect yourself is to turn off the internet and enjoy life.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#34
post #9
post #5

now i know why facebook has been doin this. http://i.imgur.com/zPapJHM.png

I believe that was for accessibility reasons, ie screen readers.

but it also allows you to do the opposite things, like search for "sky" and find that image.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#35
post #30
post #11

Earlier quoted context omitted.

same in iOS, you can search your photos like that. Actually, if you looked at the source on facebook, you could see photos being tagged with things like "one person, two people, smiles"

The iOS version doesn't work very well for me. It often uses the location of when the picture was stored. If you receive a picture from someone showing Big Ben while you're in New York, it'll show the picture when you search for new york. So searching for places doesn't really work, searching in contents also seems to be much worse than Google. Another point where Apple apparently lags behind in the AI game.

I found that both the Google and iOS versions could perform much the same sort of searches (e.g. "cat", "house") with roughly similar outcomes. However, Apple chooses to censor some searches (nothing illegal or dodgy, of course) and I could obtain no results for these despite having images which Google could find.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#36
Recently on my phone I tried to copy and paste a picture from Facebook to my messaging app. Instead of copying the picture, it copied a text message that read "picture of dog and three people." I'm sure this is nothing new, but I'd never seen it before and thought it was interesting.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#37
post #19

Earlier quoted context omitted.

The page would have cost me 60 euros worth of data in Cuba. If I pressed refresh, because something didn't load? 120 euros.

I wonder, how does one survive on the "modern" internet in a place like that? I feel i would die a little inside. Seems the only reliable way would be to navigate with everything disabled, even images, and manually (or automatically) allow images that are of certain types (no gifs) / size (not too big) and etc. I mean, that sounds so bad that i would argue you shouldn't even see the 50mb gif in that page, at all - ie…

Apparently, there's a "weekly package" of videos, articles, and so forth that's used by 80% of Cubans. Distributed on memory sticks or external drives.

http://www.npr.org/sections/parallels/2015/01/05/374986028/l...

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#38

Recently on my phone I tried to copy and paste a picture from Facebook to my messaging app. Instead of copying the picture, it copied a text message that read "picture of dog and three people." I'm sure this is nothing new, but I'd never seen it before and thought it was interesting.

This reminds me, (very unrelated) a few years ago (almost 10), when I dragged and dropped an image from Wikipedia with Google Chrome to my Windows XP desktop, and to my surprise it actually saved it with a file name that is the description of the picture, not some arbitrarily chosen name or the Wikipedia file name. Sometimes it was really long and descriptive, like "A man wearing red and a woman wearing blue are playing soccer on a field blah blah blah".

I wondered where that came from, and I looked for that description on that image's page on Wikipedia and couldn't find the same description anywhere (keep in mind, I was a middle schooler or something and it could very well be the case that I overlooked something) I was a little spooked, and I thought it was some sort of hidden feature in Chrome that labeled images like that.

Does anyone know what was happening? It still bugs me to this day :P

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#39
post #8

Google photos does this. I just opened Google photos and searched for "food" and aside from a couple pictures of some jack o lanterns (which are arguable, but I don't know anybody who eats theirs on Nov 1st), the results were spot on. "Unlocks" might not be the right word here.

If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8. Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me. Update : not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photo…

Interesting. I searched Google Photos for 'dog', and out of 5 results, one is my SO and I, and two are photos of my cats.

Re: Facebook’s AI unlocks the ability to search photos by what’s in them

#40

Earlier quoted context omitted.

If I search Google Photos for 'dog', the top seven hits are, in order: a fuzzy toy, a possum, another picture of the same possum, a cat, a pair of goats, a sheep, and I think it's a pheasant. The dog is #8. Of course, if I search Google Photos for 'me', the top hit is a frog, so maybe it just hates me. Update : not any more! Now the frog is #2. The top hit if I search for 'me' is the MV Isle of Lewis car ferry, photo…

Interesting. I searched Google Photos for 'dog', and out of 5 results, one is my SO and I, and two are photos of my cats.

do you use google photos and/or drive regularly? Just curious if it is a training data set problem for "me"
Post reply on HN