Live data from Hacker News

Facebook machine learning technology improves; Redditors alaramed.

reddit.com

41–50 of 168 posts

Re: Facebook machine learning technology improves; Redditors alaramed.

#41
Immature, but I really loved this comment/idea and wonder about the feasibility of such attacks:

"You know what this means:

Time to rewrite your EXIF info and location bomb the hell out of popular attractions. Eiffel Tower in Paris? Nope, it's in Iowa ..." [1]

Possible? Google bomb with a twist?

1: http://www.reddit.com/r/WTF/comments/nkktm/facebook_is_reall...

Re: Facebook machine learning technology improves; Redditors alaramed.

#42

The important thing to take away from this: If they can make guesses this accurate about your photos, imagine they guesses they're making behind the scenes about your life, your personality and your innermost thoughts. If there was a page on fb where it showed all the inferences they had made about you, sexuality, income, religion, philosophical viewpoints, mental health, etc. then people would run screaming. Of cour…

or build a self-aware version/cylon of you.

Re: Facebook machine learning technology improves; Redditors alaramed.

#43
A test that might fool this. You will need: 1. A facebook status update/checkin/access from a particular location. 2. A photo taken without EXIF data at around the same time as the update/checkin/access above, but from a completely different location.

Upload the photo using your facebook account. Check whether they get the location right. If yes, the mystery continues. If no, but the location is somewhere other than where you updated your status/checked in from, the mystery deepens. Else, they're pairing the times together.

Re: Facebook machine learning technology improves; Redditors alaramed.

#44
I've seen both extremes on my photos. One set it suggested the nearby town, which was creepily accurate; another it asked "were these taken in England, Arkansas" which was a hilariously poor guess. Weirdly, they managed the difficult part (figuring out the photos were taken in "England" without any obvious clues) but then failed to sensibly geolocate it.

Re: Facebook machine learning technology improves; Redditors alaramed.

#45
post #27
post #4

Here's my guess at how it's done: Redditor has facebook app installed on their smartphone (or just uses the website), sets status to "OMG wife is going into labour, at the hospital now". Facebook now knows roughly where redditor was at the specified time based on the ip, they can narrow this down further by looking at keywords in the status message and check it against a list of addresses in the local area and select…

It's probably a combination of techniques to be honest. They do have some unprecedented access to contextually heavy data, as well as an unusually large base of free labor to supervise the learning... My creepy moment came when It correctly pointed out the exact location of this photo: http://www.flickr.com/photos/40127665@N03/4788700749/in/set-... I was in the middle of Costa Rica. For fear of roaming charges my pho…

Simply not making a status update isn't enough. You'd have to never visit a page with a Facebook like button from a computer which you'd used ever to log in to Facebook with.

I'm yet to be convinced that this feature requires actually analysing image content at all. GeoIP and time stamps alone can provide a huge amount of context before you even start on things like mobile clients providing location data.

Re: Facebook machine learning technology improves; Redditors alaramed.

#46
post #31
post #23

Earlier quoted context omitted.

How does Facebook use image recognition to recognize that an image of a baby on a blanket with no surroundings visible was taken inside a certain hospital? I doubt it. Regarding your Chamonix images, perhaps your friends uploaded photos taken at roughly the same time, with geo-tags? Perhaps you are tagged in some of them? That would make for pretty simple logic: - Facebook knows that you were at a certain place a cer…

Regarding your Chamonix images, perhaps your friends uploaded photos taken at roughly the same time, with geo-tags? Nope. Family holiday. Of those there I am the only one with photos on Facebook - and in fact at the time was the only family member with a Facebook account :) I am intrigued because if it is image recognition there isn't much for them to have gone on. But I am stumped for what else they could have used.

maybe Facebook just randomly guesses locations. those who get matches write comments on reddit wondering how the hell it works and those that get weird suggestions ignore them :)

Re: Facebook machine learning technology improves; Redditors alaramed.

#47
post #28
post #24

http://en.wikipedia.org/wiki/Scale-invariant_feature_transfo... Facebook almost certainly has more photo information than TinEye or Flickr, and of indoor environments probably more than Google (which has reverse image search too). Across any given bar or hospital Facebook would have maybe 5-10 other people with albums tagged with the name/gps/check-in. They'd only need one other album though. SIFT more or less turns…

But why that whole technology for just making a Suggestion? There is something else they are working on...something really BIG and a complete game changer I guess.

Also consider this, use SIFT on video stills and collect all the handheld video of a particular concert. Use machine learning to combine all the audio tracks and clean them up into high quality audio. Stitch the video together, using textures from the higher resolution stills people take, to allow people to relive the concert with a massive panoramic video (or 3D) with high quality sound. Use it to launch a music competitor to Google or destroy Ticketmaster (well overdue..) as bands and venues won't have to hire video production companies to record concerts if they sell tickets through FB. All that technology is in current research papers and prototypes at the moment, it would probably only take two years to put it together at worst if they aren't working on it already.

Re: Facebook machine learning technology improves; Redditors alaramed.

#48
post #31
post #23

Earlier quoted context omitted.

How does Facebook use image recognition to recognize that an image of a baby on a blanket with no surroundings visible was taken inside a certain hospital? I doubt it. Regarding your Chamonix images, perhaps your friends uploaded photos taken at roughly the same time, with geo-tags? Perhaps you are tagged in some of them? That would make for pretty simple logic: - Facebook knows that you were at a certain place a cer…

Regarding your Chamonix images, perhaps your friends uploaded photos taken at roughly the same time, with geo-tags? Nope. Family holiday. Of those there I am the only one with photos on Facebook - and in fact at the time was the only family member with a Facebook account :) I am intrigued because if it is image recognition there isn't much for them to have gone on. But I am stumped for what else they could have used.

Wow. Maybe they have a bunch of people looking at pictures, manually making suggestions? Google "similar images" search-like tool? It does sound scary if they really had nothing to go on other than the image data.

Re: Facebook machine learning technology improves; Redditors alaramed.

#49
Highly unlikely that there is anything sophisticated here. It would be too many computing cycles thrown at something with very small RoI. Most likely some straightforward text, date, and location matching. Many of the previous commenters are assuming you need sophisticated pattern sifting to get any good insights. Not true. Large numbers of facebook users are including this data voluntarily or with their unexpurgated photos. Going after the sliver who don't is just not a worthy investment -- yet.

Re: Facebook machine learning technology improves; Redditors alaramed.

#50
I don't think this is machine learning.

I have Facebook suggested a few albums today (2 hours ago). Some of them are from 2+ years ago, others are recent ones. The suggestion is quite accurate (89%, 8 out of 9 albums). With the incorrect album, Facebook suggested another city with the same name but from another country!

So Facebook probably just combine as much data as possible and when the matching rate is larger than some threshold, it will temporary tag the album and confirm with users. Data may include:

1. Album info (yeah, most of my album includes the place in it's name or description)

2. Comments group. 3 of my albums have a large number of comments, they are all from my highschool friends (I grouped them all in the same group) so it's quite accurate I guess. Also, if Facebook use the information in their smart lists, that makes sense too.

3. EXIF data. Some people says Facebook can read the data and cross-check the date with its database of check-in. This doesn't happen to me but I think it's possible. And of course, if the EXIF has geo-tagged, that info can be picked up.

Thought?

Post reply on HN