Live data from Hacker News

Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

googleonlinesecurity.blogspot.com

11–20 of 159 posts

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#11
>In this paper, we show that this system is able to accurately detect and read difficult numbers in Street View with 90% accuracy.

> Turns out that this new algorithm can also be used to read CAPTCHA puzzles—we found that it can decipher the hardest distorted text puzzles from reCAPTCHA with over 99% accuracy.

Am I missing something or could we improve CAPTCHAs by mimicking street numbers?

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#12
post #5
post #2

In effect, Google computer vision got so good that they made their own system obsolete. This is a good thing. I still think the only reliable way to confirm identity (or humanity) online is an email or SMS verification. Recently, receiving a 2-factor SMS code took less time than the page refresh prompting me to enter it.

That confirms identity, but it doesn't confirm humanity. Robots just need to have a SIM card! I think it would annoy many human users as well.

It makes it much harder to flood a given site with a large number of actions. For instance, if you require SMS verification for account signup, and you don't allow the same phone number to be used for more than, say, two signups per month, then you make it hard to create a large number of bogus accounts.

Yes, it will annoy some real users, so it's not a no-brainer. But it will put a major brake on many kinds of abuse.

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#13
post #10

Interestingly I activated a new gmail account today and during the signup process I experienced the obligatory captcha. It was in two parts, the first looked strikingly like a street view picture of a house number, while the second looked like a traditional captcha. I suspect that google has been using techniques like this to validate their computer vision conclusions. Which makes their 99% assertion even more intere…

That's been going on for two years: http://techcrunch.com/2012/03/29/google-now-using-recaptcha-...

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#14
Wait, it's not clear to me from the blog post. Did they make a system that obsoletes reCAPTCHA? If so, it's just a matter of time before the spam systems catch up, correct? If so, what's the successor to CAPTCHA? Or is the web just going to be full of spam in the future?

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#15
post #10

Interestingly I activated a new gmail account today and during the signup process I experienced the obligatory captcha. It was in two parts, the first looked strikingly like a street view picture of a house number, while the second looked like a traditional captcha. I suspect that google has been using techniques like this to validate their computer vision conclusions. Which makes their 99% assertion even more intere…

It has been like this for a while now. AFAIK you have either

  - the actual captcha and a word from a book (Google Books)
  - the actual captcha and a house number from Street View (Google Maps)
Only the actual captcha has to be typed in correctly.

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#16
post #13
post #10

Interestingly I activated a new gmail account today and during the signup process I experienced the obligatory captcha. It was in two parts, the first looked strikingly like a street view picture of a house number, while the second looked like a traditional captcha. I suspect that google has been using techniques like this to validate their computer vision conclusions. Which makes their 99% assertion even more intere…

That's been going on for two years: http://techcrunch.com/2012/03/29/google-now-using-recaptcha-...

Isn't this like free mechanichal turk services? Or forced labour or something. Cynically brilliant outsourcing, tho.

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#18
post #11

>In this paper, we show that this system is able to accurately detect and read difficult numbers in Street View with 90% accuracy. > Turns out that this new algorithm can also be used to read CAPTCHA puzzles—we found that it can decipher the hardest distorted text puzzles from reCAPTCHA with over 99% accuracy. Am I missing something or could we improve CAPTCHAs by mimicking street numbers?

reCAPTCHA already does this, actually. It's part of the way Google trains their computer vision algorithms to recognize numbers.

http://techcrunch.com/2012/03/29/google-now-using-recaptcha-...

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#19
post #11

>In this paper, we show that this system is able to accurately detect and read difficult numbers in Street View with 90% accuracy. > Turns out that this new algorithm can also be used to read CAPTCHA puzzles—we found that it can decipher the hardest distorted text puzzles from reCAPTCHA with over 99% accuracy. Am I missing something or could we improve CAPTCHAs by mimicking street numbers?

>Am I missing something or could we improve CAPTCHAs by mimicking street numbers?

Do the street numbers also have a lowered solve rate for humans?

Re: Google's Street View computer vision can beat reCAPTCHA with 99% accuracy

#20
post #11

>In this paper, we show that this system is able to accurately detect and read difficult numbers in Street View with 90% accuracy. > Turns out that this new algorithm can also be used to read CAPTCHA puzzles—we found that it can decipher the hardest distorted text puzzles from reCAPTCHA with over 99% accuracy. Am I missing something or could we improve CAPTCHAs by mimicking street numbers?

Google already uses actual street number images from Street View in reCAPTCHA. http://www.google.com/recaptcha/intro/
Post reply on HN