Live data from Hacker News

Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

ai.googleblog.com

51–60 of 786 posts

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#51

Never have we had a more clear example of why Google needs to be regulated, and laws against what they're doing needs to be passed. The fact that they think it's okay to have bots pretending to be human making phone calls, shortly after demonstrating how quickly they can copy someone's voice (re: John Legend), it shows a blatant disregard for what they're creating.

Is it illegal for my secretary or father to make an appointment for me?

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#52

Google home's speech recognition can't even reliably turn my lights on and off every time, why would I trust it to book a restaurant reservation? I'd expect to tell it to book a 6pm table for 2 and wind up with an 8pm table for 10.

Listen to the audio examples. The person at the restaurant misheard the bot and repeated incorrect information back to it and it handled it in stride.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#53
post #13

This is going to be awesome/terrible for social engineering attacks. We'll be training millions of people to to trust phone calls from "Google". But are you talking to Google-calling-on-behalf-of-your-boss, or Google-calling-on-behalf-of-some-phisher? Or better yet, some custom system that pretends to be Google over the phone? Who knows!

That's now how this works, that's not how any of this works. If you have ever been cold called by Google I would go change your passwords and the like.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#54

One positive thing about our dystopian future is that it will force us to meet up more in person, if only to confirm our friends are real.

It's already happening, most people I know rarely, if ever, answer calls from unknown phone numbers.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#55

Google home's speech recognition can't even reliably turn my lights on and off every time, why would I trust it to book a restaurant reservation? I'd expect to tell it to book a 6pm table for 2 and wind up with an 8pm table for 10.

Listen to the audio examples. The person at the restaurant misheard the bot and repeated incorrect information back to it and it handled it in stride.

I just hope it never gets one of the 9 out of 10 humans who don't repeat back important information to prevent miscommunication...

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#56
And then the salon and the restaurant start using Duplex as well, and all phone conversations become Google talking to Google.

How bout: "Hey Duplex, call this support number and get a top level human manager on the line please."

Then we get a HN article: "Duplex is fighting Alexa!"

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#57
The examples they give are quite impressive but I always want to hear some examples of failures as well with these types of technology. They mention that the system is self monitoring and will try to detect a situation it can't handle and redirect to a human operator but I think some examples of situations it can't handle or where it gets things wrong would be very useful in understanding its real world robustness.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#58
post #34

Earlier quoted context omitted.

Just wait until a Google Duplex caller "on behalf of a client" calls to schedule a reservation at a restaurant using Google Duplex to answer the phones.

The most inefficient API you could design!

Seriously. Instead of a single, clean restaurant reservation HTTP POST API, the future is two neural nets modulating and demodulating the request to and from inexact and potentially ambiguous English audio.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#59

> The system also sounds more natural thanks to the incorporation of speech disfluencies (e.g. “hmm”s and “uh”s). These are added when combining widely differing sound units in the concatenative TTS or adding synthetic waits, which allows the system to signal in a natural way that it is still processing. (This is what people often do when they are gathering their thoughts.) In user studies, we found that conversation…

If you are building a system that mimics human speech you need to teach it to be imperfect and use common parlance. Otherwise you will fall into the uncanny valley. If you listen to the conversation again there are several points where they lose immersion. For example no one would say 12 pm, they would say 'noon' instead. Google has clearly done some impressive work here, and I'm now a bit more confident/scared that they will be able to successfully fool me in the next few years.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#60
post #13

This is going to be awesome/terrible for social engineering attacks. We'll be training millions of people to to trust phone calls from "Google". But are you talking to Google-calling-on-behalf-of-your-boss, or Google-calling-on-behalf-of-some-phisher? Or better yet, some custom system that pretends to be Google over the phone? Who knows!

At least in the demo, the system didn't identify itself as a bot. It pretended (fairly convincingly) to just be a person, and seemed focused on interactions (making a restaurant reservation, etc.) that don't involve someone recognizing your voice. In other words, I don't think the attack surface is any different than situations where you could just place the call yourself, save perhaps for the possibility of scaling…

I don't think the scaling concern should be underestimated. Thats a big difference. Its mostly a numbers game.
Post reply on HN