Live data from Hacker News

Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

ai.googleblog.com

131–140 of 786 posts

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#131
post #32

Earlier quoted context omitted.

I wonder if they detect that and solve whatever task it is directly then.

It'd be trivial to detect if they transmit high-frequency noise over the line, and then fallback to DTMF tones.

Since the restaurant in this situation is clearly using a digital booking system already why would Google (or whatever service inherits this kind of bot call) not just check on the popular booking sites before placing the call?

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#132

I worry that this will make people have an AI make phone calls for them regularly when they wouldn't have in the past. At some point, the restaurants will need to have their own AI to respond to the call volume. You end up with 2 AIs attempting to have a conversation.

Give your credit card number to one of them and it will be even more fun.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#133
post #13

This is going to be awesome/terrible for social engineering attacks. We'll be training millions of people to to trust phone calls from "Google". But are you talking to Google-calling-on-behalf-of-your-boss, or Google-calling-on-behalf-of-some-phisher? Or better yet, some custom system that pretends to be Google over the phone? Who knows!

Either that, or it will train people to stop trusting a phone call as some sort of authentication. The whole social engineering problem is that when somebody gets a phone call, they trust that the person at the other end is who they say they are. Which can be a false assumption. When the robots start calling, maybe people will finally stop making that assumption automatically.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#134

Earlier quoted context omitted.

At least in the demo, the system didn't identify itself as a bot. It pretended (fairly convincingly) to just be a person, and seemed focused on interactions (making a restaurant reservation, etc.) that don't involve someone recognizing your voice. In other words, I don't think the attack surface is any different than situations where you could just place the call yourself, save perhaps for the possibility of scaling…

So now I can script a bot to book restaurant reservations all over the city at busy times. Then nobody shows up for the reservations, the busy time has passed, and customers have moved on or gone home. Restaurants make or break on one or two nights in a month. A calculated social engineering attack like this could bring down hundreds of restaurants in a city, which would cause millions of dollars in lost taxes, and y…

How would you script "script a bot" - i think you're underestimating the effort. You'd have better luck trying to attack by mass booking manually.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#135

This is awesome, But The algorithm of cause doesn't understand all contexts. What troubles me is that, in the first example, should we really give algorithm the freedom to propose a new date for an appointment? It reminds me one thing that particular bothers me with the Gmail's smart reply feature, where when given Monday or Wednesday as options, the suggested reply is, 'How about Tuesday', which does make the conver…

Ideally this would have to have access to your calendar or be given a time range of options.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#136

I worry that this will make people have an AI make phone calls for them regularly when they wouldn't have in the past. At some point, the restaurants will need to have their own AI to respond to the call volume. You end up with 2 AIs attempting to have a conversation.

If the main impediment to dining at a restaurant was having to reserve a table, I think that would be a real possibility. But the main impediments are usually cost, complexity in getting to the restaurant, unfamiliarity with how good the food and service are, agreeing with the rest of the party about the timing, etc.. The actual booking of a table is a minor stepping stone on the road from the thought to the actual execution of the plan.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#137

And then the salon and the restaurant start using Duplex as well, and all phone conversations become Google talking to Google. How bout: "Hey Duplex, call this support number and get a top level human manager on the line please." Then we get a HN article: "Duplex is fighting Alexa!"

I wonder who’s have the last laugh on this.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#138
post #71

Never have we had a more clear example of why Google needs to be regulated, and laws against what they're doing needs to be passed. The fact that they think it's okay to have bots pretending to be human making phone calls, shortly after demonstrating how quickly they can copy someone's voice (re: John Legend), it shows a blatant disregard for what they're creating.

How would you handle deepfakes? This is much more disturbing than what is in the post, and it isn't a corporation who built it. I don't think this has anything to do with regulating google.

The reality changes. Fast. You won't be able to trust photos, audio recordings, or videos. You will be able to trust digital signature. To have any opinion whether information about somebody else is real you will need a working web of trust. It's gonna be a great thing and I can't wait for it. It's going to change news, politics and in general the world we live in. It's going to be bigger than the Internet but way more polarizing and controversial. IMHO

One issue though, unless we hurry up and make this WoT decentralized and with open protocols, well, we will get it from FB and the likes.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#139
post #13

This is going to be awesome/terrible for social engineering attacks. We'll be training millions of people to to trust phone calls from "Google". But are you talking to Google-calling-on-behalf-of-your-boss, or Google-calling-on-behalf-of-some-phisher? Or better yet, some custom system that pretends to be Google over the phone? Who knows!

Clever social engineering is really customized, but social engineering that works "often enough" is mostly reducible to a flow chart. If you can automate it, your response rate only needs to be, what, like people clicking on spam? Tiny. The days of trusting meat sacks with important information might be numbered. Someone should make the dystopia where Skynet doesn't build terminators, but call centers.

When people talk about AI taking over, they really need to consider this route. Social engineering most of the world simultaneously. It doesn't have to build armies of robots when we'll tear everything down for it.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#140
Avi Ovadya among others has talked about a coming infopocalypse in which fake anything can be generated. Combined with data troves from Facebook or wherever they can simulate actual people to completely steal identities on a large scale and create a society disrupting mass hysteria to start a war or a mass panic.

IMHO, to fix this everything needs two factor authentication generated by a biometric scan in person at a government office. Yes you could use a blockchain for it too.

Post reply on HN