Live data from Hacker News

Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

ai.googleblog.com

711–720 of 786 posts

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#711
post #638

Earlier quoted context omitted.

May 2001: “XML: the universal language?” https://www.computerweekly.com/feature/XML-the-universal-lan... I recall a Wired article from the same era. “XML means your doctor’s system can just talk to the hospital system even though they’re different!” Hasn’t happened yet... will it? Can it?

> Hasn’t happened yet... will it? Can it? Nope. XML (or Json, etc.) are just "human-readable" presentation of data. It does not provides any semantic whatsoever. So you need some semantic on top of these data. And a general-purpose, universal API is yet to be invented (hint: it is probably not feasible)

Of course it's feasible. It's called English!

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#712
It's worth noting that Google Assistant has been able to make reservations with OpenTable since 2014. No need to have Duplex talking to Duplex; it's just protobufs or JSON or XML or whatever people use nowadays for RPCs.

Google Duplex is about helping the long-tail -- it's work that is done by studying the needs and processes of the smallest of small businesses, and tailoring a product just for them.

I've lost count of the number of college hackathon projects where they say, "oh, push a button and you get a pizza" and they think they'll just put an iPad in the kitchen, and then fizzle out when they get to a real restaurant.

In practice, the restaurant might pass around pieces of paper in the kitchen. So you think, oh, I'll put in a thermal receipt printer. But then you realize that they don't have Wi-Fi or internet, so now you have to put in a $70/month internet bill, on top of the phone bill, and a router or two. So you think, "oh, I'll use a fax machine", or "I'll integrate with the point of sale system". But the fax machine runs out of paper, and the point of sale system is an offline piece of ---- running Windows XP. And even if you do get them using an iPad or OpenTable or Yelp or whatever, before you know it, you have waiters writing on a computer monitor with a whiteboard marker: https://javlaskitsystem.se/2012/02/whats-the-waiter-doing-wi...

But every one of these businesses has a telephone number, whether it's a landline or a cell phone or whatever.

When pg says to talk to your customers (https://twitter.com/paulg/status/898476047263518720), he means, talk to your customers. You'll be surprised by what you learn.

(Disclaimer: I work at Google, but on YouTube, not on this product.)

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#713
post #638

Earlier quoted context omitted.

> Hasn’t happened yet... will it? Can it? Nope. XML (or Json, etc.) are just "human-readable" presentation of data. It does not provides any semantic whatsoever. So you need some semantic on top of these data. And a general-purpose, universal API is yet to be invented (hint: it is probably not feasible)

Microsoft and others enterprise selling vendors loved the end goal back in early 2000s - the universal API solved by middleware. That's why you had Biztalk and Biztalk consultants that made more than SAP consultants (think todays crazy Salesfarce consultants that compete for gamification badges). For example you could be a small insurance company submitting to a larger underwriter, and when you work out the transacti…

In the 80's, it was EDI -- electronic data interchange, a set of schemes for sending binary formatted business data, like invoices and POs.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#714
post #568
post #399

Earlier quoted context omitted.

English, an API with over 1.5 billion clients in the wild

If it was that straightforward, we’d already have bots that pass the Turing Test. Whatever natural language is, it’s not an API. Might have some overlap, but it’s different.

Natural language is not an API. But a business can assume (or weed out quickly) that caller is calling to hit a specific API endpoint. And as such their language will eventually lead to one of those endpoints.

And similarly, a caller can assume the business they are calling is trying to lead them to an endpoint.

In both cases, a set of assumptions lets natural language act as an API, even if neither end could pass a Turing test with someone who wasn't interested in any of the endpoints.

edit: I read your point about language changing, and that is true. But if we only have machines using the language with each other (no more training with humans), we can also assume the language won't change.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#715
post #310

The people losing their marbles over this being some kind of Turing Test passing distopian stuff are missing the point at how limited this domain is. People who answer phones to take bookings perform an extremely limited set of questions and responses, that’s why they can even be replaced by dumb voice response systems in many cases. In these cases, the human being answering the phone is themselves acting like a bot…

> The end game would be for the business to run something like duplex on the other side, and you’d have duplex talking to duplex. And looking even further into the future, we can imagine a day when the computers forgo natural speech and use a better-suited form of communication. Some kind of sequence of ones and zeros transmitted directly across the wire.

You can't just drop compatibility. We will have A.I. trained voice systems that mimic natural speech just enough to be understood by duplex while compressing the exchange to a minimum. Data transfer will be measured in microwords per second. Future versions of duplex will of course detect this kind of compressed speech and reply in kind, falling back to normal speech only if the immediate response is similar to north american confusion.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#716
post #557

Google itself (Google Search) is extremely wary of being used by "bots" and uses string of captchas to screen them out. But search is just a machine. That Google would create bots to talk to real people is horrifying. This is only possible if Google doesn't in fact think of working people answering the phone, as really human. This is like doing war with drones instead of soldiers. This may sound over the top, but bea…

In middle age Europe, designated herolds came to the town centre and recited news and gossip - an equally time consuming contract for both sides. The invention of the Newspaper eliminated that - wouldn't you say that this change was, while disruptive, for the better?

I think you meant to write "town crier" instead of herald [0], though its wikipedia page does mention herald in the "See also" section.

[0] https://en.wikipedia.org/wiki/Town_crier

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#717

The people losing their marbles over this being some kind of Turing Test passing distopian stuff are missing the point at how limited this domain is. People who answer phones to take bookings perform an extremely limited set of questions and responses, that’s why they can even be replaced by dumb voice response systems in many cases. In these cases, the human being answering the phone is themselves acting like a bot…

I feel like a lot of people who are pointing out the limitations show a failure in imagination of where this will go in the future. I don't care about the obscure technical limitations now, those are just engineering problems that will be solved in very short time.

I'm not afraid of the machines going all singularity or skynet or whatever, becoming sentient and taking over the world as some kind of robo-Hitler. That's moronic. But what does worry me is the normalization of having a machine do everything for you, plan your whole life, access every little detail of every bit of your personal data and lifestyle.

Of course we've already had that for a while with the way phones work. But this is another step towards getting public consensus for using it in new ways. Once people are used to this, we'll have more and more systems with conversational software that manages your life for you. Speaks on your behalf. Interfaces with the world for you because doing it yourself is far too stressful and inconvenient.

And of course it'll be a free, advertising-supported model so all that data will have to be shared with, among many things, shady political organizations to try to gain every little advantage possible to manipulate public opinion and steer themselves into enormous power.

Think of where the cell phone started off: just a phone in your pocket. It's so much more now. Remember that when thinking about these AI assistants and what they will develop into. I'm not afraid of the classical AI apocalypse. I'm afraid that these systems will do exactly what they're designed to do. That people are underestimating just how much power lies in these little inconveniences in life, once they're all added up and analyzed and tallied.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#718

The people losing their marbles over this being some kind of Turing Test passing distopian stuff are missing the point at how limited this domain is. People who answer phones to take bookings perform an extremely limited set of questions and responses, that’s why they can even be replaced by dumb voice response systems in many cases. In these cases, the human being answering the phone is themselves acting like a bot…

Umm...hmm...I got you.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#719

There's a great Black Mirror episode in here somewhere. Imagine five years from now, this tech and Google's Smart Reply ( https://blog.google/products/gmail/save-time-with-smart-repl... ) have evolved to the point where they can basically write entire email responses or have whole conversations without your input. You could develop elaborate friendships where both parties are just having their AIs converse and aren't…

Jesus. We're really reaching an age in which it's too inconvenient to talk to other people. I gotta wonder if the huge spike in anxiety disorders is somehow connected in there somewhere.

We're not using technology to do fantastic things. We're largely using it to enable fantastic laziness and entertain the habitually bored. I wonder what trivial little convenience would actually spur us to draw the line and say "Enough. Get out of my life." I'm envisioning a device which would access all your most secret sexual urges, but it would allow you to fart while sitting down without lifting one ass cheek. I bet we'd leap at that.

I'm extremely disappointed in us.

Re: Google Duplex: An AI System for Accomplishing Real World Tasks Over the Phone

#720

I did a whole write up about my homegrown attempt to do this last summer. That blog post from Google is more technical but eerily similar. https://philandrews.io/post/20000-phone-calls-later-why-siri... In short, I don't have a lot of faith in this being plausible yet. The major reason is the phone lines. Phone call quality is not solid enough to ensure a accuracy rate high enough to roll this out as a production ser…

It was the most impressive thing in the keynote for sure, but given the current state of AI we should have no reason to believe that this would work well enough to be employed at scale. It also feels weird that it is trying to trick the callee that it is a human. I believe even if they used a mechanical voice, the system could work, because businesses would learn to recognize the "google call" and respond to it the w…

I agree. There's a whole world where I imagine businesses with stickers like the Visa accepted here stickers, except something like "Siri accepted here" or "Siri works here", whatever the wording. That way you would know that you could use Siri to interact with that business on your behalf. That takes away part of the resistance to phone bots by people that answer phones, them expecting those calls.
Post reply on HN