Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Clones Your Voice After Listening for 5 Seconds (2018)

google.github.io

Post reply on HN
Print view View original

281–290 of 338 posts

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#281

Post by firethief »

jancsika wrote: post #200
arkades wrote: post #159

I once got a call while I was lecturing some students. It was repeated three times in three minutes - I assumed it was an emergency and stepped out. I was greeted by someone explaining that my father had caused a car accident, and they were calling on his behalf. That someone would need to send over some money for repairs or they’d call the police. Sure. They added that their cousin, the driver, is a parolee now hold…

> I can only imagine what I’d have done if I’d heard my fathers voice pleading for help. Hm... that certainly gives me pause, and my first reaction was to be very afraid. On the other hand-- it still doesn't hold a candle to pyramid scheme sales techniques. I mean in a lot of cases those involve your actual loved ones betraying your trust and love in order to sell merchandise for a third party. Yet somehow in the fac…

It's harder for Eve to get your loved ones to betray you than to speak for 5 seconds.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#282

Post by xfkechyk »

AbbasHaiderAli wrote: post #39

Wow, impressive results! Already a few examples in the comments of what bad actors could do this tech. I wanted to share an example of something good. I lost my dad about 6 years ago after a Stage 4 cancer diagnosis and a 3 month rapid diagnosis. I have some, but not a lot of video content of him from over the years. My mom still misses him terribly so for her 60th birthday I tried to splice together an audio message…

Reminds me of the LifeAfter podcast: https://www.stitcher.com/podcast/panoply/the-message

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#283

Post by hawaiianbrah »

bjelkeman-again wrote: post #248
r00fus wrote: post #193

Earlier quoted context omitted.

While it's a great idea, how do you test this? Is it worth the time? All my loved ones are on my iCloud so I would just ping their phone/watch while confirming location and asking the assailant to let you hear the phone ping on the line.

Find My Friend is so unreliable for me it is nearly worthless. Apple isn’t really delivering what I need.

Really? How so? I use it probably almost daily and haven’t had an issue, at least I don’t think I have!

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#284

Post by fasturdotcom »

Benjammer wrote: post #270
zaroth wrote: post #238

Earlier quoted context omitted.

B2C - not team internal chats. It will have “jumped the shark” once there’s an SMS button on the business listing that Google Maps displays. Instead of the wonky/creepy Google demo which did speech to text and then analysis and then text to speech relayed over to the business, every business will just communicate directly with customers over text. It’s not that this isn’t already done (to some extent). And more so in…

What is stopping this text-only paradigm shift from happening? What developments are needed before this happens? Why hasn't it happened already? Twilio has given the ability to programmatically text anyone for years. Why hasn't this hypothetical B2C text business developed yet?

The work involved in setting up a server/dashboard for twilio to work is too high for it to be popular for mass independent businesses.

This hints that a "shopify for twilio" would be popular

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#285

Post by filoeleven »

jimmydorry wrote: post #208
filoeleven wrote: post #170

Earlier quoted context omitted.

Better provenance is the way to guard against fakes. For video and audio, I imagine a combination of hardware signing, perhaps with the camera itself living on an isolated, Secure Enclave-like chip, and sending hashes of (incoming images/video * deviceID * trustedTimestamp) to a blockchain or some other public distributed ledger. Getting the timestamp from a service that keeps its own record adds further security. Th…

If you are trusting a camera to upload to a blockchain, the same can be simulated on a computer, given enough time.

Sure, that’s the reason for including the 3rd-party timestamp AND for keeping the device signing keys on a separate secure chip. The idea is to say “these images/sounds were recorded at this time by this device,” and to have that statement both registered publicly at the time of creation and backed by the reputation of the device maker.

It’s acknowledging that using AI to catch AI fakes is a fool’s errand, and relies instead on the premise that hashing a raw data stream is much faster than producing a good fake, and that a secure device key is secure. You’d need both for it to work, otherwise you can generate a deepfake beforehand and get the device to sign a fake stream. That may be easier to do than I think; this is not my area of expertise.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#286

Post by fasturdotcom »

Angostura wrote: post #32

My bank's (HSBC) telephone banking offers the option do away with a PIN and instead a 'my voice is my password'phrase system. I'm glad I never opted in.

unchecked, the progress of this technology and the staleness of banking security might cause entire institutions to fail

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#287

Post by willmadden »

Lucadg wrote: post #100

At first glance there seems to be more more malicious uses than good ones with voice. Yes, hearing someone dear to me say things he/she never said maybe comforting. Anything else? Maybe some movies with the deceased actor's voice? But what if someone who wants to hurt me sends me files (or phone calls) from the deceased person saying horrible things like: - "I am still alive but left as I was tired of you" - "oh Jan,…

>We will never be able to believe voice again...how will we adapt?

"Say, Grandma, before I wire the money, what's the name of your cat?"

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#288

Post by fasturdotcom »

jermaustin1 wrote: post #43
rshi wrote: post #41

I wonder what the legal implications of this alongside similar developments like deepfakes are going to be in the next couple years. We're already having fraudsters impersonate CEOs using Deep learning-aided Voice generation[1] due to just how low the barrier of entry is now. There's already a public implementation of the paper out [2]! [1]: https://www.wsj.com/articles/fraudsters-use-ai-to-mimic-ceos... [2]: https:/…

The latest episode of Blacklist had a dark plot based on deep-fakes.

didn't know new season was out! thx!

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#289

Post by fasturdotcom »

thimkerbell wrote: post #61

Ok, what happens to society when this gets to be really good?

computers will have unique voices.

someone will invent a conversational interface for programming

the worlds demand for human programmers will go near 0

everyone will call themselves an engineer and live on basic income

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#290

Post by sundarurfriend »

ben_w wrote: post #154
nwsm wrote: post #119

Earlier quoted context omitted.

Images of us can be sourced from any number of places: social media, government surveillance, private surveillance. Video less so but from the same sources. Audio from phone companies, VoIP services, surveillance, etc. Health data easily from a number of private companies if you use new-age "health" services, or less easily (illegally) from health records. Maybe we can find solace in the fact that is or will soon be…

“Don’t worry, just about anyone can steal your soul and there’s nothing you can practically do to stop it” That doesn’t seem like a message of solace to me.

>> Maybe we can find solace in the fact that is or will soon be infeasible to avoid, so we needn't try to avoid it.

It's the meager solace of the absolution of personal responsibility - there's no way to avoid it, so at least no one can say "why did you allow that to happen to you".

Post reply on HN