Live data from Hacker News

AI Clones Your Voice After Listening for 5 Seconds (2018)

google.github.io

61–70 of 338 posts

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#63

Wow, impressive results! Already a few examples in the comments of what bad actors could do this tech. I wanted to share an example of something good. I lost my dad about 6 years ago after a Stage 4 cancer diagnosis and a 3 month rapid diagnosis. I have some, but not a lot of video content of him from over the years. My mom still misses him terribly so for her 60th birthday I tried to splice together an audio message…

Seems like,

> This is just

>> All can be returned, all can be taken away

> with extra steps.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#64

The malign applications of this technology greatly outweigh the benign. Discuss.

I think there are many benign applications, and definitely a massive potential for abuse. In practice, it will be used mostly for benign applications, I think, but due to the outsized impact, you could still say the malign applications outweigh.

However, what I found reassuring is that the paper actually addresses these concerns:

"However, it is also important to note the potential for misuse of this technology, for example impersonating someone's voice without their consent. In order to address safety concerns consistent with principles such as [1], we verify that voices generated by the proposed model can easily be distinguished from real voices"

This doesn't mean it won't fool humans, especially when used in a carefully crafted setting (low-quality phone call with distressing content).

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#65

Wow, impressive results! Already a few examples in the comments of what bad actors could do this tech. I wanted to share an example of something good. I lost my dad about 6 years ago after a Stage 4 cancer diagnosis and a 3 month rapid diagnosis. I have some, but not a lot of video content of him from over the years. My mom still misses him terribly so for her 60th birthday I tried to splice together an audio message…

When I interviewed Ray Kurzweil we talked about the obvious-in-hindsight insight that his life’s work was essentially trying to build an AI to bring his father back to life.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#67

It means we can talk to anyone forever

It means you can make someone talk, non-stop, for an indefinite amount of time.

Now I want to make an art piece that's just a valley girl droning on, and on, and on, and on about believable and obnoxious life experiences. The stores they go to, how they feel about certain colors, what "too spicy" is. It just never stops.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#69

Earlier quoted context omitted.

Good luck with that. The best product you'll come up with is some sort of snake oil. The whole point of GANs is that you can't really "detect" the synthesized components anymore. Not that this would/will stop people from claiming otherwise in the spirit of profitablity :-)

GANs may produce imagery or audio which fools humans, but they are unlikely to consistently produce imagery or audio which fools humans over time.

GANs train by fooling AIs, not humans. Fooling humans is a side effect, not the primary thing trained for (mostly because that's cheaper of course). It's just that humans are in some ways different from AIs in terms of fooling.

Looking at the papers I must say I think the ability to fool humans is a scale problem, not a fundamental limitation. Already GAN produced images and sounds survive "normal" human scrutiny: if you have no reason to suspect foul play you won't see it. If you really go looking, you'll see it.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#70

AI can make decisions, create deep fakes, and now, clone voices. It may be that the next big business opportunity lies in creating 'anti-AI' technology just as it did with antiviruses in the 90's and 2000's

Good luck with that. The best product you'll come up with is some sort of snake oil. The whole point of GANs is that you can't really "detect" the synthesized components anymore. Not that this would/will stop people from claiming otherwise in the spirit of profitablity :-)

No, GANs train exactly one discriminator, jointly with the generator. There's no guarantee that you can't train another good discriminator out of band.

Furthermore, GAN discriminators are (as I understand it) often hobbled a bit to ensure that the generator can make progress on the loss function. An always-correct D doesn't provide a useful gradient.

Post reply on HN