Live data from Hacker News

AI Clones Your Voice After Listening for 5 Seconds (2018)

google.github.io

201–210 of 338 posts

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#201

I once got a call while I was lecturing some students. It was repeated three times in three minutes - I assumed it was an emergency and stepped out. I was greeted by someone explaining that my father had caused a car accident, and they were calling on his behalf. That someone would need to send over some money for repairs or they’d call the police. Sure. They added that their cousin, the driver, is a parolee now hold…

[deleted]

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#202

The malign applications of this technology greatly outweigh the benign. Discuss.

I'm currently working by myself on a game that will likely launch without voice acting (text only) because I don't have the money or skill to find and pay voice actors. If I could act out the dialog myself and then purchase or generate voices other than my own to overlay on top of those performances, the quality and accessibility of my finished product would go up dramatically. That would also open up the door for mo…

Have you tried out Replica? I can hook you up with a beta account to see if it'll help with your voice acting.

https://replicastudios.com/

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#203

It will be interesting to see if these made-up AI voices can deliver jokes with the same tonality and delivery as good comedians can. I'm just a layman but it feels like a hard problem to solve.

The furthest right column in the first table shows that they might be a long way off from getting timing right. The 5-second sample happens to have a comma, at which the speaker pauses; this pause is in most of the generated output, at seemingly random places in the sentence. The one sentence that does have a comma doesn't use the pause, either.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#204

I once got a call while I was lecturing some students. It was repeated three times in three minutes - I assumed it was an emergency and stepped out. I was greeted by someone explaining that my father had caused a car accident, and they were calling on his behalf. That someone would need to send over some money for repairs or they’d call the police. Sure. They added that their cousin, the driver, is a parolee now hold…

It was a real rollercoaster reading this comment! Also now, you have to also be worried about talking back being a smartass, because now they will record YOUR voice and use it to contact another loved one...

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#205

What it is doing is not really cloning, but because it was trained on 18k different voices, it actually finds one that is closest to yours, and uses that one. It can do a bit of interpolation to create an embedding which is closer to your own, but only if it is well represented by a mix of other voices. Real voice cloning like at https://replicastudios.com/ can take just a minute or two of audio, and it does a fairly…

Was it 18k voices or samples? Also, is it finding the closest voice, or is it a continuous parameter space formed from the voices?

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#207
post #100

At first glance there seems to be more more malicious uses than good ones with voice. Yes, hearing someone dear to me say things he/she never said maybe comforting. Anything else? Maybe some movies with the deceased actor's voice? But what if someone who wants to hurt me sends me files (or phone calls) from the deceased person saying horrible things like: - "I am still alive but left as I was tired of you" - "oh Jan,…

It doesn't have to be about creating audio of specific text with 's voice; it can be much more about creating audio of specific text with a wide variety of believable people's voices. I could see this, if it becomes commercially viable, potentially being a huge boon to indie game creation, for instance, since hiring a load of voice actors to record the dialogue for an entire game is vastly more expensive than, say, h…

This 100%. It's not about impersonating someone, it's about providing natural sounding text-to-speech for games, film, robots etc.

We're currently working on using voice AI to create real products over at https://replicastudios.com

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#208

AI can make decisions, create deep fakes, and now, clone voices. It may be that the next big business opportunity lies in creating 'anti-AI' technology just as it did with antiviruses in the 90's and 2000's

Better provenance is the way to guard against fakes. For video and audio, I imagine a combination of hardware signing, perhaps with the camera itself living on an isolated, Secure Enclave-like chip, and sending hashes of (incoming images/video * deviceID * trustedTimestamp) to a blockchain or some other public distributed ledger. Getting the timestamp from a service that keeps its own record adds further security. Th…

If you are trusting a camera to upload to a blockchain, the same can be simulated on a computer, given enough time.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#209
post #147

In a couple of years we won't be able to trust any media. I wonder what the cultural implications will be, much like photoshopped models and actors have change the beauty ideals.

There are a lot of security features that are being put in place to help us all understand what is real and fake. Of course there is still a lot of work to be done and the technology is very new, but at https://replicastudios.com/ work in watermarking audio, as well as authentication of Replica voices and detection of fake, non-authorised replicas is already in progress.

Facebook, YouTube, Twitter, and the likes, will then be able to let users know what is using real (actual real voices, or the authenticated Replica voice) or fake voices.

Post reply on HN