Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Clones Your Voice After Listening for 5 Seconds (2018)

google.github.io

Post reply on HN
Print view View original

271–280 of 338 posts

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#271

Post by sangnoir »

justinjlynn wrote: post #245
sangnoir wrote: post #81

Earlier quoted context omitted.

Is it that difficult to create/retrofit an AV container format for cryptographically signed audio and video streams? Key management & revocation could be a pain, but it's something that consumer electronics companies like Apple could do: think of it as the MPEG LA, but with signature checking & non-repudiation.

Congratulations, you have now created a class of people who can forge audio and video streams at will, relatively cheaply - and an underclass of people who cannot and may not even be able to record genuine footage they wish to record. This is not a road you want to go down.

No - I just created the equivalent to https for video; the "underclass" can still create, share and play unsigned videos - those would get low-trust warnings[1] (as they should, just like there is an "underclass" with no cert for their site). This wouldn't take away anything from todays' tech, only adds attestation for person/org behind videos they would like to mark as "official".

1. (edit) It occurred to me that some people may wish to manage the public keys independent of (say, Apple) and they could distribute via keybase or key-signing parties, so they actually don't have to suffer low-trust warnings. Now that I think of it, instead of merely signing streams, they could be signed and encrypted using recipients PK for 1:1 transmissions. Obviously law enforcement won't be a fan

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#272

Post by code_code »

ihm wrote: post #4

Reading this headline I begin to understand certain people’s worry about having their soul stolen upon being photographed.

Even decades ago I gave such reported concern with photographs more credence than the typical western account of it. I also wondered if the translation was precise enough -- could it (in some cases) have reflected a concern with "essence" more generally? Even without reference to a soul the concern can be a bit immaterial.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#273

Post by justinjlynn »

sangnoir wrote: post #271
justinjlynn wrote: post #245

Earlier quoted context omitted.

Congratulations, you have now created a class of people who can forge audio and video streams at will, relatively cheaply - and an underclass of people who cannot and may not even be able to record genuine footage they wish to record. This is not a road you want to go down.

No - I just created the equivalent to https for video; the "underclass" can still create, share and play unsigned videos - those would get low-trust warnings[1] (as they should, just like there is an "underclass" with no cert for their site). This wouldn't take away anything from todays' tech, only adds attestation for person/org behind videos they would like to mark as "official". 1. (edit) It occurred to me that so…

Law enforcement will just coerce the CA system you've suggested to secretly improperly issue certificates. Just as it does with the current CA system. Problem not solved - it's just hidden.

You conflate content trustworthyness with origin sureity but a CA system doesn't even provide that.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#274

Post by LargoLasskhyfv »

inetknght wrote: post #264
LargoLasskhyfv wrote: post #250

Earlier quoted context omitted.

Why are there people who are legally required to answer the phone? On what grounds? Why? (Assuming private persons here)

For example: people who are entangled in the court systems are required to answer their phone. Even if they're not convicted and are out on bail, they still must answer the phone -- it could be their bail bondsman. If someone's on parole, they must answer their parole officer. So as part of the bond contract and the parole contract, you must answer the phone.

Oh!

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#275

Post by JaRail »

azinman2 wrote: post #267
JaRail wrote: post #239

Earlier quoted context omitted.

Did you read section 3 of the paper where they evaluate their system? > We primarily rely on crowdsourced Mean Opinion Score (MOS) evaluations based on subjective listening tests. All our MOS evaluations are aligned to the Absolute Category Rating scale [14], with rating scores from 1 to 5 in 0.5 point increments. We use this framework to evaluate synthesized speech along two dimensions: its naturalness and similarit…

Evaluation doesn’t make it science. There’s no investigation of the physical or natural world going on, unless they really think they’re modeling how humans are able to talk. But they’re not — they’re trying to create a system that works no matter how unnatural it is.

I'll take that as a no.

> There’s no investigation of the physical or natural world going on

I just quoted them describing their observational method! Do you just not believe psychology is a science?

> unless they really think they’re modeling how humans are able to talk

I've lost you. They're not generating birdsong. What do you think WaveNet does exactly?

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#276

Post by skykooler »

smush wrote: post #128
skykooler wrote: post #112

Earlier quoted context omitted.

Exactly. I was working on an Air Traffic Control mod for Kerbal Bpace Program, but the work has gone on hold due to having to find enough people to record all the lines (to have a decent number of airport voices). Being able to record everything once, and only having to find people willing to let me record five seconds of speech rather than a lengthy recording session, would make this much more feasible.

Hypothetically, if we were interested in donating some voice samples, where would we look to see what lines were needed?

I haven't uploaded the list of lines; I should add that to the github repo.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#277

Post by [deleted] »

airstrike wrote: post #242
drbawb wrote: post #96

Earlier quoted context omitted.

When I was doing a computer repair: I remember a woman coming in with a digital answering machine; the kind that stored its recordings in volatile flash. During a thunderstorm the night prior the machine lost power, and subsequently lost all the stored recordings. As it happens some of those lost recordings included messages from the woman's late mother. That moment has stuck with me for many, many years. The heartbr…

My pet project I will likely never have the resources to work on would be AI-generated 3D virtual environments based on old photos / videos that you could navigate in VR and relive long lost memories I'd pay a good amount of money to be able to relive certain experiences from my childhood with that level of immersion

[deleted]

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#278

Post by sillysaurusx »

I used this repository to make Half Life’s Dr. Kleiner sing “I am the very model of a modern major general”:

https://twitter.com/theshawwn/status/1171806394783326208?s=2...

https://www.youtube.com/watch?v=koU3L7WBz_s

Then @jonathanfly deepfaked Dr Kleiner’s face onto a live performance of the song, which was hilariously unexpected. The AI twitter scene is awesome:

https://twitter.com/jonathanfly/status/1171907301231513605?s...

There is some promising new work in the GitHub issues. For example, someone has been training on ~10,000 additional speakers.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#279

Post by sillysaurusx »

JaRail wrote: post #233
Riccardo_G wrote: post #199

What it is doing is not really cloning, but because it was trained on 18k different voices, it actually finds one that is closest to yours, and uses that one. It can do a bit of interpolation to create an embedding which is closer to your own, but only if it is well represented by a mix of other voices. Real voice cloning like at https://replicastudios.com/ can take just a minute or two of audio, and it does a fairly…

I'm not really sure where you're getting this. It doesn't pick a specific voice from a database to use. From their introduction: "Our approach is to decouple speaker modeling from speech synthesis by independently training a speaker-discriminative embedding network that captures the space of speaker characteristics and training a high quality TTS model on a smaller dataset conditioned on the representation learned by…

They’re saying that underrepresented voices will have trouble being modeled. That matches my experience with this project: for example, I had a very tough time cloning female voices compared to nerdy-sounding / deep male voices.

Re: AI Clones Your Voice After Listening for 5 Seconds (2018)

#280

Post by johnsonjo »

I was literally just researching tts (text to speech) programs yesterday and I believe Mozilla’s open source (open source in this case meaning weak copyleft) TTS [1] also uses Tacotron and is trying to implement multi speaker tts currently [2]. I literally just posted Mozilla’s TTS to hacker news [3] without even seeing this which made me experience a bit of the Baader-Meinhof Phenomenon [4].

[1]: https://github.com/mozilla/TTS

[2]: https://github.com/mozilla/TTS/blob/master/README.md#major-t...

[3]: https://news.ycombinator.com/item?id=21532189

[4]: https://en.m.wikipedia.org/wiki/List_of_cognitive_biases#Fre...

Post reply on HN