Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

It’s Game over on Vocal Deepfakes

daringfireball.net

Post reply on HN
Print view View original

81–90 of 122 posts

Re: It’s Game over on Vocal Deepfakes

#81

Post by tzs »

gnicholas wrote: post #38

Does anyone have suggestions on verbal ways to authenticate family members, for example, on the phone?

Someone should make a family authentication app. It would generate a TOTP secret and associated QR code that could be shared with other family members. (This app does not have to be a mobile app. It could be a desktop app, or even a web app that runs locally in the browser).

Have every family member scan that code for use with the TOTP authenticator of their choice on their phone and/or tablet and/or watch.

When you are talking to someone who purports to be a family member you ask them for the family TOTP code and check to see if they give the same code that your TOTP authenticator on your phone or watch is showing.

Re: It’s Game over on Vocal Deepfakes

#82

Post by philistine »

MBCook wrote: post #60
rdedev wrote: post #32

Earlier quoted context omitted.

My guess would be for voice actors to copyright their voices. I am not familiar with the voice generation ML but i guess for things like dramatic pauses a voice actor might still be needed. Also I'm guessing it should be fairly straightforward to detect such copyright violations. I would really like to see it implemented for heavy text driven rpgs. But overall yeah things look bad for voice actors in general

Copyright might not be needed. SAG created a rule after Crispin Glover’s face was used without permission via a prosthetic in Back to the Future 2 to ensure it never happened again. I could easily see a similar rule being added by an appropriate union to their contracts to prevent AI copies of voices that weren’t approved by the original actor.

Video game voice actors are famously not unionized.

Re: It’s Game over on Vocal Deepfakes

#83

Post by pabs3 »

capableweb wrote: post #63
gnicholas wrote: post #38

Does anyone have suggestions on verbal ways to authenticate family members, for example, on the phone?

One way: Everyone has a code-word which they only share with humans, over "private" channels like direct voice calls. For example, I'm "pineapple", and you're "orange", when we're connected on a call, we share our code-words in order to "authenticate" the call. Another way: have a passphrase with a group of people that you share with each other, that is hard to guess but memorable. "The sky was green this morning" fo…

You'll want to vary all of those over time to protect against leaks/hacks.

Re: It’s Game over on Vocal Deepfakes

#84

Post by lazyeye »

rvz wrote: post #41
Teever wrote: post #13

Earlier quoted context omitted.

Name the Roger Stone or Steve Bannon of the left.

Sure. The BLM fraudsters Alicia Garza, Patrisse Cullors, and Opal Tometi whose grifting campaigns brought in $180M for the organization only for them to spend it on themselves. More than what Roger Stone or Steve Bannon's worth combined. Again. Let us not pretend that only one side can use this for their next so called 'donations' or 'fundraising campaign'. Both of them will, to influence the electorate of their choi…

It seems for the most part though, only one side is reported in the majority of the media and/or prosecuted.

Re: It’s Game over on Vocal Deepfakes

#85

Post by andreareina »

smitty1e wrote: post #16
Teever wrote: post #12

Earlier quoted context omitted.

Imagine an AI voice of Trump that phones lonely old people to thank them for coming to his rally. After 20 minutes of small talk he asks them to donate to his campaign via bitcoin...

Lonely old people sophisticated enough to do bitcoin? Color me skeptical.

I know at least a couple. Doesn't take much sophistication with all the hype the last few years and different apps making it easy. It's essentially as easy as using any other mobile payment tech e.g. mpesa or alipay

Re: It’s Game over on Vocal Deepfakes

#86

Post by andrewflnr »

unlikelymordant wrote: post #59
NoZebra120vClip wrote: post #45

Earlier quoted context omitted.

Conceivably, anyone who uses his or her voice for spoken word or singing could, in theory, cryptographically sign each master copy of the recording, and therefore certify that they were present and active in its creation. Of course any post-processing would lose this attestation. So it's practically useless, I suppose. But it would be a first-line of defense in copyright cases, at least, by being able to say "I did i…

Maybe a use case for NFTs hah.

It's a use case for merkle trees. Since the mere existence of the hash at a reasonably well-attested time is sufficient, you don't need the rest. A handful of central roots of various trees is fine, morally equivalent to announcing things with an ad in the newspaper.

Re: It’s Game over on Vocal Deepfakes

#87

Post by weard_beard »

eddiewithzato wrote: post #57
geuis wrote: post #4

Once the generation times get to real-time, I dunno what's going to happen. I follow the voice acting community a lot and this is a big existential threat level of worry in that community. But I also see some positives for the narrative voice field, but at the expense of actual actors. The latest sequel to a favorite audio book series has the professional narrator pronouncing different character names and town names…

it’s already here. People on the chans are using a alexjones model to sing anime songs and it worked really well.

You've piqued my curiosity. Got any links?

Re: It’s Game over on Vocal Deepfakes

#88

Post by wilsonnb3 »

ethicalsmacker wrote: post #49
DethNinja wrote: post #5

Those fake AI voices are perfect tools for phishing campaigns. I wonder if ChatGPT combined with a voice generator can mount successful phishing campaigns. It looks like Cyberpunk future we never asked is already here.

"Hey mom, it's X. Sorry to leave this voice mail, I got in a bit of a car accident and lost my phone. I need to get back home, could you send $$$$ to ####?"

Just have to establish real life security questions.

They did this in one of the Harry Potter books (the sixth one?) since it is easy for them to impersonate other people.

If you can’t tell me my favorite flavor of jam then you aren’t getting my money.

Re: It’s Game over on Vocal Deepfakes

#89

Post by debatem1 »

NoZebra120vClip wrote: post #45
rdedev wrote: post #32

Earlier quoted context omitted.

My guess would be for voice actors to copyright their voices. I am not familiar with the voice generation ML but i guess for things like dramatic pauses a voice actor might still be needed. Also I'm guessing it should be fairly straightforward to detect such copyright violations. I would really like to see it implemented for heavy text driven rpgs. But overall yeah things look bad for voice actors in general

Conceivably, anyone who uses his or her voice for spoken word or singing could, in theory, cryptographically sign each master copy of the recording, and therefore certify that they were present and active in its creation. Of course any post-processing would lose this attestation. So it's practically useless, I suppose. But it would be a first-line of defense in copyright cases, at least, by being able to say "I did i…

This is a thing I've started at pretty hard. Embedding a signal that survives basic postprocessing isn't that hard, but doing it in such a way that it stays well below the noise floor and survives extensive editing is not easy. If anyone is interested I could be convinced to put my work on GitHub, highly doubtful that it will go commercial unless I get a huge raft of free time.

Re: It’s Game over on Vocal Deepfakes

#90

Post by tjfl »

wilsonnb3 wrote: post #88
ethicalsmacker wrote: post #49

Earlier quoted context omitted.

"Hey mom, it's X. Sorry to leave this voice mail, I got in a bit of a car accident and lost my phone. I need to get back home, could you send $$$$ to ####?"

Just have to establish real life security questions. They did this in one of the Harry Potter books (the sixth one?) since it is easy for them to impersonate other people. If you can’t tell me my favorite flavor of jam then you aren’t getting my money.

What is your favorite flavor of jam?
Post reply on HN