Live data from Hacker News

It’s Game over on Vocal Deepfakes

daringfireball.net

51–60 of 122 posts

Re: It’s Game over on Vocal Deepfakes

#52
post #18

Those fake AI voices are perfect tools for phishing campaigns. I wonder if ChatGPT combined with a voice generator can mount successful phishing campaigns. It looks like Cyberpunk future we never asked is already here.

I'm sure it's going to get exponentially better, but right now ChatGPT sounds like one very vanilla guy. The other day I asked it to write me a conversation between David Foster Wallace and Ernest Hemingway, and it came out something like (paraphrasing): HEMINGWAY: I notice you write about political issues and philosophy. WALLACE: Thank you, I noticed you write about raw experience and manliness. HEMINGWAY: Well, wha…

Has ChatGPT actually read any books (apart from snippets on the Internet), or has that been avoided for copyright reasons?

I wonder how long until someone pirates every ebook on Z-Library or SciHub and trains a language model off that. Imagine a language model that's read every book and every scientific paper.

Re: It’s Game over on Vocal Deepfakes

#57
post #4

Once the generation times get to real-time, I dunno what's going to happen. I follow the voice acting community a lot and this is a big existential threat level of worry in that community. But I also see some positives for the narrative voice field, but at the expense of actual actors. The latest sequel to a favorite audio book series has the professional narrator pronouncing different character names and town names…

it’s already here. People on the chans are using a alexjones model to sing anime songs and it worked really well.

Re: It’s Game over on Vocal Deepfakes

#58
post #18

Those fake AI voices are perfect tools for phishing campaigns. I wonder if ChatGPT combined with a voice generator can mount successful phishing campaigns. It looks like Cyberpunk future we never asked is already here.

I'm sure it's going to get exponentially better, but right now ChatGPT sounds like one very vanilla guy. The other day I asked it to write me a conversation between David Foster Wallace and Ernest Hemingway, and it came out something like (paraphrasing): HEMINGWAY: I notice you write about political issues and philosophy. WALLACE: Thank you, I noticed you write about raw experience and manliness. HEMINGWAY: Well, wha…

I asked it to make a certain stand up bit in the style of various comedians. The Seinfeld one was reasonably good but the Chris Rock one was off because it wouldn’t curse.

Re: It’s Game over on Vocal Deepfakes

#59
post #32

Earlier quoted context omitted.

My guess would be for voice actors to copyright their voices. I am not familiar with the voice generation ML but i guess for things like dramatic pauses a voice actor might still be needed. Also I'm guessing it should be fairly straightforward to detect such copyright violations. I would really like to see it implemented for heavy text driven rpgs. But overall yeah things look bad for voice actors in general

Conceivably, anyone who uses his or her voice for spoken word or singing could, in theory, cryptographically sign each master copy of the recording, and therefore certify that they were present and active in its creation. Of course any post-processing would lose this attestation. So it's practically useless, I suppose. But it would be a first-line of defense in copyright cases, at least, by being able to say "I did i…

Maybe a use case for NFTs hah.

Re: It’s Game over on Vocal Deepfakes

#60
post #32
post #4

Once the generation times get to real-time, I dunno what's going to happen. I follow the voice acting community a lot and this is a big existential threat level of worry in that community. But I also see some positives for the narrative voice field, but at the expense of actual actors. The latest sequel to a favorite audio book series has the professional narrator pronouncing different character names and town names…

My guess would be for voice actors to copyright their voices. I am not familiar with the voice generation ML but i guess for things like dramatic pauses a voice actor might still be needed. Also I'm guessing it should be fairly straightforward to detect such copyright violations. I would really like to see it implemented for heavy text driven rpgs. But overall yeah things look bad for voice actors in general

Copyright might not be needed.

SAG created a rule after Crispin Glover’s face was used without permission via a prosthetic in Back to the Future 2 to ensure it never happened again.

I could easily see a similar rule being added by an appropriate union to their contracts to prevent AI copies of voices that weren’t approved by the original actor.

Post reply on HN