Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

101–110 of 461 posts

Re: They stole my voice with AI

#101
post #23

Earlier quoted context omitted.

It's going to be an interesting First Amendment question.

Might as well make photoshopping and manual audio tweaking / impersonation illegal, since its the same ballpark, just less effort.

But I think if you photoshopped someone into an advertising image in a way that made them appear to endorse your product you would probably very quickly be hit (and lose?) a lawsuit right?

So I’m increasingly of the opinion that it’s not the tool that needs to be regulated, but the use of the output.

Clone voices? Fine. Clone voices for deceptive or commercial purposes without the person’s consent? Not fine.

But then how do you prove it, what is deceptive, what is non-consenting voice cloning, yadda yadda.

I imagine we will shortly see a raft of YouTubers adding “do not clone my voice” notices to their channels like the Facebook “by posting this notice you remove all rights for Facebook to steal the copyright in your photos” spam posts that were doing the rounds at one point.

Re: They stole my voice with AI

#102

More and more I am starting to wish I had gone ahead with the novel I had sketched out in the 1990s. The backdrop was a kind of post-imitative-AI collapse of trust in society, because it had become effortless to fake up, say, your least favorite political candidate talking about the merits of eating babies, so the various echo chambers bore a kind of ghastly fruit, each stance finding its own "evidence" for its belie…

You can still write it. It'll sound like you're just jumping on the AI bandwagon, but considering it's all the rage, it might still help your sales.

Re: They stole my voice with AI

#103

Earlier quoted context omitted.

Might as well make photoshopping and manual audio tweaking / impersonation illegal, since its the same ballpark, just less effort.

But I think if you photoshopped someone into an advertising image in a way that made them appear to endorse your product you would probably very quickly be hit (and lose?) a lawsuit right? So I’m increasingly of the opinion that it’s not the tool that needs to be regulated, but the use of the output. Clone voices? Fine. Clone voices for deceptive or commercial purposes without the person’s consent? Not fine. But then…

>you would probably very quickly be hit (and lose?) a lawsuit right?

A lawsuit from a private individual or business entity is very different from the federal, state, or municipal government attempting to silence you, the latter is prohibited by the First Amendment.

I find it appalling that this needs to be spelled out.

Re: They stole my voice with AI

#104
post #91

Earlier quoted context omitted.

Might as well make photoshopping and manual audio tweaking / impersonation illegal, since its the same ballpark, just less effort.

Might as well make forging signatures and identity thief legal. Who is the government to say which squiggles I may and may not write? Society is about compromises and balancing different needs against each other. Sometimes we go one way, other times we go the other way, there is no one principle that always solve any situation.

no one demands a moratorium on pens and pencils because someone might write illegal squiggles with them. we simply accept the fact that 0.0001% of squiggles will be illegal, harmful, hateful, unethical, unsafe, etc, so we can use the pen and pencil tech to write the other 99.9999% of squiggles.

the current lobbying and legislating efforts seek to outlaw pens and pencils produced by anyone but a handful of US corporation, who only let you use their pens and pencils if you let them look over your shoulder while you write your squiggles.

Re: They stole my voice with AI

#105
post #42
post #33

Earlier quoted context omitted.

The danger of this shit can not be understated. Four years ago already there was a video where a deepfake of a president of the USA read a speech: In Event of Moon Disaster https://www.youtube.com/watch?v=LWLadJFI8Pk we of course know Nixon never gave this speech. What happens when this "AI" is used to sway an election? Last month a family got hospitalized after eating mushrooms they found and identified from a AI ge…

>Last month a family got hospitalized after eating mushrooms they found and identified from a AI generated book. Yeah, mushrooms are very dangerous, but the argument here is that the book could be written by a human. So what's the best way forward? Ban A.I. books, and human books? A.I. also, is the best way IMHO to identify mushrooms. Mushrooms are drastically different from one another by magnifying their spores usi…

That's kind of a different thing. Making the best AI possible for recognizing mushrooms and trying to produce the most factually correct answers is different than letting AIs run rampant, generating fiction.

Also, I'd want some kind of verification before using the mushroom app. Who made the app? Do they have people on their team familiar with mushrooms? Botanists or whatever you call them. Some random dude with free time and access to maybe 10 species of mushrooms in his backyard.. even if his intent is good, is still dangerous.

Re: They stole my voice with AI

#106
post #92

If LLMs are the ultimate remix machine, then is anyone with a RAG a digital DJ? One can't help but wonder what theft even means any more, when it comes to digital information. With the (lack of) legal precedent, it feels like the wild wild west of intellectual property and copyright law. Like, if even a superstar like Scarlett Johansson can only write a pained letter about OpenAI's hustle to mimic her "Her" persona,…

what theft even means any more They dragged the term through different phases, but that’s just projection of will. Theft is undefined for objects with .copy() interface. It’s still there when you look at it. People have to adjust expectations, not laws. Computers replaced computers, now voice acting replaces voice actors. Your popularity doesn’t mean anything really and wouldn’t it be unfair if only popular could spa…

Try singing a song on youtube. See what youtube copyright checker does.

Re: They stole my voice with AI

#107
post #72
post #60

Earlier quoted context omitted.

> Stolen voices matter because what's being stolen here is the authors likeness There is not enough voice space to accommodate everyone. Authors would like to fence off and own their little voice island. For every voice there are thousands of similar ones.

This was fine 10 years ago because I would, if I wanted to get an impersonator of someone's voice who carries a lot of weight, I'd have to go through to the work of hunting them down, finding out if they were willing, paying them, or I guess having tons of children and waiting decades and hoping their voice is right for what I need. Now I can sit at a computer and spend a few hours doing it. You are completely blowin…

This is not about impersonation, it's about having a similar voice while using it to create new things.

Re: They stole my voice with AI

#108
post #92

Earlier quoted context omitted.

what theft even means any more They dragged the term through different phases, but that’s just projection of will. Theft is undefined for objects with .copy() interface. It’s still there when you look at it. People have to adjust expectations, not laws. Computers replaced computers, now voice acting replaces voice actors. Your popularity doesn’t mean anything really and wouldn’t it be unfair if only popular could spa…

> Theft is undefined for objects with .copy() interface. > Computers replaced computers, now voice acting replaces voice actors. It's incredible what web development does to someone's ability to communicate ideas.

The original meaning of the word computer was a person who calculates.

Looks perfectly clear to me.

Re: They stole my voice with AI

#109
> I remember when OpenAI practically cloned Scarlett Johanssen's voice

Except that never happened and the voice belonged to a completely different voice actress and Scarlett Johanssen had exactly zero right to prevent this person from making money as a voice actress lending it to AI.

These complaints remind me a little bit of the story that a man complained that his photo was used to illustrate the article about how all hipsters look the same and it eventually turned out it wasn't his photo.

Re: They stole my voice with AI

#110

Earlier quoted context omitted.

Seems silly. What if I train my model on somebody who sounds like a somebody?

That's what happened with Scarlett Johanssen's voice in the OpenAI thing, right? Or at least I think it was a claim at the time.

She wrote a strongly worded tweet and people outraged for 0.03 ms and moved on to the next thing.
Post reply on HN