Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

231–240 of 461 posts

Re: They stole my voice with AI

#231
post #115
post #99

Earlier quoted context omitted.

Yeah it does. Motive: Altman had some weird boyish thing for her and they asked her first, she said no. Means: Lots of available data to use from her movies. They probably trained a model first without releasing it just because it’s ridiculously easy. Especially for OpenAI. Opportunity: AI is astonishingly good at laundering and remixing without exposing the training set, for previously-unseen levels of plausible den…

> AI is astonishingly good at laundering and remixing without exposing the training set They just about manage to make a good multimodal transformer that can generate audio and you expect that right away they can also interpolate in latent space? How does that actually work? It's not so simple. What benefit do they have from training on Scarlett Johansson's data, because they sure as hell have a big risk. They clearl…

To be clear I’m not saying it did happen for sure. Only that it’s realistic and not exactly far fetched given everything that’s publicly known.

> they can also interpolate in latent space? How does that actually work?

I don’t know. I assumed it is the case because of the vast and excellent interpolation AI appears to do in other domains.

Re: They stole my voice with AI

#232
post #139

Earlier quoted context omitted.

I guess then, you should use AI to generate videos of all of the lynch mob leadership committing blasphemy and let them sort it out internally?

You joke but, given the religious/sectarian nature of the issue, all it does is empower one sect to act against the leaders of the other sect. Check the twitter link, you won't have to scroll much to find a mullah being blasted for blasphemy. No one is safe.

Well, then target dead people. Find someone who died 6 months ago, have AI make them a blasphemer, have the sect look for dead people. After the third or fourth time, they'll stop. Not because they want to stop, but because they don't trust this being another prank by Mullah Achmed the Fool.

Re: They stole my voice with AI

#234
post #204

Earlier quoted context omitted.

The only logical legal solution is that any content of you shared by you is legitimate one and all other content of you shared by somebody else is presumed non-authenthic and possibly fake.

What if a third party gains access to your social media account(s) and starts posting fake content from there?

It happens all the time. They usually post spam and scam.

Re: They stole my voice with AI

#235
post #193
post #162

Earlier quoted context omitted.

> what if AI was used to imitate a person saying something blasphemeous? > My country is already has blasphemy lynching mobs in your case the problem is not AI, it’s your country.

The US equivalent is much less labour intensive than a lynch mob: it's mass shooters radicalized by things they've read on the internet. Or https://www.npr.org/2024/09/19/nx-s1-5114047/springfield-ohi... , where repeating racial libel causes a public safety problem. While this kind of incitement in no way requires AI, it's certainly something that's easier to do when you can fake evidence. See also https://www.bbc.co…

The internet isn't always the bogeyman, the last assassin was radicalized by mass media.

Re: They stole my voice with AI

#236

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

Is your country US? Somehow I think it is.

https://news.ycombinator.com/user?id=ryzvonusef

It's in my profile :)

Re: They stole my voice with AI

#237

[flagged]

The first one sounds more like Scarlet Johanson to me. It's not just about the voice itself, it's about the sensuality and gravitas of the voice. The first one has Scralet's warmth and feminity whereas the second one sounds a robot impersonator trying mimicking scarlet's voice without understanding emotions. So to me you really proved that the voice actress sounds more like Scarlet than a literal AI replication of Sc…

[flagged]

Re: They stole my voice with AI

#238
post #192

Earlier quoted context omitted.

Your country might not have lynching mobs, but you can't deny there are certain taboo topics in your society also, certain slurs and other opinions which would take you ages to clense and even then never fully. If an AI fake-porn of some ordinary person involving a minor was unleashed, think of the utter shame and horror they would be treated by people for the rest of their lives, even if it were proven false. No one…

But mob formation and mass social shaming on little evidence already happens without AI and it isn't clear why AI would make it worse. If it gets so easy to create fake videos that'll just muddy the waters and people would trust rumour less , not form mobs more. It happens once, then some wag creates videos of all the mob leaders blaspheming or whatever. Undermines the idea that the videos are the root cause.

I feel like the Bullshit Asymmetry Principle is involved here. If the bar is lowered to the point where it takes less energy to generate inflammatory video "evidence" than it does to debunk it the shitheads win. I feel like we can all agree that AI has the potential to lower that bar.

Re: They stole my voice with AI

#239

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

From Hong Kong. We already had fake audio messages that sounded like a protest leader during 2014 protests… It was always there, even a long time ago

Re: They stole my voice with AI

#240

Earlier quoted context omitted.

You joke but, given the religious/sectarian nature of the issue, all it does is empower one sect to act against the leaders of the other sect. Check the twitter link, you won't have to scroll much to find a mullah being blasted for blasphemy. No one is safe.

Well, then target dead people. Find someone who died 6 months ago, have AI make them a blasphemer, have the sect look for dead people. After the third or fourth time, they'll stop. Not because they want to stop, but because they don't trust this being another prank by Mullah Achmed the Fool.

Just like how you are the traffic, you are also the mob

Mobs are not formal organisations with leadership and membership dues.

Mobs are general everyday people who are sick and tird of this miserable life and need an excuse to rabble and rouse.

So in this case, fake dead person's blasphemy will only be channeled towards their family members, mobs just need an excuse to get crazy.

AI is not what causes mobs, it just helps lower the incitement barrier by providing quality bait.

Post reply on HN