Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

Post reply on HN
Print view View original

181–190 of 461 posts

Re: They stole my voice with AI

#181

Post by bryanrasmussen »

underdeserver wrote: post #175
latexr wrote: post #167

Earlier quoted context omitted.

The comment didn’t say the problem was AI, it said they feared its consequences, which is a perfectly valid concern. It’s like if someone said “I’m scared of someone bringing a semi-automatic weapon to my school and doing a mass shooting. My country has lax laws about guns and their proper use”. And then you said “in your case the problem is not guns, it’s your country”. I mean, it’s technically true, but also unhelp…

Switzerland allows you to own a gun, but (generally) not to bear it. Huge difference.

America also has laws against taking guns into theaters and indiscriminately shooting people, once you have easy access to guns the gun becomes a potential solution to problems. Maybe Switzerland just has less problems where that potential solution appeals to people.

Re: They stole my voice with AI

#182

Post by marginalia_nu »

sureglymop wrote: post #171
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

My specific fear is that if a picture of you next to your name is available online, that becomes part of the training set of a future model. Paranoically, I do not have any picture of myself available online. I could then trivially generate pictures or even videos of you e.g. by knowing your name. Of course that's just an example but I do think that's where we are headed and so the concept of "trust" will change a lo…

Seems like the end game for that technological development is kind of self-defeating.

Once it's 2 clicks away to generate a believable video of someone at the kkk kitten barbecue getting along with ted bundy and jeff epstein, surely the evidence value of that would dwindle, and the brief period in history when video evidence was both accessible and somewhat believable will come to an end.

Re: They stole my voice with AI

#183

Post by ryzvonusef »

blueflow wrote: post #166
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

> And we have no tools to control this. Do you know "The boy who cried wolf"? Fabricate some allegations yourself and this will train people to disbelieve them.

Doesn't work.

You are assuming that people who are part of lynch mobs have the critical thinking skills to differentiate between real vs fake, and use logic.

Reminds me of the post I read on twitter, of some Thai/Chinese New Yorker whose mother told him not to speak Mandarin in public when COVID related Anti-Asian hate was rampant....

And he had to explain to her that she can't expect the sort of person who hits a random Asian to differentiate between Thai and Mandarin.

Re: They stole my voice with AI

#184

Post by ahaucnx »

donatj wrote: post #19

Maybe I am crazy but I don't really think it sounds that much like him. It's a little similar but different. It's slightly higher pitch, more nasal, and the intonation is a little different.

There are definitely elements in the voice that totally sound like Jeff.

Re: They stole my voice with AI

#185

Post by cess11 »

marginalia_nu wrote: post #182
sureglymop wrote: post #171

Earlier quoted context omitted.

My specific fear is that if a picture of you next to your name is available online, that becomes part of the training set of a future model. Paranoically, I do not have any picture of myself available online. I could then trivially generate pictures or even videos of you e.g. by knowing your name. Of course that's just an example but I do think that's where we are headed and so the concept of "trust" will change a lo…

Seems like the end game for that technological development is kind of self-defeating. Once it's 2 clicks away to generate a believable video of someone at the kkk kitten barbecue getting along with ted bundy and jeff epstein, surely the evidence value of that would dwindle, and the brief period in history when video evidence was both accessible and somewhat believable will come to an end.

Lynchings aren't commonly waged based on a solid process of evaluating evidence.

Re: They stole my voice with AI

#188

Post by blueflow »

latexr wrote: post #174
blueflow wrote: post #166

Earlier quoted context omitted.

> And we have no tools to control this. Do you know "The boy who cried wolf"? Fabricate some allegations yourself and this will train people to disbelieve them.

That sounds like a dangerous proposition. Either they fabricate allegations about a “nobody” and put them in trouble or they fabricate allegations about those in power and will be investigated and put themselves in danger. Neither strategy is good.

It worked pretty fine with #MeToo. Not saying there was no collateral damage, but the end result was that people now default to not believing such allegations.

Re: They stole my voice with AI

#189

Post by marginalia_nu »

cess11 wrote: post #185
marginalia_nu wrote: post #182

Earlier quoted context omitted.

Seems like the end game for that technological development is kind of self-defeating. Once it's 2 clicks away to generate a believable video of someone at the kkk kitten barbecue getting along with ted bundy and jeff epstein, surely the evidence value of that would dwindle, and the brief period in history when video evidence was both accessible and somewhat believable will come to an end.

Lynchings aren't commonly waged based on a solid process of evaluating evidence.

In that regard, the presence of this type of evidence isn't worth much either, a malicious rumor or an accusation is plenty sufficient to stoke the flames of an angry and terrified mob, nobody's going to pause the proceedings and wait for a fair and cool-headed judgement of evidence. This is after all a phenomenon that is far older than the smartphone.

Re: They stole my voice with AI

#190

Post by left-struck »

surfingdino wrote: post #77

It's all fun and games until someone produces a recording of somebody else saying something incriminating and it will be used in court. This is the part of AI I hate.

It’s worse than that. People will start claiming that real, incriminating voice recordings of them are fakes as well.

I think this matters more in the court of public opinion than in real court in both cases though.

Post reply on HN