Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

Post reply on HN
Print view View original

311–320 of 461 posts

Re: They stole my voice with AI

#311

Post by meowster »

eth0up wrote: post #225

My aunt is (supposedly) in her 90s, having left the US for Ecuador 10 or so years ago. We've remained in regular contact via phone over the years. Recently we went more than a few months without speaking. She has/had two numbers; magic jack and google. When I tried to call her, the magic jack was no longer in service and google said something about "unavailable". I reached out to my cousin (my aunt's daughter) to inq…

It's possible if she doesn't know why you're asking the questions and requesting a specific photograph, her responses won't be helpful.

For example, if you asked for a selfie, she might just think you want a picture of her, and she remembers that she has a picture of her that she took last year where she looked good (passport phot that people dress up for), and wants you to have a good photo rather than one where she looks miserable in a hospital.

The way you tell the story makes it sound suspicious, but next time I would just be direct and tell her something seems suspicious to you, that someone could impersonating her, so that is why you are asking.

If someone is targeting you, chances are they already saw your comment here so that hypothetical person already know you're on to them, so saying that on the phone won't give any new information away.

Re: They stole my voice with AI

#312

Post by Jeff_Brown »

ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

Given that this tech is unstoppable, the best defense might be a good offense: Flood the internet with clips of prominent religious and political leaders, especially those largely responsible for mob violence historically, saying preposterously blasphemous things they would obviously never say.

Re: They stole my voice with AI

#313

Post by meowster »

eth0up wrote: post #225

My aunt is (supposedly) in her 90s, having left the US for Ecuador 10 or so years ago. We've remained in regular contact via phone over the years. Recently we went more than a few months without speaking. She has/had two numbers; magic jack and google. When I tried to call her, the magic jack was no longer in service and google said something about "unavailable". I reached out to my cousin (my aunt's daughter) to inq…

It's possible if she doesn't know why you're asking the questions and requesting a specific photograph, her responses won't be helpful.

For example, if you asked for a selfie, she might just think you want a picture of her, and she remembers that she has a picture of her that she took last year where she looked good (passport phot that people dress up for), and wants you to have a good photo rather than one where she looks miserable in a hospital.

The way you tell the story makes it sound suspicious, but next time I would just be direct and tell her something seems suspicious to you, that someone could impersonating her, so that is why you are asking.

If someone is targeting you, perhaps are they already saw your comment here so that hypothetical person already know you're on to them, in which case saying that on the phone won't give any new information away.

Re: They stole my voice with AI

#314

Post by tomjen3 »

Ygg2 wrote: post #227
kmlx wrote: post #162

Earlier quoted context omitted.

> what if AI was used to imitate a person saying something blasphemeous? > My country is already has blasphemy lynching mobs in your case the problem is not AI, it’s your country.

The problem is AI. What if you post video of a politician eating babies, and that causes some nutjob to kill that politician? Sure, distrust everything digital, but what if only evidence of someone doing something wrong is digital?

What if someone printed yellow papers blaming Spain for a ship accident so the us would go to war with them?

Re: They stole my voice with AI

#315

Post by zwirbl »

valval wrote: post #292
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

You’d simply make such things highly illegal. No matter how I spin it in my head, there’s nothing particularly scary about this, like there isn’t about identity theft or any other crime, in reality. Even if blasphemy is illegal in your country, people would probably agree that falsely accusing someone of blasphemy is also wrong.

Lynching someone is highly illegal, whatever the cause. And yet...

Re: They stole my voice with AI

#316

Post by meowster »

m463 wrote: post #55
XorNot wrote: post #32

The idea that stolen voice tones are going to matter at all is one of the shortest sighted bits of AI investment - powered by Hollywood "never make anything new" thinking. In about 5 years AI voices will be bespoke and more pleasant to listen to then any real human: they're not limited by vocal cord stress, can be altered at will, and can easily be calibrated by surveying user engagement. Subtly tweaking voice output…

"This call may be monitored or recorded for quality assurance and training purposes" > training <

Can anyone recommend a good, seemless voice modulating phone app (that also records for your records)?

Re: They stole my voice with AI

#317

Post by cityzen »

Ex-Google CEO says successful AI startups can steal IP and hire lawyers to ‘clean up the mess’ / “But if nobody uses your product, it doesn’t matter that you stole all the content,” Eric Schmidt said during a recent talk at Stanford that has been taken offline.

Since that guy was CEO of Google it’s all good right???

https://www.theverge.com/2024/8/14/24220658/google-eric-schm...

Re: They stole my voice with AI

#319

Post by veunes »

deepsun wrote: post #259
HeatrayEnjoyer wrote: post #251

Earlier quoted context omitted.

This is idealistic. People still haven't fully learned that images can be photoshopped in its twenty years of its existence. (Deep)faked porn is still harmful which is why it's a crime. Worse, there isn't an attitude of default skepticism in many areas/cultures. If a person is suspected of violating the moral code the priority will be punishment and reinforcing that such behavior isn't acceptable. Whether or not the…

Yep, had a lawyer telling me that image timestamp cannot be faked. While it's literally a right-click away.

When people in positions of authority, like legal experts, don’t fully grasp how easily digital content can be manipulated

Re: They stole my voice with AI

#320

Post by caeril »

jerpint wrote: post #258
CoastalCoder wrote: post #250

Earlier quoted context omitted.

> I had my 70 year mother ask me last week if she should remove her voicemail message because can't people steal her voice with it? I was surprised but I guess she heard it on a Fox segment or something. Out of curiosity, how much training data is needed currently to mimic a voice at various levels of convincingness?

Just a few seconds of speech gets you pretty far with a lot of models

Yes, this is generally true, in order to clone the timbre/pitch/tonality, but if you're going to run a voice cloning scam to fool friends and family members, you need much more to get the cadence, pauses, vocal tics, etc right.
Post reply on HN