Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

331–340 of 461 posts

Re: They stole my voice with AI

#331
post #225

My aunt is (supposedly) in her 90s, having left the US for Ecuador 10 or so years ago. We've remained in regular contact via phone over the years. Recently we went more than a few months without speaking. She has/had two numbers; magic jack and google. When I tried to call her, the magic jack was no longer in service and google said something about "unavailable". I reached out to my cousin (my aunt's daughter) to inq…

This is some serious Twilight Zone stuff.

Re: They stole my voice with AI

#332

Earlier quoted context omitted.

> what if AI was used to imitate a person saying something blasphemeous? I've been contemplating writing an open letter to Dang to nuke my account. Because at this time you can likely deanonymize any user with a fair amount of comments. As long as you can correlate. You can certainly steal their language, even if not 100% accurate. It may be caution, but it isn't certain that we won't enter a dark forest and there's…

Yep, im sure lots of people have written a lot of random stuff on a lot of forums that should absolutely stay anonymous from gossip to family secrets to honesty about career/workplace and what not. If stylometric analysis runs on all comments on the internet then yeah. Bad things will happen, very very bad. I honestly think it should be at least illegal to do this kind of analysis because it'll be a treasure trove fo…

Stuff like this is why I tell everyone who does good work in the AI space to remember that they are watched

Re: They stole my voice with AI

#333

Earlier quoted context omitted.

> what if AI was used to imitate a person saying something blasphemeous? I've been contemplating writing an open letter to Dang to nuke my account. Because at this time you can likely deanonymize any user with a fair amount of comments. As long as you can correlate. You can certainly steal their language, even if not 100% accurate. It may be caution, but it isn't certain that we won't enter a dark forest and there's…

You can't nuke your account. You can close it but your comments remain on the site. They'll delete your account and assign your comments and posts to a random username. Yes this violates any EU citizen's right to be forgotten under GDPR. Welcome to silicon valley.

How would one report this to the EU and force HN to follow the GDPR?

Re: They stole my voice with AI

#334

Earlier quoted context omitted.

> what if AI was used to imitate a person saying something blasphemeous? I've been contemplating writing an open letter to Dang to nuke my account. Because at this time you can likely deanonymize any user with a fair amount of comments. As long as you can correlate. You can certainly steal their language, even if not 100% accurate. It may be caution, but it isn't certain that we won't enter a dark forest and there's…

The problem I fear is that, let's say you once had a facebook account, we all deactivated our accounts when there was wave against Zuck a few years back, but as we know, facebook doesn't really delete your account. Now imagine that account was linked to a SIM. It's trivial for a nefarious actor to get it re-activated, infact there was a video by Veritasium just today where they didn't even need your SIM. But even if…

I think we need a data Great Reset: all data (and I mean all) must be deleted by a certain date in the future, and all newly collected data must have provenance so in the future the customer can find out that Ford got information from Databroker A which bought it from B which bought it from Microsoft which collected it from what you type in Windows. Companies holding activity data without provenance get the crack-cocaine dealer treatment: officers in jail, everybody fired, investors and lenders fucked, company liquidated and forfeited.

While it is impossible to take back a disclosed secret, we can create a legal framework which issues immediate business-stopping corporate death sentences for spreading that data without consent (or after you revoke consent, yes it needs to be revokable). Your data is so valuable, because now that we have universal function approximators you can be simulated (to a prediction horizon) and that simulation interrogated.

Re: They stole my voice with AI

#335

Earlier quoted context omitted.

> what if AI was used to imitate a person saying something blasphemeous? I've been contemplating writing an open letter to Dang to nuke my account. Because at this time you can likely deanonymize any user with a fair amount of comments. As long as you can correlate. You can certainly steal their language, even if not 100% accurate. It may be caution, but it isn't certain that we won't enter a dark forest and there's…

Another solution would be to use an LLM to rephrase your posts, wouldn't it? Not a great outlook though, if everybody does this...

I already do this in all my IRCs, Matrices, and Discords

Re: They stole my voice with AI

#336

Earlier quoted context omitted.

> what if AI was used to imitate a person saying something blasphemeous? I've been contemplating writing an open letter to Dang to nuke my account. Because at this time you can likely deanonymize any user with a fair amount of comments. As long as you can correlate. You can certainly steal their language, even if not 100% accurate. It may be caution, but it isn't certain that we won't enter a dark forest and there's…

Yep, im sure lots of people have written a lot of random stuff on a lot of forums that should absolutely stay anonymous from gossip to family secrets to honesty about career/workplace and what not. If stylometric analysis runs on all comments on the internet then yeah. Bad things will happen, very very bad. I honestly think it should be at least illegal to do this kind of analysis because it'll be a treasure trove fo…

>Actually thinking about it further you could also easily group people political affiliations, and all kinds of other thoughts, dark, dark stuff!

Already happening at Google and Meta for a decade or more.

Re: They stole my voice with AI

#337

Earlier quoted context omitted.

I'm very sorry to say this but if you live in a country that is killing others for what they say, AI is probably not your biggest problem. And I don't believe an easy solution exists.

"You can't refuse this brand new technology but you must change your society's culture that's been around for centuries so you are compatible with it." is a repulsively Silicon Valley answer.

Not every culture deserves to live on, certainly not just because "it has been around" and absolutely not one that lynches people.

Tolerance of intolerance is a bullshit strategy that won't work.

Re: They stole my voice with AI

#338

Earlier quoted context omitted.

I was simply explaining my personal fears regarding AI given that lynch mobs exist in my country; the lesson you should have taken from that was not about lynch mobs, but to analyse how AI might affect YOU in your particular environment. Remember the post is about cloning a youtuber's voice using AI; most people were thinking of the copywrite aspect of it, but I wanted to share with people what my fear was. My fears…

Maybe it's because I have no knowledge of lynch mobs in my country but I find that fear is a bad adviser. I think currently there is no way back in AI development. I read Microsoft is getting a failed nuclear reactor repaired to power the power hungry AI. The only way forward is making sure most people know that digital content can be easily faked. If you hand out good faker tools for free, it will happen faster

There is absolutely a way back if laws change. It's that simple, people need to stop pretending its inevitable when it absolutely isn't.

Re: They stole my voice with AI

#339

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

It's sounds like a problem with your crazy population, not with AI.

Re: They stole my voice with AI

#340

Earlier quoted context omitted.

It'll be bad for a few years, but surely at some point it'll become inadmissible in court because it's too easy to fake, right? But then what do we do, if video and audio footage is inadmissible?

Where i am, video and audio are not admissible in court...'too easily faked'. A car bump i was in was dash-cammed, but all my team could do was second by second analysis of the video, and present that to the court. I did win, but it was very costly to do so.

That's crazy. For dash cam videos you can at least compare if the footage matches with the damage on the cars. And hopefully both parties have video footage, then you can really compare if something doesn't add up.
Post reply on HN