Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

Post reply on HN
Print view View original

271–280 of 461 posts

Re: They stole my voice with AI

#271

Post by eth0up »

nh2 wrote: post #263
eth0up wrote: post #225

My aunt is (supposedly) in her 90s, having left the US for Ecuador 10 or so years ago. We've remained in regular contact via phone over the years. Recently we went more than a few months without speaking. She has/had two numbers; magic jack and google. When I tried to call her, the magic jack was no longer in service and google said something about "unavailable". I reached out to my cousin (my aunt's daughter) to inq…

Ask your cousin to visit her and video call you together? Or go there for a weekend and check?

If my cousin (in US too) was equally skeptical, I'd contact either the US embassy or Ecuador embassy and arrange a wellness check with local LE. But while that offer and others stand, that's not my jurisdiction presently. Regarding travel resources, I live well enough but have to look steeply upward to see the poverty line, negating such options. For now, I'm satisfied being a fool.

Re: They stole my voice with AI

#272

Post by ryzvonusef »

nkrisc wrote: post #256
ryzvonusef wrote: post #176

Earlier quoted context omitted.

Your country might not have lynching mobs, but you can't deny there are certain taboo topics in your society also, certain slurs and other opinions which would take you ages to clense and even then never fully. If an AI fake-porn of some ordinary person involving a minor was unleashed, think of the utter shame and horror they would be treated by people for the rest of their lives, even if it were proven false. No one…

Yes, you’re right. That’s why the problem is the lynch mobs. If there was no AI, people would find another way to sic the mob on someone. I’m sure it’s already happened countless times without AI. Mobs aren’t known for the rational behavior and respect of the rule of law.

I was simply explaining my personal fears regarding AI given that lynch mobs exist in my country; the lesson you should have taken from that was not about lynch mobs, but to analyse how AI might affect YOU in your particular environment.

Remember the post is about cloning a youtuber's voice using AI; most people were thinking of the copywrite aspect of it, but I wanted to share with people what my fear was.

My fears are, things are already bad w.r.t lynch mobs before AI, after AI things will only get worse with fake but realistic sounding voice notes etc. That's my fear, doesn't have to be yours.

You don't have lynch mobs (hopefully) but surely you can think of other problems that a fake AI image/audio/video can cause, and just low the barrier is, and just how good the tools are.

Re: They stole my voice with AI

#273

Post by nkrisc »

mbrumlow wrote: post #24
toomuchtodo wrote: post #11

Earlier quoted context omitted.

California recently signed some legislation into effect. It’s a start. Congress is working on “No Artificial Intelligence Fake Replicas And Unauthorized Duplications Act.” Still in dev in the House, but has bipartisan support. Call your congressperson, ask them to co-sponsor and/or vote for it. https://www.cbsnews.com/losangeles/news/california-bills-pro... https://salazar.house.gov/media/press-releases/salazar-intro…

Seems silly. What if I train my model on somebody who sounds like a somebody?

That’s what courts are for, and sounds like you’d have a defensible case.

Re: They stole my voice with AI

#274

Post by thfuran »

marginalia_nu wrote: post #182
sureglymop wrote: post #171

Earlier quoted context omitted.

My specific fear is that if a picture of you next to your name is available online, that becomes part of the training set of a future model. Paranoically, I do not have any picture of myself available online. I could then trivially generate pictures or even videos of you e.g. by knowing your name. Of course that's just an example but I do think that's where we are headed and so the concept of "trust" will change a lo…

Seems like the end game for that technological development is kind of self-defeating. Once it's 2 clicks away to generate a believable video of someone at the kkk kitten barbecue getting along with ted bundy and jeff epstein, surely the evidence value of that would dwindle, and the brief period in history when video evidence was both accessible and somewhat believable will come to an end.

It turns out that humans aren't perfectly rational actors. Actors get hatemail and death threats because of roles they've played, "evidence" that isn't just potentially suspect but actually known to be entirely fictional.

Re: They stole my voice with AI

#275

Post by thfuran »

sensanaty wrote: post #269
gwervc wrote: post #211

Earlier quoted context omitted.

This is nothing to do with AI but with intolerance of a certain religion. That religion is killing a lot in my country and many others too, but both the governments (national and supranational) and corporations censor any criticism of it. Even here on HN I got posts and accounts removed by the moderation for the slightest hint of criticism against it, and fully expected a downvoting mob by writing this comment. Sadly…

If you were in the US and someone were to make a deepfake of you saying a racial slur, do you think you'd fair better than if you were a blasphemer in a Sharia country? The religion isn't the (whole) issue here, this situation can apply in the secular West just as easily. The punishment won't be death, but it can still ruin people's lives. A fake pedophilia accusation comes to mind, where even if proven innocent you'…

>If you were in the US and someone were to make a deepfake of you saying a racial slur, do you think you'd fair better than if you were a blasphemer in a Sharia country?

Of course.

Re: They stole my voice with AI

#276

Post by vasco »

pjc50 wrote: post #154
vasco wrote: post #138

Earlier quoted context omitted.

The best we can hope for is that one personally avoids this for the first 5 years or so, and then it gets so widespread and easy that everyone will start doubting any videos they watch. The same way it took social media like reddit a few years of "finding the culprit" / "name and shame" till mods figured out that many times the online mob gets it wrong and so now that is usually not allowed. But many people will suff…

> everyone will start doubting any videos they watch. This kills the medium. Just as ubiquitous scam calls have moved people away from phones, this moves people away from using media which cannot be trusted. Done enough this destroys reporting and therefore democracy. I wonder when the first nonexistent candidate will be elected.

I'm not sure I can take seriously arguments of "killing democracy", that undermines whatever point you're making in the same way people that worry about crime and shout "think of the children" or immediately go to "stopping terrorism". Just make your point without hyperbole.

Re: They stole my voice with AI

#277

Post by criddell »

sureglymop wrote: post #264
criddell wrote: post #222

Earlier quoted context omitted.

Do you have a state driver’s license? If so, then chances are data brokers have your photo from that. https://www.dallasnews.com/news/watchdog/2021/03/19/its-mind...

I am not from the US so no. And when I did visit the US, I was young enough not to have to give my fingerprints at the airports.

If it was a while back, your passport probably wasn’t the kind with a chip. If you visit today, your passport photo is electronically readable. I have no idea if the feds are as sloppy with this data as the states are though.

Re: They stole my voice with AI

#278

Post by tharkun__ »

input_sh wrote: post #254
bryanrasmussen wrote: post #181

Earlier quoted context omitted.

America also has laws against taking guns into theaters and indiscriminately shooting people, once you have easy access to guns the gun becomes a potential solution to problems. Maybe Switzerland just has less problems where that potential solution appeals to people.

I'd say that the key difference is that Switzerland has compulsory military service in which you're taught how to operate a weapon properly. Therefore, everyone that has one has gone through months of training. Vs the US, where there are loopholes that you can use to avoid even a basic background check, and then use it for the very first time to shoot someone.

That doesn't seem to make sense. All that would do is to make sure that a nut job knows how to properly shoot the gun. Basically what you are saying is "a Swiss wouldn't have missed Trump".

The difference might be in what guns mean to Swiss people vs. the US.

A gun in the US has this "if the government becomes destructive of these ends we can start shooting" connotation. A gun is there for self defense. Someone doesn't get off your law, you use your gun.

In Switzerland the gun and the compulsory military service you mention is there for the people to protect their country and fellow countrymen. You are trained in defending your neighbor, who just stepped on your lawn against outside aggressors.

Re: They stole my voice with AI

#280

Post by znpy »

We’ve been in a post-truth world for T least ten years anyway.

We already had fake news and organizations willingly spread fake news.

We had clearly fake pictures and people believing that.

Flat-earthers, no-vax and whatever.

This is just another brick in the wall.

Post reply on HN