Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

281–290 of 461 posts

Re: They stole my voice with AI

#281

Earlier quoted context omitted.

I'd say that the key difference is that Switzerland has compulsory military service in which you're taught how to operate a weapon properly. Therefore, everyone that has one has gone through months of training. Vs the US, where there are loopholes that you can use to avoid even a basic background check, and then use it for the very first time to shoot someone.

Training seems likely to cut down on accidental shootings, but not so much on the deliberate ones.

I disagree. First of all, people with issues are more likely to be found out in boot camp.

Second, you learn a certain respect for the firearm and are expected to observe strict safety rules when handling it. That gives you a kind of psychological flinch when you consider doing anything out of the norm with it.

Re: They stole my voice with AI

#282

Earlier quoted context omitted.

I think the answer, counterintuitively, is to make these AI tools more open and accessible. As long as they're restricted or regulated or inaccessible people will continue to think of videos and recordings as not fakeable. But make voice cloning something easy and fun to do with a $1 app, let the teens have their prank call fun and pretty soon it should work its way into the public consciousness. I had my 70 year mot…

This is idealistic. People still haven't fully learned that images can be photoshopped in its twenty years of its existence. (Deep)faked porn is still harmful which is why it's a crime. Worse, there isn't an attitude of default skepticism in many areas/cultures. If a person is suspected of violating the moral code the priority will be punishment and reinforcing that such behavior isn't acceptable. Whether or not the…

I'll note that both photoshop and changing the timestamp of images (mentioned below) are only easy for a very small percentage of the population. It'd likely be different if >30% of people could easily do these things.

Re: They stole my voice with AI

#283

Earlier quoted context omitted.

Well, then target dead people. Find someone who died 6 months ago, have AI make them a blasphemer, have the sect look for dead people. After the third or fourth time, they'll stop. Not because they want to stop, but because they don't trust this being another prank by Mullah Achmed the Fool.

Just like how you are the traffic, you are also the mob Mobs are not formal organisations with leadership and membership dues. Mobs are general everyday people who are sick and tird of this miserable life and need an excuse to rabble and rouse. So in this case, fake dead person's blasphemy will only be channeled towards their family members, mobs just need an excuse to get crazy. AI is not what causes mobs, it just h…

> fake dead person's blasphemy will only be channeled towards their family members

More alternatives: fake full persons. The mobs will be confused when they are directed to hunt down someone with a family name in a neighbor where no one has that family name. Furthermore, send them to the car repair shop between the coffee shop and the market in a street with no car shops, markers and coffee shops.

Re: They stole my voice with AI

#284
post #33

Earlier quoted context omitted.

How much? This IP/copyright mentality is so 90s/2000s. Brings back memories of Napster. This Jeff Geerling which I have never heard of will cry until some Spotify of AI appears and pay him some pennies. Maybe he wants to be the James Hetfield/Metallica of this generation. This guy doesn't have 1/10000 of the relevance Metallica had at the time tho.

The danger of this shit can not be understated. Four years ago already there was a video where a deepfake of a president of the USA read a speech: In Event of Moon Disaster https://www.youtube.com/watch?v=LWLadJFI8Pk we of course know Nixon never gave this speech. What happens when this "AI" is used to sway an election? Last month a family got hospitalized after eating mushrooms they found and identified from a AI ge…

> What happens when this "AI" is used to sway an election?

What do you mean "when"? It's already happening.

https://apnews.com/article/trump-taylor-swift-fake-endorseme...

Re: They stole my voice with AI

#285

Earlier quoted context omitted.

People copied and pasted faces of celebrities on another photo since 1990s. Nothing significant happened.

problem is not celebrities, problem is general every day people. With celeberaties, atleast they are famous enough that the idea of fakes exist... but you are Johnny nobody, that's not a fake, you just got caught and don't want to admit you said/did it! The court of public opinion is much smaller and personal, and 'evidence' is much more realistic and detailed.

general every day people will have to figure out that photoshop exists and that it contains AI now that can invent pictures from scratch. It should be easy to figure out, just explain that it can paint 100% realistically like a camera. The real issue is how people will start using this as a defense for criminal acts. "it wasn't me, all the camera footage is AI generated"

Re: They stole my voice with AI

#286
post #55
post #32

The idea that stolen voice tones are going to matter at all is one of the shortest sighted bits of AI investment - powered by Hollywood "never make anything new" thinking. In about 5 years AI voices will be bespoke and more pleasant to listen to then any real human: they're not limited by vocal cord stress, can be altered at will, and can easily be calibrated by surveying user engagement. Subtly tweaking voice output…

"This call may be monitored or recorded for quality assurance and training purposes" > training <

Didn't even think of that, I'm sure somebody has already had the idea of monetizing that, you could harvest the voices of millions of people and once that happens it will be on the dark web in the next breach and facilitate massive bank fraud.

Re: They stole my voice with AI

#288

It’s the Wild West and will be for some time but I agree, they should have the decency to use only voices of the dear departed. The library should be open source and hosted on GitHub. the talking dead seems like a good name for it. Obviously we will have to put it to a vote among the living.

That's even worse imo. There's a reason nearly every major world belief system includes a proscription against necromancy and this is exactly what they mean. The living should not speak with the mouths of the dead.

It seems more likely that necrophilia was a major problem (compared to today), given how the Egyptians handled it and stories like Botan Dōrō. Very strange that you’re saying cloning voices with AI is “exactly what they mean”…?

Re: They stole my voice with AI

#289
post #256

Earlier quoted context omitted.

Yes, you’re right. That’s why the problem is the lynch mobs. If there was no AI, people would find another way to sic the mob on someone. I’m sure it’s already happened countless times without AI. Mobs aren’t known for the rational behavior and respect of the rule of law.

I was simply explaining my personal fears regarding AI given that lynch mobs exist in my country; the lesson you should have taken from that was not about lynch mobs, but to analyse how AI might affect YOU in your particular environment. Remember the post is about cloning a youtuber's voice using AI; most people were thinking of the copywrite aspect of it, but I wanted to share with people what my fear was. My fears…

I don’t disagree that AI could exacerbate the issue, in fact I agree. But anything could potentially do so. Instant messaging likely also made the problem worse as a call to form a mob can reach many people much faster than before. The time from inciting incident to mob action is greatly compressed because of instant messaging.

It’s fundamentally a societal issue, not a technological one. Yes, it’s scary what effect AI could have on lynch mobs, because lynch mobs are scary.

Re: They stole my voice with AI

#290

Earlier quoted context omitted.

I'd say that the key difference is that Switzerland has compulsory military service in which you're taught how to operate a weapon properly. Therefore, everyone that has one has gone through months of training. Vs the US, where there are loopholes that you can use to avoid even a basic background check, and then use it for the very first time to shoot someone.

Training seems likely to cut down on accidental shootings, but not so much on the deliberate ones.

It seems like tons of toddler are accidentally firing guns as well in America, so training probably won't help there.
Post reply on HN