fair play to him for calling out his own "claim chowder"
It’s Game over on Vocal Deepfakes
11–20 of 122 posts
Re: It’s Game over on Vocal Deepfakes
#12Those fake AI voices are perfect tools for phishing campaigns. I wonder if ChatGPT combined with a voice generator can mount successful phishing campaigns. It looks like Cyberpunk future we never asked is already here.
Imagine an AI voice of Trump that phones lonely old people to thank them for coming to his rally. After 20 minutes of small talk he asks them to donate to his campaign via bitcoin...
Re: It’s Game over on Vocal Deepfakes
#13> It’s all fun and games in these demos, but this is inevitably going to be put to use by ratfuckers to create fake scandals in political campaigns...And it feels inevitable that a Roger Stone or Steve Bannon type will use this technology to commission, say, a recording of Joe Biden forgetting his own name... The road to hell is paved with good intentions, and all politicians are going to use this for their political…
Name the Roger Stone or Steve Bannon of the left.
Re: It’s Game over on Vocal Deepfakes
#14When this topic has come up with family and friends, folks often say that they aren't worried (yet) because while a human can be fooled, they can't yet fool readily available forensic tools, and perhaps can't ever.
I can't speak to the veracity of that claim, but as the post points out, the past several years has shown us that it doesn't matter, not in the least.
The author goes on to say how it feels inevitable that we'll see a Bannon or Stone type use this technology to create fake scandals.
I'm more worried about the grass roots efforts. Crowdsourced conspiracies like QAnon. Now they'll have more capable tools to radicalize people.
Re: It’s Game over on Vocal Deepfakes
#15Meh. We achieve a state of complete systemic disbelief, and alternate trust mechanisms develop.
[Clip of Abe Lincoln in RayBans saying "Don't believe everything you see and hear on the Internet" goes here]
Even the stuff that wasn't deepfaked was mostly bollocks anyway.
Re: It’s Game over on Vocal Deepfakes
#16Those fake AI voices are perfect tools for phishing campaigns. I wonder if ChatGPT combined with a voice generator can mount successful phishing campaigns. It looks like Cyberpunk future we never asked is already here.
Imagine an AI voice of Trump that phones lonely old people to thank them for coming to his rally. After 20 minutes of small talk he asks them to donate to his campaign via bitcoin...
Lonely old people sophisticated enough to do bitcoin?
Color me skeptical.
Re: It’s Game over on Vocal Deepfakes
#17I think he's right about this—things are going to get weird and ugly and people aren't prepared for what's coming. Here's my suggestion for safeguarding your sanity in the years ahead: find the people and the blogs you love, embrace RSS, block or avoid everything else, read old books, stop listening to podcasts, revert to email as the primary channel for occasional "social" correspondence, abandon all side projects t…
I agree with most of your advice, especially "go outside" ... but I don't understand why one should "stop listening to podcasts". Do you mean stop listening to podcasts which discuss current events? Because there are plenty of good podcasts which don't.
Also, I think this is good advice even without the proliferation of deepfakes or GPT spam. I already abandoned social media in favor of small group chats and Real Life long ago, and I know I'm not alone. The only habit I still need to kick is reading too much HN. ;)
Re: It’s Game over on Vocal Deepfakes
#18Those fake AI voices are perfect tools for phishing campaigns. I wonder if ChatGPT combined with a voice generator can mount successful phishing campaigns. It looks like Cyberpunk future we never asked is already here.
I'm sure it's going to get exponentially better, but right now ChatGPT sounds like one very vanilla guy. The other day I asked it to write me a conversation between David Foster Wallace and Ernest Hemingway, and it came out something like (paraphrasing):
HEMINGWAY: I notice you write about political issues and philosophy.
WALLACE: Thank you, I noticed you write about raw experience and manliness.
HEMINGWAY: Well, whatever our differences I feel like we can get along and work together. We will soon be fast friends.
Re: It’s Game over on Vocal Deepfakes
#19Those fake AI voices are perfect tools for phishing campaigns. I wonder if ChatGPT combined with a voice generator can mount successful phishing campaigns. It looks like Cyberpunk future we never asked is already here.
Imagine an AI voice of Trump that phones lonely old people to thank them for coming to his rally. After 20 minutes of small talk he asks them to donate to his campaign via bitcoin...
Even simpler. Have the voice give them a short onboarding call, but then have it regularly call them again using reverse charging, and then chat with them. Convince them that they've formed a friendship.
Re: It’s Game over on Vocal Deepfakes
#20It is difficult to predict what will happen, but nefarious use of something that powerful is a given.
Generated images and audio clips are still pretty easy to detect, we're not there yet, but close.
What I worry about is not the obvious usage and risks, but the second and third order effects, those we can't predict.
I will be interesting.