Super interesting read, makes me wonder if audio data poisoning could be employed en masse to help defend against this kinda stuff
The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
141–150 of 255 posts
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#142Earlier quoted context omitted.
It's very, very hard for untrained people to be strict about verifying any secret phrase. The attacker can make all kinds of excuses, while creating urgency, and many people quickly abandon verifying the phrase. A scene in One Battle After Another comes to mind.
At some point, the scam evolves to a live video of a gagged loved one being tortured. "Stop wasting my time or they lose another finger." People aren't prepared for this shit.
I know lots of old people who have instant access to quite significant sums of money and many of them just don't need it. I don't need it. I'd be happy to opt-in to, say, a three day wait period on new payment recipients, but my bank doesn't offer that.
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#143Earlier quoted context omitted.
It's very, very hard for untrained people to be strict about verifying any secret phrase. The attacker can make all kinds of excuses, while creating urgency, and many people quickly abandon verifying the phrase. A scene in One Battle After Another comes to mind.
At some point, the scam evolves to a live video of a gagged loved one being tortured. "Stop wasting my time or they lose another finger." People aren't prepared for this shit.
"Are you prepared to bring them down to a total of 11 fingers?!?"
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#144Earlier quoted context omitted.
That's a great idea. What do you use as your family password?
Nice try, but our password is the same as the password to my HN account, and for security HN automatically censors your password if you type it in a comment. See: *******
*********
Oh yeah! Neat.
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#145[dead]
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#146Earlier quoted context omitted.
A terse, altered "Hello" is all I say. Sometimes I don't say anything. Most humans would wait a few seconds then prompt with "...Hello?", whereas bots tend to hang up after ~2s silence
Don’t you guys have phones that screen calls?
Yep, if the number is not in my comtacts, it goes straight to voicemail.
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#147This old post of mine may be of interest, where I point out: "After a bit of threat modeling, it becomes apparent that future spearphishing robocalls may not directly con you, but rather “farm” your voice data by asking you benign questions, and use that to train a voice model to penetrate more deeply into your network." A lot of this writing has been on the wall forever and many (I'm sure otherwise smart people in) mission critical industries like banking, ISPs, and more refused to even acknowledge the risks.
2021 - "Despite the prevalence of deepfake audio tech, banks and ISPs rush ahead with “voice print” authentication" https://keydiscussions.com/2021/12/07/despite-the-prevalence... ends with a section called "The next crisis: robocalls that spoof the voices of victims at scale"
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#148Earlier quoted context omitted.
Yeah my bank does the same except don’t think there is an opt out. Kinda crazy
Spam 0, you’ll eventually get some customer service agent
Fancy private bank so getting a human isn't the issue
...but I know one of the signals they use for authentication is voice analysis in background...which I do not love.
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#149Earlier quoted context omitted.
Key phrases make sense to put in place, but another easy safeguard is: "Before you send anything to anyone, ever, call them back. Doesn't matter if it's me, the bank, a lawyer, whatever... tell them 'hang on I have another call coming in, let me just call you back in a few minutes, okay?'"
I overheard a cab driver being scammed by someone claiming to be HMRC (UK version of the IRS), and when he asked to call them back they managed to convince him to call them back on Viber , and he was about to when I intervened and pointed out to him that 1) what I'd overheard was blatantly a scam, 2) if he was unsure, to go to their official website and find their number... If you're going to get people to call you b…
Also, make sure to use official website, not just Google search, or any chat agent question, the SEO are sometimes poisoned with scam phone numbers.
I consider myself always to be wary of scams and my trust-level is zero when they call me, but I recently almost got myself hooked on an airline support call. I google searched the support number and trusted the AI summary on top and called it, they asked me my reservation number and I happily provided. With the reservation number they have public access to the entire reservation details, they knew my name, my flight, my co-passenger details everything. I called to do a reservation for my pet which is normally not done online. their problem, they got greedy and asked me more than pet travel, iirc they said there was a problem with one of my flights, it wasn't paid and I had to repay on the call. If they just followed along instead of going by the script I would have paid the pet travel amount.
Re: The Three-Second Theft: Why AI Voice Fraud Outruns Every Defence
#150> most victims of a cloned-voice call never learn that a machine was involved at all. They believe, as Sharon Brightwell initially believed, that they spoke to their own child.
This doesn’t make any sense. At some point they will speak to their child and learn that the call wasn’t real.