It's right out of Terminator 2, except for the actually dead foster parents part.
It's right out of Terminator . The voice-altering scene in Terminator 2 was a replay of the original.
You're right! Somehow the T2 scene stuck in my mind more...
The Terrifying A.I. Scam That Uses Your Loved One's Voice
41–47 of 47 posts
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#42Anyone believing AI will be a nice thing in the future: With data from social media it's a fucking nightmare - billions of people having their relationships visible to everyone and a singular voice recording/video is enough to scam your friends, family, workplace. I don't see a future of the current communication channels without strong authentication measures - people already get scammed with shitty tactics by billi…
I doubt a single voice recording could generate speech with enough emotional depth that I'd be fooled by a fake call from my better half. Do people really have such a shallow connections to their loved ones that they wouldn't instinctively feel that something isn't right? C'mon, we humans operate with a lot of extra clues. Its not like we just STT and "read" the resulting output.
There was an interesting paper about a year ago that talked about synthesizing voices with minimal training data, iirc on the order of 30 seconds. The results were imperfect but wholly impressive given the input.
"Think of what will be possible just two more papers down the line."
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#43I wonder if these things will be the breaking point where we start to take security and identity verification seriously. I mean banks are still using SMS 2FA. Will tools like Keybase become well known and used? Yubi keys? Push into homomorphic encryption? Signal? Matrix? Don't get me started on SSNs... I think one of the unfortunate things about our societies is that we so strongly believe "if it ain't broke, don't f…
Identifying people online has already been solved https://news.ycombinator.com/item?id=39638744
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#44Anyone believing AI will be a nice thing in the future: With data from social media it's a fucking nightmare - billions of people having their relationships visible to everyone and a singular voice recording/video is enough to scam your friends, family, workplace. I don't see a future of the current communication channels without strong authentication measures - people already get scammed with shitty tactics by billi…
I doubt a single voice recording could generate speech with enough emotional depth that I'd be fooled by a fake call from my better half. Do people really have such a shallow connections to their loved ones that they wouldn't instinctively feel that something isn't right? C'mon, we humans operate with a lot of extra clues. Its not like we just STT and "read" the resulting output.
From experience, it is the people who are confident they won't be tricked that are most vulnerable to being tricked.
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#45this is why i believe the only possible route forward for humanity in the AI age is a biometric digital footprint
And a biometric digital footprint cannot be stolen or replicated by AI because?
Well it has to be something tied to the body, but also unique to the individual, like a fingerprint mixed with DNA
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#46As horrible as this is, I suspect this will be far worse in enterprise companies. We’ve already seen issues with email impersonation where top managers or CEOs order money transfers, and since this works better than it should, we now use confirmation of some sort. Imagine if you’d get both the email and a call, maybe even a video call in the future with the confirmation… Especially CEOs will be very “easy” to imperso…
I wonder if the problem is with impersonating C-level executives or if the problem is that they have power to just send money.. In recent John Oliver episode there was banker who simply bankrupted his bank by sending money to the scammer. Or this guy https://www.npr.org/2019/03/25/706715377/man-pleads-guilty-t... . Do these companies not have proper process for sending so much money with multiple levels of people inv…
> I wonder if the problem is with impersonating C-level executives or if the problem is that they have power to just send money.
Yeah, I guess I'm surprised that executives are allowed to do this without a "second opinion", so to speak.
In my (thankfully) long-ago days as a manager, I had a petty cash fund (used for stuff like office supplies and coffee filters and such). I'd spend that as I saw fit, and just send in my receipts once in a while (usually only when the petty cash box got low). No one got too worried about that.
Above that, I could make medium-sized purchases without approval, but I had to send in the paperwork immediately, along with a justification of why I'd spent the money.
Anything above that required approval at a higher level.
At the very least, it seems like both the CEO and the CFO should have to sign off on any money transfers of a potentially company-bankrupting size.
Maybe even add the CTO (or some other executive), just to have a third watchdog on the case.
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#47Anyone believing AI will be a nice thing in the future: With data from social media it's a fucking nightmare - billions of people having their relationships visible to everyone and a singular voice recording/video is enough to scam your friends, family, workplace. I don't see a future of the current communication channels without strong authentication measures - people already get scammed with shitty tactics by billi…
I doubt a single voice recording could generate speech with enough emotional depth that I'd be fooled by a fake call from my better half. Do people really have such a shallow connections to their loved ones that they wouldn't instinctively feel that something isn't right? C'mon, we humans operate with a lot of extra clues. Its not like we just STT and "read" the resulting output.
The spouse of a former boss of mine regularly mistook me for him, if I happened to answer his phone while he was at lunch or in the toilet or something (this was long before people had personal cell phones).
Once she even said "Hi! This is your little snuggle bunny!". Mutual embarrassment ensued.