The Terrifying A.I. Scam That Uses Your Loved One's Voice
1–10 of 47 posts
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#2whatever happened to that yc company that was providing this service
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#3Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#4whatever happened to that yc company that was providing this service
ElevenLabs (not YC), which powers most of the popular voice cloning controversies that make mainstream media, just raised a round at a valuation of $1.1B: https://www.reuters.com/technology/voice-ai-startup-elevenla...
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#5It's right out of Terminator 2, except for the actually dead foster parents part.
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#6[flagged]
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#7[flagged]
Good luck with that.
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#8[flagged]
It's insanely cruel and fucked up. Imagining what this is like for the victims goes way, way beyond what calling it a "scam" implies.
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#9As horrible as this is, I suspect this will be far worse in enterprise companies. We’ve already seen issues with email impersonation where top managers or CEOs order money transfers, and since this works better than it should, we now use confirmation of some sort. Imagine if you’d get both the email and a call, maybe even a video call in the future with the confirmation… Especially CEOs will be very “easy” to impersonate since there is often quite a lot of video footage freely available of them.
You’re going to have to rely on personal confirmation, or digital signatures to do these sort of transfers. We use the digital signature since we have a system for that in Denmark, but we can’t use that for our Japanese department as an example as they don’t have a similar system which integrates with our national digital ID for companies. I guess our national system will eventually be extendable to Japanese citizens in some way, but it’ll likely never be extended to al the countries we operate in for various reasons.
And this is us being sort of ahead of the curve on this, even for most companies around here in the worlds most digitalised country (unless that’s Estonia now). Interesting times.
Re: The Terrifying A.I. Scam That Uses Your Loved One's Voice
#10[flagged]
It's insanely cruel and fucked up. Imagining what this is like for the victims goes way, way beyond what calling it a "scam" implies.
It’s actual terrorism. It’s just small beans compared to other things which we usually call terrorism, but that’s what quite a large number of these “scams” are, small scale terrorism.