251–260 of 471 posts
Earlier quoted context omitted.
So basically stealing other people voice for you hobby? Great!
Who says it has to be someone else's voice?
I recommend you immediately add identity verification (state-issued identification verification), set up appropriate secrets store for PII, and audit trail EVERYTHING your users are doing, storing the contents in a secure location. Yesterday. This service will be used to harm others, shortly. I do think that there are exciting, honest things that can be done with this service but you need to set up some friction for…
Earlier quoted context omitted.
I'm with you on this. I can't honestly think a good use case for the average user to generate audio this way. Maybe some niche use case in like movie or tv production where you can generate a missing line without flying in an actor or something. Or maybe for generating dialogues for videogames. But those are business use cases, not things for the genral public.
My Dad died before my kids were born. When he got cancer, he recorded himself reading "The Night Before Christmas", which is about enough audio for the high quality version of this technology. Is it ghoulish on my part to want to hear his voice again or for my kids to hear it? Maybe. Do I really care what you think (or really what _I_ think) about that? No.
Earlier quoted context omitted.
yeah because that's working great for crypto lol
What do you mean? KYC is required on every US exchange.
Earlier quoted context omitted.
While I agree with you, the problem is far bigger than any one company in my opinion. These tools are already accessible enough to individuals that no audio or video is trustworthy, regardless of its source. I suspect we can still detect whether most faked audio/video is authentic or not algorithmically, but that's going to turn into an arms race eventually. And IMO none of the "answers" are ones that you really want…
I feel like this will be the thing that finally forces digital signing into the public eye. "Wait, is that video real?" "Well, it was signed by a reputable news source."
I recommend you immediately add identity verification (state-issued identification verification), set up appropriate secrets store for PII, and audit trail EVERYTHING your users are doing, storing the contents in a secure location. Yesterday. This service will be used to harm others, shortly. I do think that there are exciting, honest things that can be done with this service but you need to set up some friction for…
Like this example here: https://playground.play.ht/listen/1554 which says: > "Hi Mom, I need some help. Some guys hit me over the head and put me in a van, and they're saying they'll kill me if you don't wire money to this bank account." top class. EDIT this was about one page down on the "see what people are generating" page
This is the first startup here where I think the tech should essentially be illegal. It's cool tech, yes I'm impressed at the achievement. Nuclear weapons are impressive too. OTOH this kind of thing is getting easier and easier to do, so what's a realistic way forward?
Serious question. What is the difference in implications between this and a professional voice impersonator? I don't think it's as dangerous as we think it is. All of the consequences that Play.ht bring to society are already possible today and have been for some time. The difference is that it will be easier, but I don't think that makes it any more dangerous.
Of course a human could do that manually, but with those AIs it's a completely different scale, and it can be automated (so someone with no skills can click a button "generate 10k fake identities online").
Maybe even with one click, those techs could generate a fake coworker and send phishing e-mails. Suddenly every single e-mail you receive (or friend request or call) could be a very convincing fake. You don't have to be a high-value target anymore, it's all automated.
That makes it much more dangerous: from "can be forged manually with time and resources" to "everyone can do it at scale for free".
> I want you to lay me down, gently, and show me why you're known as the most agile tongue this side of the Mississippi
Whoever wrote that, bravo, I needed a good laugh today.