This is the first startup here where I think the tech should essentially be illegal. It's cool tech, yes I'm impressed at the achievement. Nuclear weapons are impressive too. OTOH this kind of thing is getting easier and easier to do, so what's a realistic way forward?
Cofounder here, What you see in the above demo is a very rate-limited demo of our upcoming model. We realize how dangerous this technology can be and have built a lot of mitigations on our main product (Play.ht) to reduce possible abuse: - We strictly moderate the generated text of any sexual, offensive, racist, or threatening content. It automatically gets detected and blocked. - We built and are offering for free a…
This won't be the problem. My voice calling my parents asking for money to be sent to a random account will be the problem. And none of that will be sexual, offensive, racist, or threatening.
>we are working hard to mitigate that and deploy it safely.
How?
>we have seen enough genuine use cases
What?