Live data from Hacker News

This Voice Doesn't Exist – Generative Voice AI

blog.elevenlabs.io

61–70 of 279 posts

Re: This Voice Doesn't Exist – Generative Voice AI

#61
post #17

Imagine if in-game voice chat automatically converts player speech into the voice of the character they're playing -- this would resolve a lot of the gender-based harassment problems arising from competitive games requiring vocal communication, since now _everyone's_ default is hiding the actual player's voice, contrasting the "just use a voice changer if you're a girl playing" suggestion which themselves draws atten…

[deleted]

Re: This Voice Doesn't Exist – Generative Voice AI

#62
post #4

Impressive. Any chance there will be an API version of this product for real-time apps?

This is the major issue with the majority of this technology at the moment. Theres a plethora of options available and soon to be unveiled by several startups who are talking up their tech... but they are almost all for "editing"/"after the recording" work. You have to have a complete recorded track you can pass into their software (usually by uploading to their service) and then it will crunch away at the file and work their magic.

The current real time options I've found are... lacking, they are mostly fake/toys (not actually using voice cloning, just old school pitch shifting) or tech demo videos, with a scattering of research papers which are highly variable in terms of "how easily can i reproduce this", ranging from "sure if I want to waste money on a google colab instance, to "only works with specific model of video card due to reasons"

If you know of any real-time (audio stream in -> audio stream out) voice cloning/transform/replacement tools, feel free to post about them in a reply, this is an area of tech I'm trying to keep on top of and I'm only human so I have no idea what new company or research I might miss.

Re: This Voice Doesn't Exist – Generative Voice AI

#63
post #17

Imagine if in-game voice chat automatically converts player speech into the voice of the character they're playing -- this would resolve a lot of the gender-based harassment problems arising from competitive games requiring vocal communication, since now _everyone's_ default is hiding the actual player's voice, contrasting the "just use a voice changer if you're a girl playing" suggestion which themselves draws atten…

I’m looking forward to NPCs having dynamic responses with real voices Doesn't have to be prerecorded, just trained

A galaxy scale exploration game on the scale of Elite Dangerous where you could have more complex and varied interaction would be pretty amazing. The way you could apply these new AI models to video games has some wild potential. I think video games are one of the areas where I see the most potential for positive impact rather than negative impact.

Re: This Voice Doesn't Exist – Generative Voice AI

#67
post #37

Earlier quoted context omitted.

Not only voice actors, include radio hosts, documentary/news content, any voice over for anything, as well as imitation of familiar voices.

This will really open pandoras box for scammers and other bad actors. Grandma won't know she's speaking with an AI.

I have an AI service from my mobile company that talks to scammers. Idea is to hold scammer on call as much as possible. Then you can listen or read transcribe of those calls.

Re: This Voice Doesn't Exist – Generative Voice AI

#68
post #50

Earlier quoted context omitted.

Grandma already falls for scams. Will I know I’m speaking with an AI?

Any interaction that you didn’t kick off is a scam. Whether is is an AI or human is irrelevant.

That would mean any interaction I initiate is a scam for the other party

Re: This Voice Doesn't Exist – Generative Voice AI

#69

The “narrative” example is pretty good, but the “conversational” example is rather unpleasant to listen to. (Especially if you know how well Meryl Streep delivers that monologue in the original: https://youtu.be/Ja2fgquYTCg )

Agreed, the intro and narrative ones are great. The news one is terrible.

Re: This Voice Doesn't Exist – Generative Voice AI

#70

I can't tell if I'm starting to get that old person "new things are scary" instinct or if my gut level of fear about the implications of these things is warranted. As impressive as a lot of these models are, I can't help but feel like they're going to end up making an incredible amount of sterile soulless content that makes everyone's lives worse . We're already drowning in ad dominated cynical soulless computer gene…

I agree with this completely. Technology has always made us trade quality for low-quality quantity in exchange for convenience. People now interact more through technology which removes a lot of body language and other enriching experiences.

The most dangerous aspect of this is that each step seems relatively harmless: right now, ChatGPT and DALL-E are amusements, but each small step is building a monstrous and as you say, soulless machine that overloads us so much that we will forget what it's like to even be human.

I firmly believe (and I have given this a lot of thought) that technology is ultimately evil, and that tech companies are trading short term gain of enormous wealth for the very essence of humanity, preying upon the basic instincts of individuals who are also trading their personal worth for convenience.

If I could have one single wish fulfilled in this world, it would be that every single human being gain a natural and instinctual revulsion for advanced technology. If someone asked me what disease was the worst that ever plagued humanity, it would not be smallpox or the flu or COVID, it would be the tech company.

Post reply on HN