Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

This Voice Doesn't Exist – Generative Voice AI

blog.elevenlabs.io

Post reply on HN
Print view View original

151–160 of 279 posts

Re: This Voice Doesn't Exist – Generative Voice AI

#151

Post by spaceman_2020 »

didericis wrote: post #56

I can't tell if I'm starting to get that old person "new things are scary" instinct or if my gut level of fear about the implications of these things is warranted. As impressive as a lot of these models are, I can't help but feel like they're going to end up making an incredible amount of sterile soulless content that makes everyone's lives worse . We're already drowning in ad dominated cynical soulless computer gene…

My YouTube feed is currently filled with videos of whitehats hacking into Indian scam call centers.

Most of the time, the giveaway is the callers' Indian accent. If you could simply type into a box and speak with an American accent, it would be really hard to get caught.

We're opening a pandora's box here if I'm honest. I'm hardly one for pro-regulation, but good God, we're playing with things here that can really hurt us down the line.

Re: This Voice Doesn't Exist – Generative Voice AI

#152

Post by spaceman_2020 »

5350-uiop-1130 wrote: post #79
didericis wrote: post #56

I can't tell if I'm starting to get that old person "new things are scary" instinct or if my gut level of fear about the implications of these things is warranted. As impressive as a lot of these models are, I can't help but feel like they're going to end up making an incredible amount of sterile soulless content that makes everyone's lives worse . We're already drowning in ad dominated cynical soulless computer gene…

I think we already have a lot of soulless human generated search results. I think there will be need for a greater level of filtering and curation yes, but I see it as an opportunity both for creators and curators. The barriers to entry for media creation will go down, but with saturation also the already low margins of profit will get worse.

we'll go back to the old way of consuming media - recommended by friends, vetted by known curators.

Re: This Voice Doesn't Exist – Generative Voice AI

#153

Post by spaceman_2020 »

elboru wrote: post #50
holler wrote: post #37

Earlier quoted context omitted.

This will really open pandoras box for scammers and other bad actors. Grandma won't know she's speaking with an AI.

Grandma already falls for scams. Will I know I’m speaking with an AI?

I really can't tell half the time on easy-to-spam forums like Reddit if I'm chatting with an AI or a human.

Re: This Voice Doesn't Exist – Generative Voice AI

#154

Post by monk1 »

Good to see that authors/maintainers of AI models are beginning to think about attribution. But it seems like this will be a hard problem to solve. For example, say my voice was part of the training data set, to what degree can I lay claim to the newly created voices? Also, will there be some sort of grading/ranking (e.g. it could be argued that some of the voices used in the training set are more desirable than others, and therefore their "owners" deserve better fees etc.)?

Re: This Voice Doesn't Exist – Generative Voice AI

#155

Post by Roark66 »

yreg wrote: post #97
pronlover723 wrote: post #84

What are the odds of this kind of thing being open source so I can use it at home. So far, most of the "good" text-to-speech systems are all commercial services https://aws.amazon.com/polly/ https://cloud.google.com/text-to-speech https://azure.microsoft.com/en-us/products/cognitive-service... And now one is also a service. I tried using tortoise-tts on my M1. Generating a 7 minute speech took 3 days and, while bette…

Any time I see AI model news on hn nowadays, my first question is whether I can run it locally, and if not, what are the alternatives that I can run locally.

The speed of progress on this front is increasing. These days even "cheap" rockchip MCUs are packing 5TOPs AI accelerators. And both AMD and Intel are working on much more powerful ones for their cpus. Heck, I recently wrote a mobile (android) app that runs pretty powerfull AI for intensive image processing locally on mobile phones thinking improved privacy would be more in demand than sending everything "to the cloud". I was mildly surprised to discover most people don't care (after writing the app). Still, I wouldn't be surprised if in 10 years the majority of AI people use rums on end user devices.

Re: This Voice Doesn't Exist – Generative Voice AI

#157

Post by slim »

KRAKRISMOTT wrote: post #126
bredren wrote: post #116

Earlier quoted context omitted.

I don’t know how many of the solutions offer this, but there is a markup language for TTS: https://en.wikipedia.org/wiki/Speech_Synthesis_Markup_Langua... Amazon Polly, (which seems kind of ancient with all these new solutions showing up) has supported SSML for some time. AWS Polly SSML docs: https://docs.aws.amazon.com/polly/latest/dg/ssml.html

In practice they are next to useless, the expressions are not very... expressive (just try it in the AWS editor). I suspect a LLM would be able to infer the context or we can use prompt engineering to generate the appropriate tokens encoding emotions for the intermediate neural codecs directly (Mel spectrograms are so passé now post Vall-E).

maybe the only way to express speech precisely is the speech itself ?

Re: This Voice Doesn't Exist – Generative Voice AI

#158

Post by hnbad »

rvz wrote: post #60

> At Eleven, we're fully committed both to respecting intellectual property rights and to implementing safeguards against potential misuse of our technology Unlike Stable Diffusion trampling over the copyright of artists without their permission and OpenAI doing the same for code mangled with incompatible licenses and monetizing it and outputting the trained data verbatim whilst opening a pandora's box and then attem…

Are you really surprised though?

The crypto hype was a vehicle for VC backed companies to sell unregulated financial products to retail investors.

The "gig economy" was a vehicle for VC backed companies to skirt labor protections and zoning laws.

And now AI is a vehicle for VC backed companies to skirt copyright laws.

"Disruption" is often just about finding edge cases of existing laws and regulations and exploiting them for profit until legislation catches up.

Re: This Voice Doesn't Exist – Generative Voice AI

#159

Post by IshKebab »

feoren wrote: post #111

Okay can I ask a question that has been bothering me for a long time? Why do seemingly all these text-to-speech programs attempt to produce spoken voice based solely on raw text ? Why don't they consume a MIDI-like text-markup language where you can write phonetic pronunciations along with markup about the emotion, volume, speed, etc.? I feel like this is a huge unnecessary roadblock holding back this kind of technol…

I think markup would always be more work and less effective than using your own voice input to guide its tone.

Re: This Voice Doesn't Exist – Generative Voice AI

#160

Post by wpietri »

IshKebab wrote: post #159
feoren wrote: post #111

Okay can I ask a question that has been bothering me for a long time? Why do seemingly all these text-to-speech programs attempt to produce spoken voice based solely on raw text ? Why don't they consume a MIDI-like text-markup language where you can write phonetic pronunciations along with markup about the emotion, volume, speed, etc.? I feel like this is a huge unnecessary roadblock holding back this kind of technol…

I think markup would always be more work and less effective than using your own voice input to guide its tone.

But not nearly as manageable. Imagine saying the same thing about music, for example. Musical notation is clearly more work than just humming a tune, but there's still a need for it.
Post reply on HN