The intonation is very good in a way that modern speech synthesizers don’t get quite right.
What do you mean? Text-to-speech systems from the past few years are indistinguishable from an actual human voice.
Voder Speech Synthesizer
11–20 of 46 posts
Re: Voder Speech Synthesizer
#12I was thinking about the complexity of expression in TTS voice synthesizers recently and it struck me just how difficult a problem that is.
To be as expressive as a human the AI model would need to fully "understand" the context of what is being said. Consider how a phrase like "I hate you" can be said in a loving way between friends sharing a joke at each others expense, vs being said with anger or in sadness.
It got me wondering if all sufficiently complex problems require models to be generally intelligent – at least in the sense that they have deep, nuanced models of the world.
For example, perhaps for a self-driving car to be as "good" as a human it actually needs to generally intelligent in that it needs to understand that it's appropriate to drive differently if it is in an emergency situation vs a leisurely weekend drive through a scenic part of town. When driving through my city after 8PM on the weekend I tend to drive slower and more cautiously because I know drunk people often walk out in front for my car – would a good self-driving car not need to understand these nuances of the world too?
This is interesting because it highlights just how important the element human understanding is in to accurately convey expression in a voice synthesizer. While I'd argue modern voice synthesizers have been more intelligible than this for some time the expressiveness of this machine has probably only been recently been rivalled by state of the art AI models.
Re: Voder Speech Synthesizer
#13Re: Voder Speech Synthesizer
#14Re: Voder Speech Synthesizer
#15This is quite off topic, but it reminded me of something I have been thinking about recently – perhaps at the limit all highly capable narrow AI systems must become generally intelligent. I was thinking about the complexity of expression in TTS voice synthesizers recently and it struck me just how difficult a problem that is. To be as expressive as a human the AI model would need to fully "understand" the context of…
For TTS, the "tone" is something you should encode in the input rather than have TTS figure out. I can imagine ebook > LLM > annotated text with speakers, emotions etc > TTS. So the TTS can remain rather dumb.
For the self-driving car, it shouldn't know cultural norms and be "more careful" sometimes. It should always know how much it sees and what stoping distance it can get with max breaking and its reaction time and adjust accordingly.
Agreed on stuff like emergencies etc.
Re: Voder Speech Synthesizer
#16Re: Voder Speech Synthesizer
#17This is quite off topic, but it reminded me of something I have been thinking about recently – perhaps at the limit all highly capable narrow AI systems must become generally intelligent. I was thinking about the complexity of expression in TTS voice synthesizers recently and it struck me just how difficult a problem that is. To be as expressive as a human the AI model would need to fully "understand" the context of…
Probably to some degree, but for your two examples I would argue that isn't necessary: For TTS, the "tone" is something you should encode in the input rather than have TTS figure out. I can imagine ebook > LLM > annotated text with speakers, emotions etc > TTS. So the TTS can remain rather dumb. For the self-driving car, it shouldn't know cultural norms and be "more careful" sometimes. It should always know how much…
I used to live next to two schools. In the morning before school the pavement and road outside my house was always full of school kids on bikes. During this time I'd drive with the assumption that at any moment a bike could drive out in front of my car because those kids were nuts and often did.
But to assume this generally just to be safe would be extremely inconvenient. In reality if I see a group of bikers wearing lycra I will assume their competent bikers. While I'll still drive carefully, I won't assume they're about to pull out in front of my car.
If self driving cars operate with the assumption that every pedestrian is drunk and every bike on the road is a 12 year school boy then no one will use them. Do self driving cars try to this currently? If I jaywalked in front of a Tesla is it designed to always be able to stop in time?
Re: Voder Speech Synthesizer
#18Re: Voder Speech Synthesizer
#19A short explanation as to how this works: The voice can be modeled using two main components. The vocal chords are a periodic source of sound, which is then filtered by the mouth and tongue to produce vowel sounds [0]. The filter can be modeled as a set of band-pass filters, each of which let through a specific band of frequencies — these are called ‘formants’ in acoustic phonetics. Different vowel sounds are produce…
Re: Voder Speech Synthesizer
#20Earlier quoted context omitted.
What do you mean? Text-to-speech systems from the past few years are indistinguishable from an actual human voice.
I agree that they got pretty good but there’s still something that they get wrong, their intonation is a kind of passable average. If you want to be able to distinguish them from actual human speech pay close attention to intonation/inflection. They’re still very usable, Im not claiming otherwise
https://cloud.google.com/text-to-speech/docs/wavenet
I'm fairly sure I couldn't tell Studio voices and real people apart in a blind test.