For reference in case anyone is wondering, it is based on:
https://github.com/152334H/tortoise-tts-fast
The developer of tortoise tts fast was hired by Eleven labs.
Eleven v3
61–70 of 168 posts
Re: Eleven v3
#62From the example: "Oh no, I'm really sorry to hear you're having trouble with your new device. That sounds frustrating." Being patronized by a machine when you just want help is going to feel absolutely terrible. Not looking forward to this future.
"I can help you get a replacement. Here let me pull up a totally hallucinated order number and a link that goes nowhere. Did that solve your problem?"
Look at it this way—if someone were trying to sabotage the entire tech support industry, convincing companies to ditch all their existing staff and infrastructure and replace them with our cheerfully unhelpful and fault-prone AI friends would be a great start!
Re: Eleven v3
#63We’re using elevenlabs in a new prototype, and it gets confused by its own voice which my mic picks up. Unless I wear headphones, it thinks I’m talking, and it gets into a loop. I hope this release fixes that bug!
That doesn't sound like a problem they need to solve.
On your client you need to implement some form of echo cancellation.
Re: Eleven v3
#64We’re using elevenlabs in a new prototype, and it gets confused by its own voice which my mic picks up. Unless I wear headphones, it thinks I’m talking, and it gets into a loop. I hope this release fixes that bug!
This is not a model issue - you just have not properly implemented acoustic echo cancellation on your end.
Re: Eleven v3
#65>Is this available over API?
>Public API for Eleven v3 (alpha) is coming soon.
There is zero use for this without an API endpoint. At least is coming.
Re: Eleven v3
#66Re: Eleven v3
#67Unfortunately voice actors will be replaced by someThing like this hopefully they will find someThing else To do
I dunno. It's definitely a concern in the community. But real people are still getting work.
Audible has ruined their catalog listings with their "Virtual voice" thing and no option to filter them out. They're mostly low quality books narrated by subpar AI voice that don't sell at all, while making it extremely difficult to find quality new books to listen to.
Re: Eleven v3
#68What's the state of open source tts? I'm a heavy TTS user, anything that can run at 3x-4x speed off enthusiast hardware?
expressive: https://github.com/resemble-ai/chatterbox
dialogue like notebooklm: https://github.com/nari-labs/dia
Re: Eleven v3
#69Earlier quoted context omitted.
Ouch. Professional Voice Actor here.
Just here to say the oposite. It is astonshing how far away it still is from a professional voice actor while being really good. Emotion is completely missing. Instead it seems to try to hard to express exactly that. I cant really put my finger on it. It feels predictable, flat and the timing is strange.
Better by a mile than most anime voice work, but lacks the detail that a good voice narrator has on an audio book.
Re: Eleven v3
#70Earlier quoted context omitted.
If you edit the text so that laugh makes sense in the context it should be much more natural like this one: https://x.com/elevenlabsio/status/1930689782331412811
The first laugh in that " Hey, Dr. Von Fusion" is a dedicated laugh section, which the model does extremely well, but it works because that's a natural place to laugh before actually speaking the following words. Skip ahead to "...robot chuckle. Jessica: I know right!" and you get an awkwardly time/toned light chuckle completely separated from the "I know" you'd naturally continue saying while making that chuckle. Yo…
have to say that this human can't tell the difference between this and other real humans so...