41–50 of 128 posts
I am mostly excited for cheaper audiobooks with consistent voices for different characters.
Use text to speech and chatgpt to tag the character text and timestamps.
Then use a speech to speech to change the character voices or even the whole reader.
But as a product I feel like theres some legal hurdles to figure out.
Is Meta just operating in hope and AI moonshots now ? Everyone one of their products is just garbage to me and becoming less relevant by the day. When do they actually starting building something useful again ? Honestly Apple seems to be using “AI” much more successfully and actually seamlessly integrating it into their existing products to improve them. My theory is Mark is hoping the meta verse will pop out if Yan’…
I think that the "star trek" use case of a live translation is super exciting. I think that this also will force people to have pass phrases that they use to authenticate phone calls with. I normally downplay when people bring up everyone signing everything with a public/private key (impractical for normal users) but clearly there will be a need for authentication protocols as AI proliferates
> As with other powerful new AI innovations, we recognize that this technology brings the potential for misuse and unintended harm. In our paper, we detail how we built a highly effective classifier that can distinguish between authentic speech and audio generated with Voicebox to mitigate these possible future risks. We believe it is important to be open about our work so the research community can build on it and t…
That little stinger at the end was not as surprising as they thought it was :P It's very cool tech, but it's far from transparent. It has a very obvious "autotune" like sound to it that jumps right out. when they edited that one word it was obvious it had been edited. Again, super cool tech, just not going to replace voice actors or anything.
When. Narrating. Videos. One. Tends. To. Speak. Differently.
Or, the more important case -- if I'm listening to audio-version-of-X, is it sufficiently human-like that I can forget that it's synthesized voice?
To me, yes.
Easy to tell if you're specifically listening for it, but to use an analogy one doesn't typically read novels and parse closely for grammar, does one? Your attention is elsewhere, on the content and plot.
Is this really better than eleven labs?
Just listening to it, it's subjectively not better, but if it's > 10x faster/cheaper, I would use it anyway -- it's good enough to be listenable. Eleven Labs is the first voice synthesis that is good enough that I'd listen to an audiobook generated from it, but pricing is such that it would cost $100 to synthesize a 10 hour audiobook. A little too expensive. If they could get it down to $10 I'd cancel my Audible subs…
This is basically my dream for local AI... locals models trained on my own data/code/styles. Even if they're slow, as long as they work (V/RAM) and are of high enough quality then I'm happy to wait!
I am mostly excited for cheaper audiobooks with consistent voices for different characters.
Why would they make it cheaper when they can make even more profit by not having to pay a voice actor?
This opens up for non-signed authors to release audio books.
Is this really better than eleven labs?
Just listening to it, it's subjectively not better, but if it's > 10x faster/cheaper, I would use it anyway -- it's good enough to be listenable. Eleven Labs is the first voice synthesis that is good enough that I'd listen to an audiobook generated from it, but pricing is such that it would cost $100 to synthesize a 10 hour audiobook. A little too expensive. If they could get it down to $10 I'd cancel my Audible subs…
I think that the "star trek" use case of a live translation is super exciting. I think that this also will force people to have pass phrases that they use to authenticate phone calls with. I normally downplay when people bring up everyone signing everything with a public/private key (impractical for normal users) but clearly there will be a need for authentication protocols as AI proliferates
like... a pin?