can an expert in the field comment on whether the results are more or less impressive than Soundstorm?
Voicebox: Generative AI model for speech that generalizes across tasks
61–70 of 128 posts
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#62Earlier quoted context omitted.
Just listening to it, it's subjectively not better, but if it's > 10x faster/cheaper, I would use it anyway -- it's good enough to be listenable. Eleven Labs is the first voice synthesis that is good enough that I'd listen to an audiobook generated from it, but pricing is such that it would cost $100 to synthesize a 10 hour audiobook. A little too expensive. If they could get it down to $10 I'd cancel my Audible subs…
Have you tried tortoisetts? I believe eleven labs basically forked that and made improvements on voice quality and speed there
How does it compare to Voicebox in quality?
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#63Is this really better than eleven labs?
I'm not sure. Eleven Labs requires some tweaking of the parameters, but I've created samples that friends and family are certain is me.
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#64> introduces state of the art AI Model for speech > narrator for the presentation is indian woman with lisp every time
The narration was bad. I was thinking maybe it was the head developer of the project and they wanted her to narrate or something. Why would you choose that narration?
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#65Earlier quoted context omitted.
For me its more like I wake up and check if humans have been replaced yet. Oh good, it's another day that I don't have to share one time pads with my mother to ensure that I'm talking to her and not a simulant performing fraud on a massive scale.
Cryptographic proof of personhood is going to be a thing, is it not? Outside of BigTech, Signal is as poised as WorldCoin to be just that.
Yes and it's going to be done through digital IDs. Unless something dramatic happens, we're poised to turn to digital IDs linked to your real ID and in turn validating access to apps/communication.
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#66Earlier quoted context omitted.
Why would they make it cheaper when they can make even more profit by not having to pay a voice actor?
Because it would be extremely easy to produce it cheaper or record it independently. This opens up for non-signed authors to release audio books.
Yes, but they're not going to pass on costs from not using a voice actor. They're just going to charge what they normally would have, and not worry about having to give so and so a cut.
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#67I think that the "star trek" use case of a live translation is super exciting. I think that this also will force people to have pass phrases that they use to authenticate phone calls with. I normally downplay when people bring up everyone signing everything with a public/private key (impractical for normal users) but clearly there will be a need for authentication protocols as AI proliferates
Coming to an android and iphone near you voice authentication. Audio streams have inaudible data produced by encrypting a mutually known but changeable token like the current time with your private key embedded in the stream for example in frequencies you can't hear. Your phone app queries the service with the time of call and the data received and if they are also a subscriber it is able to discern their identity with certainty.
If this feature is standardized and built in it could be paired with a token like a yubikey which is on users keychain and authenticated even if they were using someone else's phone.
All these details can be completely opaque to the user who just needs to see a blue check by calls made with a device verifiably logged in as name@provider and a red exclamation beside calls made with no info at all.
Think fake kidnapping scams, industrial espionage, recent attacks involved in pretending to be in HR to redirect corp transfers to attacker.
Just a little doubt is liable to blow up such scams.
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#68I am mostly excited for cheaper audiobooks with consistent voices for different characters.
This is a huge issue in the voice acting community. Been frequent recent discussions over at https://www.reddit.com/r/VoiceActing/ . For what its worth, most of the cost of audiobooks doesn't come from paying talent. For intermediate level actors, the going rate is around $50-$100 per finished hour (PFH) and experienced actors it can be around $250-$300. This page does a decent job of laying out pay structures for au…
There’s also a different possible take on this.
Voice acting seems to be really bad career, so eliminating that job is desired, if you can deliver same quality/better product for cheaper to customers, without requiring employees to be underpaid.
I know it sucks for people in that industry, but technical progress always eliminates jobs. Calculator used to be a job, now it’s a device.
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#69All I want is a podcast player that automatically cleans up the crappy audio.
Re: Voicebox: Generative AI model for speech that generalizes across tasks
#70Earlier quoted context omitted.
like... a pin?
In the US some phone companies have been using voice recognition to authenticate when their customers call. This will definitely have to see its end.
HMRC in the UK also use it. Has never worked once for me and I don't even have any kind of accent.