91–100 of 197 posts
Earlier quoted context omitted.
do you know if any current locally hostable public transcribers are good at diarization? for some tasks having even crude diarization would improve QOL by a huge factor. i was looking at a whisper diarization python package for a bit but it was a bitch to deploy.
WhisperX! https://github.com/basetenlabs/truss-examples/tree/main/whis...
Just a regular reminder to tell your friends and family to be extra skeptical about phone conversations. It’s becoming much more likely that the friend who desperately needs a gift card to Walmart isn’t the friend at all. :(
Earlier quoted context omitted.
FWIW in my recent experience I've found LLMs are very good at reading through the transcription errors (I've yet to experiment with giving the LLM alternate transcriptions or confidence levels, but I bet they could make good use of that too)
Pairing speech recognition with a LLM acting as a post-processor is a pretty good approach. I put together a script a while back which converts any passed audio file (wav, mp3, etc.), normalizes the audio, passes it to ggerganov whisper for transcription, and then forwards to an LLM to clean the text. I've used it with a pretty high rate of success on some of my very old and poorly recorded voice dictation recordings…
I've found it excellent with really common accents but with other accents (that are pretty common too) it can easily get stuck picking a different accent. For instance several Scottish recordings ended up Australian, likewise a fairly mild Yorkshire accent
Earlier quoted context omitted.
Nevermind, this is just ~3/10 open, or not really open at all [1]: https://github.com/resemble-ai/chatterbox/issues/45#issuecom... > For now, that means we’re not releasing the training code, and fine-tuning will be something we support through our paid API ( https://app.resemble.ai ). This helps us pay the bills and keep pushing out models that (hopefully) benefit everyone. Big bummer here, Resemble. This is not at…
Cant make everyone happy :)
If you're going to drop weights on unsuspecting developers (who might not be familiar with TTS) and make them think that they'll fit their use case, that's a bit of a bait-and-switch.
Chatterbox TTS is only available over API for fine tunes. That's an incredibly saturated market, and there are better quality and cheaper models for this.
Chatterbox TTS is equivalent to already-released semi-open weights from ByteDance and other labs, and those models already sound and perform better.
It'd be truly exciting if Chatterbox fine tunes could be done as open weights, similar to how Flux operates. Black Forest Labs has an entire open weights ecosystem built around them. While they do withhold their pro / highest quality variants, they always release open weights with training code for each commercial release. That's a much better model for courting open source developers.
Another company doing "open weights" right is Lightricks with LTX-1. They have a commercial studio, but they release all of their weights and tuning code in the open.
I don't see how this is a carrot for open source. It's an ad for the hosted API.
Earlier quoted context omitted.
1. Any non-OpenAI, non-Google, non-ElevenLabs player is going to have to aggressively open source or they'll become 100% irrelevant. The TTS market leaders are obvious and deeply entrenched, and Resemble, Play(HT), et al. have to aggressively cater to developers by offering up their weights [1]. 2. This is CYA for that. Without watermarking, there will be cries from the media about abuse (from anti-AI outfits like 40…
>Without watermarking, there will be cries from the media about abuse (from anti-AI outfits like 404Media [2] especially). it is highly amusing that they still believe they can put that genie back in the bottle with their usual crybully bullshit.
A lock needs not be infinitely strong to be useful, it just needs to take more resources to crack it than the locked thing is worth.
Earlier quoted context omitted.
Once it's good enough Audible will be flooded with AI-narrated books so we'll know soon. (The only question is whether Amazon would disclose it, ofc)
its watermarked
``` watermarked_wav = self.watermarker.apply_watermarl(... ```
You can run it for free here: https://huggingface.co/spaces/ResembleAI/Chatterbox
It makes my Australian accent sound very English though, in a posh RP way.
Very natural sounding, but not at all recreating my accent.
Still, amazingly clear and perfect for most TTS uses where you aren't actually impersonating anyone.
I've found it excellent with really common accents but with other accents (that are pretty common too) it can easily get stuck picking a different accent. For instance several Scottish recordings ended up Australian, likewise a fairly mild Yorkshire accent
Funnily enough, it made my Australian accent sound very English RP. I was suddenly very posh.
Also, a deployable model: https://lightning.ai/bhimrajyadav/ai-hub/temp_01jwr0adpqf055...