Live data from Hacker News

Chatterbox TTS

github.com

11–20 of 197 posts

Re: Chatterbox TTS

#13
post #8

Demos here: https://resemble-ai.github.io/chatterbox_demopage/ (not mine) This is a good release if they're not too cherry picked! I say this every time it comes up, and it's not as sexy to work on, but in my experiments voice AI is really held back by transcription, not TTS. Unless that's changed recently.

FWIW in my recent experience I've found LLMs are very good at reading through the transcription errors

(I've yet to experiment with giving the LLM alternate transcriptions or confidence levels, but I bet they could make good use of that too)

Re: Chatterbox TTS

#14
post #11

They should put the meaning of "TTS" in the readme somewhere, probably near the top. Or their website.

TTS is a very common initialism for Text-to-Speech going back to at least the 90s.

So? Acronym soup is bad communication.

Re: Chatterbox TTS

#15
post #11

They should put the meaning of "TTS" in the readme somewhere, probably near the top. Or their website.

Table Top Simulator.

It's obviously an AI for playing wargames without having to bother painting all the miniatures, or finding someone with the same weird interest in Balkan engagements during the Napoleonic era.

Re: Chatterbox TTS

#16
post #8

Demos here: https://resemble-ai.github.io/chatterbox_demopage/ (not mine) This is a good release if they're not too cherry picked! I say this every time it comes up, and it's not as sexy to work on, but in my experiments voice AI is really held back by transcription, not TTS. Unless that's changed recently.

Right you are. I've used speechmatics, they do a decent jon with transcription

1 error every 78 characters?

Re: Chatterbox TTS

#17
post #7

Are these things good enough to narrate a book convincingly or does the voice lose coherence after a few paragraphs being spoken?

Once it's good enough Audible will be flooded with AI-narrated books so we'll know soon. (The only question is whether Amazon would disclose it, ofc)

Re: Chatterbox TTS

#18
post #8

Demos here: https://resemble-ai.github.io/chatterbox_demopage/ (not mine) This is a good release if they're not too cherry picked! I say this every time it comes up, and it's not as sexy to work on, but in my experiments voice AI is really held back by transcription, not TTS. Unless that's changed recently.

FWIW in my recent experience I've found LLMs are very good at reading through the transcription errors (I've yet to experiment with giving the LLM alternate transcriptions or confidence levels, but I bet they could make good use of that too)

I was going to say, ideally you’d be able to funnel alternates to the LLM, because it would be vastly better equipped to judge what is a reasonable next word than a purely phonetic model.
Post reply on HN