Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chatterbox TTS

github.com

Post reply on HN
Print view View original

141–150 of 197 posts

Re: Chatterbox TTS

#141

Post by fastball »

eginhard wrote: post #136
echelon wrote: post #134

Earlier quoted context omitted.

I really don't think your analogy fits the absurdity of lacking the tooling. It's more like you have to decompile an N64 cartridge ROM and don't have the tools. But I don't want to play that game. I'll up the ante. I'll bet you money that nobody forks this and adds fine tuning for at least a year.

Someone already did: https://github.com/stlohrey/chatterbox-finetuning And someone else fine-tuned it for German: https://huggingface.co/SebastianBodza/Kartoffelbox-v0.1

You're supposed to wait to post this until I agree to the bet ;)

Re: Chatterbox TTS

#142

Post by 3ds »

There are only english voices, even in the paid version. Using them in other languages results in an accent.

Re: Chatterbox TTS

#143

Post by ltrg »

nmstoker wrote: post #21

I've found it excellent with really common accents but with other accents (that are pretty common too) it can easily get stuck picking a different accent. For instance several Scottish recordings ended up Australian, likewise a fairly mild Yorkshire accent

I'm English (RP) and it gave me a Yorkshire accent and Scottish accent in turn.

Re: Chatterbox TTS

#144

Post by aquariusDue »

rapfaria wrote: post #81
aquariusDue wrote: post #24

Earlier quoted context omitted.

I miss glossaries.

An AI-powered browser extension that shows on hover the most likely acronym meaning, based on context you say?

I've used this one for a hot minute a few weeks ago: https://lumetrium.com/definer/

It also can be configured to use Ollama or an API key from other providers (OpenRouter included) and from what I gather the default prompt can be changed too.

Sadly it's closed source.

Re: Chatterbox TTS

#145

Post by [deleted] »

theyinwhy wrote: post #124
pinter69 wrote: post #122

Earlier quoted context omitted.

The way to measure transcription accuracy is word error and not character error. I have not really checked or trusted) speechmatics' accuracy benchmarks But, from my experience and personal impression - it looks good, haven't done a quantitative benchmark

Thanks for your constructive reply on my bad joke. I was referring to your original comment where you had a typo. I just couldn't resist, sorry.

[deleted]

Re: Chatterbox TTS

#146

Post by andrewstuart »

There’s been surprisingly little advancement in TTS after a rapid leap forward three years ago or so.

There’s eleven labs which is quite good but not incredible and very expensive.

Everything else ……. all the big AI companies …. have TTS systems that are kinda meh.

Everything else in AI has advanced in leaps and bounds, TTS remains deep in the uncanny valley.

Re: Chatterbox TTS

#147

Post by miki123211 »

mikepurvis wrote: post #18
ianbicking wrote: post #13

Earlier quoted context omitted.

FWIW in my recent experience I've found LLMs are very good at reading through the transcription errors (I've yet to experiment with giving the LLM alternate transcriptions or confidence levels, but I bet they could make good use of that too)

I was going to say, ideally you’d be able to funnel alternates to the LLM, because it would be vastly better equipped to judge what is a reasonable next word than a purely phonetic model.

This is actually something people used to do.

old ASR systems (even models like Wav2vec) were usually combined with a language model. It wasn't a large language model, those didn't exist at the time, it was usually something based on n-grams.

Re: Chatterbox TTS

#148

Post by venusenvy47 »

travisvn wrote: post #123

Chatterbox is fantastic. I created an API wrapper that also makes installation easier (Dockerized as well) https://github.com/travisvn/chatterbox-tts-api/ Best voice cloning option available locally by far, in my experience.

Would this be usable on a PC without a GPU?

Re: Chatterbox TTS

#150

Post by venusenvy47 »

elektor wrote: post #38
abraxas wrote: post #7

Are these things good enough to narrate a book convincingly or does the voice lose coherence after a few paragraphs being spoken?

Yes, I've generated an audiobook of a epub using this tool and the result was passable: https://github.com/santinic/audiblez

Regarding your example "On a Google Colab's T4 GPU via Cuda, it takes about 5 minutes to convert "Animal's Farm"", do you know the approximate cost to perform this? I've only used Colab at the free level, so I have no concept of the costs for GPU time.
Post reply on HN