Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chatterbox TTS

github.com

Post reply on HN
Print view View original

61–70 of 197 posts

Re: Chatterbox TTS

#61

Post by echelon »

teraflop wrote: post #35

> Every audio file generated by Chatterbox includes Resemble AI's Perth (Perceptual Threshold) Watermarker - imperceptible neural watermarks that survive MP3 compression, audio editing, and common manipulations while maintaining nearly 100% detection accuracy. Am I misunderstanding, or can you trivially disable the watermark by simply commenting out the call to the apply_watermark function in tts.py? https://github.c…

1. Any non-OpenAI, non-Google, non-ElevenLabs player is going to have to aggressively open source or they'll become 100% irrelevant. The TTS market leaders are obvious and deeply entrenched, and Resemble, Play(HT), et al. have to aggressively cater to developers by offering up their weights [1].

2. This is CYA for that. Without watermarking, there will be cries from the media about abuse (from anti-AI outfits like 404Media [2] especially).

[1] This is the right way to do it. Offer source code and weights, offer their own API/fine tuning so developers don't have to deal with the hassle. That's how they win back some market share.

[2] https://www.404media.co/wikipedia-pauses-ai-generated-summar...

Re: Chatterbox TTS

#63

Post by backnotprop »

teraflop wrote: post #35

> Every audio file generated by Chatterbox includes Resemble AI's Perth (Perceptual Threshold) Watermarker - imperceptible neural watermarks that survive MP3 compression, audio editing, and common manipulations while maintaining nearly 100% detection accuracy. Am I misunderstanding, or can you trivially disable the watermark by simply commenting out the call to the apply_watermark function in tts.py? https://github.c…

[dead]

Re: Chatterbox TTS

#64

Post by backnotprop »

causal wrote: post #27
Mizza wrote: post #8

Demos here: https://resemble-ai.github.io/chatterbox_demopage/ (not mine) This is a good release if they're not too cherry picked! I say this every time it comes up, and it's not as sexy to work on, but in my experiments voice AI is really held back by transcription, not TTS. Unless that's changed recently.

Play with the Huggingface demo and I'm guessing this page is a little cherry-picked? In particular I am not getting that kind of emotion in my responses.

It is hard to get consistent emotion with this. There are some parameters, and you can go a bit crazy, but it gets weird…

Re: Chatterbox TTS

#66

Post by thorum »

01HNNWZ0MV43FF wrote: post #53
pryelluw wrote: post #20

Silly question, what’s the lowest spec hardware this will run ?

I was going to report how it runs on an old CPU but after fussing with it for about 30 minutes, I can't even get it to run. Listing the issues in case it helps anyone: - It doesn't work with Python 3.13, luckily `uv` makes it easy to build a venv with 3.12 - It said numpy 1.26.4 doesn't exist. It definitely does, but `uv pip` was searching for it on the pytorch repo. I passed an `--index-strategy` flag so it would ch…

We’ll know AGI has arrived when it can figure out Python dependency conflicts

Re: Chatterbox TTS

#67

Post by CGamesPlay »

andy_xor_andrew wrote: post #39

in my experience, TTS has been a "pick two" situation: - fast / cheap to run - can clone voices - sounds super realistic from what I can tell, Chatterbox is the first that apparently lets you pick 3! (have not tried it myself yet, this is just what I can deduce)

Can you share one that is fast/cheap to run and sounds super realistic? I'm very interested in finding a good TTS and not really concerned about cloning any particular voice (but would like a "distinctive" voice that isn't just a preset one).

Re: Chatterbox TTS

#68

Post by thorum »

pryelluw wrote: post #20

Silly question, what’s the lowest spec hardware this will run ?

This GitHub issue says 6-7 GB VRAM: https://github.com/resemble-ai/chatterbox/issues/44

But if the model is any good someone will probably find a way to optimize it to run on even less.

Edit: Got it running on an old Nvidia 2060, I'm seeing ~5 GB VRAM peak.

Re: Chatterbox TTS

#69

Post by magicalhippo »

pryelluw wrote: post #20

Silly question, what’s the lowest spec hardware this will run ?

Looking at the issues page, it seems it's not well optimized[1] currently.

So out of the box it seems quite beefy consumer hardware will be needed for it to perform reasonably. However it seems like there's significant potential for improvements, though I'm no expert.

[1]: https://github.com/resemble-ai/chatterbox/issues/127

Re: Chatterbox TTS

#70

Post by BigBananaGuy »

causality0 wrote: post #48

Anyone know how this compares to Kokoro? I've found Kokoro very useful for generating audiobook but it almost always pronounces words with paired vowels incorrectly. Daisy becomes die-zee, leave becomes lay-ve, etc.

Chatterbox sounds much more natural. The zero shot voice cloning and exaggeration feature is sick!
Post reply on HN