Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chatterbox TTS

github.com

Post reply on HN
Print view View original

151–160 of 197 posts

Re: Chatterbox TTS

#152

Post by echelon »

fastball wrote: post #141
eginhard wrote: post #136

Earlier quoted context omitted.

Someone already did: https://github.com/stlohrey/chatterbox-finetuning And someone else fine-tuned it for German: https://huggingface.co/SebastianBodza/Kartoffelbox-v0.1

You're supposed to wait to post this until I agree to the bet ;)

I'm totally humbled by this.

I haven't seen this level of involvement for a lot of the models I'm using, including several text to speech models.

The rapidity of this is also quite shocking. I don't think Resemble anticipated this either, given their wording on the aforementioned ticket.

There's probably a lot more work to do to ensure this works, adjusting learning rates, batching, etc., but it's all clearly being put into place and given attention. Even if this model has some finicky fine tuning behaviors, with this kind of willpower it'll be quickly overcome.

I suppose I owe you, haha.

Re: Chatterbox TTS

#153

Post by KaiserPro »

iambateman wrote: post #73

Just a regular reminder to tell your friends and family to be extra skeptical about phone conversations. It’s becoming much more likely that the friend who desperately needs a gift card to Walmart isn’t the friend at all. :(

In the UK I have been getting AI-fancyTTS calls quite often. I even got one today.

interupting them with "can you make me a poem about x" works reliably. However the latency is a dead give away.

Re: Chatterbox TTS

#154

Post by dragonwriter »

vunderba wrote: post #43
Tokumei-no-hito wrote: post #36

Earlier quoted context omitted.

thanks for sharing. are some local models better than others? can small models work well or do you want 8B+?

So in my experience smaller models tend to produce worse results BUT I actually got really good transcription cleanup with CoT (Chain of Thought models) like Qwen even quantized down to 8b.

I think the 8B+ question was about parameter count (8 billion+ parameters), not quantization level (8 bits per weight).

Re: Chatterbox TTS

#155

Post by andymcsherry »

ipsum2 wrote: post #113
andymcsherry wrote: post #100

Here's an open-source serving implementation: https://lightning.ai/bhimrajyadav/studios/build-a-production... Also, a deployable model: https://lightning.ai/bhimrajyadav/ai-hub/temp_01jwr0adpqf055...

You failed to mention that this is an ad for the company you work at. Also, the links don't even work without signing up for some shitty service.

Hey ipsum, sorry I could have mentioned that. We spend a ton of effort on open source and sharing our ML knowledge with the community. If you don't want to use our platform, the entire source code and a tutorial is there to run it on your own.

Re: Chatterbox TTS

#157

Post by IshKebab »

chii wrote: post #114
iambateman wrote: post #73

Just a regular reminder to tell your friends and family to be extra skeptical about phone conversations. It’s becoming much more likely that the friend who desperately needs a gift card to Walmart isn’t the friend at all. :(

the easiest way to defeat phone fraud is to ahead of time decide on a verbal password between family (and close friends, if they're close enough that you'd lend them money). In a real scenario, they'd know the verbal password and you can authenticate them. Drum it into them that this password will prevent other people from impersonating you in this brave new world of ai voices and even video.

"Oh sorry son did we have a password? I totally forgot."

This is a HN fantasy solution.

Re: Chatterbox TTS

#158

Post by ajolly »

skygazer wrote: post #77
landl0rd wrote: post #25

Earlier quoted context omitted.

Flip side is a solution where I can have a book without an audiobook auto-generated (or use an existing ebook rather than paying audible $30 for their version) and it's "good enough" is a legit improvement. AI generated isn't as good but it's better than nothing. Also, being able to interrupt and ask for more detail/context would be pretty nice. Like I'm reading some Pynchon and I have to stop sometimes and look up t…

If you're willing to forgo the interactive LLM bit, kokoro-tts (just a script using Kokoro-ONNX) takes epubs and outputs a series of wavs or mp3s that need to be stitched together into chapters or audiobook m4a with some ffmpeg fu. I've listened to several generated audiobooks, and found them pretty good. Some nice generic narration-like prosody. It uses espeak-ng to generate phonemes and passes those to the model to…

I've been using epub2tts / epub2tts-edge and its been working well for me. Converts into m4b

Re: Chatterbox TTS

#159

Post by barrell »

audiala wrote: post #117

What is the current state of the art for open source multilingual TTS? I have found Kokoro to be great as English as well, but am still searching for a good solution for French, Japanese, German...

I’ve also been looking for this. OpenVoice2 supports a few languages (5 IIRC), but I haven’t seen anything usable yet

Re: Chatterbox TTS

#160

Post by Ylpertnodi »

IshKebab wrote: post #157
chii wrote: post #114

Earlier quoted context omitted.

the easiest way to defeat phone fraud is to ahead of time decide on a verbal password between family (and close friends, if they're close enough that you'd lend them money). In a real scenario, they'd know the verbal password and you can authenticate them. Drum it into them that this password will prevent other people from impersonating you in this brave new world of ai voices and even video.

"Oh sorry son did we have a password? I totally forgot." This is a HN fantasy solution.

Works for me and the family. No code-word, no transfer of funds.
Post reply on HN