Live data from Hacker News

Chatterbox TTS

github.com

131–140 of 197 posts

Re: Chatterbox TTS

#131
post #82

It's only for English sadly

Are there any good options for non-English languages?

It's not on the same level in terms of emotion, but I believe the research https://github.com/CorentinJ/Real-Time-Voice-Cloning was based on is mostly oriented around Chinese first (and then English). It seems to work well enough if you and the voice you're cloning speak the same language though I haven't tested it much.

Re: Chatterbox TTS

#132
post #90

another TTS that is only supporting English. This really irritates me

For what it's worth, there are also a whole bunch of models that speak Chinese.

So far the US and China are spearheading AI research, so it makes sense that models optimize for languages spoken there. Spanish is an interesting omission on the US part, but that's probably because most AI researchers in the US speak English even if their native tongue is Spanish.

Re: Chatterbox TTS

#134

Earlier quoted context omitted.

Machine learning assets are not binary "open" or "closed". There is a continuum of openness. To make a really poor analogy, this repo is like a version of Linux that you can't cross-compile or port. To make another really poor (but fitting) analogy, this is like an "open core" SaaS platform that you know you'll never be able to run the features that matter on your own. This repo scores really low on the "openness" co…

Why can't you improve it or fit it to your data? This can be cross-compiled/ported in the Linux analogy. The Linux analogy would be more like: a kernel dev wrote code for some part of the Linux kernel using JetBrains' CLion. He used features of CLion that made this process much easer than if he had written the code using `nano`. By your logic, the resulting kernel code is not "open" because the tooling used to create…

I really don't think your analogy fits the absurdity of lacking the tooling. It's more like you have to decompile an N64 cartridge ROM and don't have the tools. But I don't want to play that game.

I'll up the ante. I'll bet you money that nobody forks this and adds fine tuning for at least a year.

Re: Chatterbox TTS

#135
post #96

Earlier quoted context omitted.

>Without watermarking, there will be cries from the media about abuse (from anti-AI outfits like 404Media [2] especially). it is highly amusing that they still believe they can put that genie back in the bottle with their usual crybully bullshit.

Some measures like that still sort of work. Try loading a scanned picture of a dollar bill into Photoshop. Try printing it on a color printer. Try printing anything on a coor printer without the yellow tracking pixels. A lock needs not be infinitely strong to be useful, it just needs to take more resources to crack it than the locked thing is worth.

[dead]

Re: Chatterbox TTS

#136

Earlier quoted context omitted.

Why can't you improve it or fit it to your data? This can be cross-compiled/ported in the Linux analogy. The Linux analogy would be more like: a kernel dev wrote code for some part of the Linux kernel using JetBrains' CLion. He used features of CLion that made this process much easer than if he had written the code using `nano`. By your logic, the resulting kernel code is not "open" because the tooling used to create…

I really don't think your analogy fits the absurdity of lacking the tooling. It's more like you have to decompile an N64 cartridge ROM and don't have the tools. But I don't want to play that game. I'll up the ante. I'll bet you money that nobody forks this and adds fine tuning for at least a year.

Someone already did: https://github.com/stlohrey/chatterbox-finetuning

And someone else fine-tuned it for German: https://huggingface.co/SebastianBodza/Kartoffelbox-v0.1

Re: Chatterbox TTS

#137

Anyone know how this compares to Kokoro? I've found Kokoro very useful for generating audiobook but it almost always pronounces words with paired vowels incorrectly. Daisy becomes die-zee, leave becomes lay-ve, etc.

If you're running Kokoro yourself then it might be worth checking your phonemizer / espeak-ng installs in case they are messing up the phonemes for those words (which are then passed on as inputs to Kokoro itself)

Re: Chatterbox TTS

#138
post #90

another TTS that is only supporting English. This really irritates me

Maybe that irritation could be channelled to contributing into one that supports not only English? Even small steps like tweaking docs, adding missing/extra examples, fielding a few issues in GH (most are usually simple misunderstandings where a quick pointer can easily help a beginner)
Post reply on HN