Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chatterbox TTS

github.com

Post reply on HN
Print view View original

171–180 of 197 posts

Re: Chatterbox TTS

#171

Post by travisvn »

mistersquid wrote: post #170
travisvn wrote: post #169

Earlier quoted context omitted.

This API wrapper was initially made to support a particular use case where someone's running, say, Open WebUI or AnythingLLM or some other local LLM frontend. A lot of these frontends have an option for using OpenAI's TTS API, and some of them allow you to specify the URL for that endpoint, allowing for "drop-in replacements" like this project. So the speech generation endpoint in the API is designed to fill that nic…

This is way more of a response than I could have even hoped for. Thank you so much. To answer your question, yes, my local text files are .txt files.

Ok, here's a command that works.

I'm new to actually commenting on HN as opposed to just lurking, so I hope this formatting works..

  cat your_file.txt | python3 -c 'import sys, json; print(json.dumps({"input": sys.stdin.read()}))' | curl -X POST http://localhost:5123/v1/audio/speech \
    -H "Content-Type: application/json" \
    -d @- \
    --output speech.wav
Just replace the `your_file.txt` with.. well, you get it.

This'll hopefully handle any potential issues you'd have with quotes or other symbols breaking the JSON input.

Let me know how it goes!

Oh and you might want to change `python3` to `python` depending on your setup.

Re: Chatterbox TTS

#172

Post by mistersquid »

travisvn wrote: post #171
mistersquid wrote: post #170

Earlier quoted context omitted.

This is way more of a response than I could have even hoped for. Thank you so much. To answer your question, yes, my local text files are .txt files.

Ok, here's a command that works. I'm new to actually commenting on HN as opposed to just lurking, so I hope this formatting works.. cat your_file.txt | python3 -c 'import sys, json; print(json.dumps({"input": sys.stdin.read()}))' | curl -X POST http://localhost:5123/v1/audio/speech \ -H "Content-Type: application/json" \ -d @- \ --output speech.wav Just replace the `your_file.txt` with.. well, you get it. This'll hop…

> Just replace the `your_file.txt` with.. well, you get it.

> This'll hopefully handle any potential issues you'd have with quotes or other symbols breaking the JSON input.

> Let me know how it goes!

Wow. I'm humbled and grateful.

I'll update once I'm done with work and back in front of my hone nachine.

Re: Chatterbox TTS

#173

Post by IshKebab »

Ylpertnodi wrote: post #160
IshKebab wrote: post #157

Earlier quoted context omitted.

"Oh sorry son did we have a password? I totally forgot." This is a HN fantasy solution.

Works for me and the family. No code-word, no transfer of funds.

Have your parents been targeted by convincing fraudsters? It doesn't work for you; you hope it will work.

Re: Chatterbox TTS

#174

Post by cpill »

echelon wrote: post #79
xnx wrote: post #4

You can run it for free here: https://huggingface.co/spaces/ResembleAI/Chatterbox

Sadly they don't publish any training or fine tuning code, so this isn't "open" in the way that Flux or Stable Diffusion are "open". If you want better "open" models, these all sound better for zero shot: Zeroshot TTS: MaskGCT, MegaTTS3 Zeroshot VC: Seed-VC, MegaTTS3 Granted, only Seed-VC has training/fine tuning code, but all of these models sound better than Chatterbox. So if you're going to deal with something you…

But whats the inference speed like on these? Can you use them in a realtime interaction with an agent?

Re: Chatterbox TTS

#175

Post by genewitch »

throwawaymaths wrote: post #91
philipkiely wrote: post #75

Earlier quoted context omitted.

WhisperX! https://github.com/basetenlabs/truss-examples/tree/main/whis...

yeah as i said, i couldn't figure out how to deploy whisper-diarization.

so you need python - a full install, and git. Doesn't matter OS. python venv (virtual environment) ensures that this folder, once it works, is locked to all the versions inside it, including the python version. this works for any software that uses pip to set up, or any python stuff in general.

  git clone 
  cd whisper-diarization
  python -m venv .
  cd scripts
  # and then depending on your OS it's activate.sh, activate.ps1, activate.bat, etc. so on linux [0]
your prompt should change to say

(whisper-diarization) $

now you can type

  cd ..
  pip install -c constraints.txt -r requirements.txt
  python ./diarize.py --no-stem --suppress_numerals --whisper-model large-v3-turbo --device cuda -a
next time you want to use it, you can just do like

  cd ~/whisper-diarization
  scripts/activate.sh (or whatever) [0]
  python ./diarize.py [...]
[0] To activate a Python virtual environment created with venv, use the command

  source venv/bin/activate
on Linux or macOS, or

  venv\Scripts\activate
on Windows. This will change your terminal prompt to indicate that the virtual environment is active.

(the [0] note was 'AI generated' by DDG, but whatever, linux puts it in ./bin/activate and windows puts it in ./Scripts/activate.ps1 (ideally))

Re: Chatterbox TTS

#176

Post by kevin_thibedeau »

thorum wrote: post #66
01HNNWZ0MV43FF wrote: post #53

Earlier quoted context omitted.

I was going to report how it runs on an old CPU but after fussing with it for about 30 minutes, I can't even get it to run. Listing the issues in case it helps anyone: - It doesn't work with Python 3.13, luckily `uv` makes it easy to build a venv with 3.12 - It said numpy 1.26.4 doesn't exist. It definitely does, but `uv pip` was searching for it on the pytorch repo. I passed an `--index-strategy` flag so it would ch…

We’ll know AGI has arrived when it can figure out Python dependency conflicts

It'll just throw up its virtual hands and switch to something better after transpiling all the Python code in a fit.

Re: Chatterbox TTS

#177

Post by pmarreck »

fastball wrote: post #101
echelon wrote: post #76

Earlier quoted context omitted.

Nevermind, this is just ~3/10 open, or not really open at all [1]: https://github.com/resemble-ai/chatterbox/issues/45#issuecom... > For now, that means we’re not releasing the training code, and fine-tuning will be something we support through our paid API ( https://app.resemble.ai ). This helps us pay the bills and keep pushing out models that (hopefully) benefit everyone. Big bummer here, Resemble. This is not at…

The weights are indeed open (both accessible and licensing-wise): you don't need to put that in square quotes. Training code is not. You can fine-tune the weights yourself with your own training code. Saying that isn't open is like saying ffmpeg isn't open because it doesn't do everything I need it to do and I have to wrap it with own code to achieve my goals.

FYI, the term is scare quotes (because they imply suspicion), not square quotes

Re: Chatterbox TTS

#179

Post by SV_BubbleTime »

Fun stuff... I don't know how or why, but connecting bluetooth while on this site, made all of the audio clips play at once (Firefox, Linux). Not the best listening experience.

Re: Chatterbox TTS

#180

Post by lukeinator42 »

Does anyone know of an open-source TTS like this that can also encode speech to do voice conversion alongside TTS? i.e. a model that would take speech as input and convert it to one of the pretrained TTS voices.
Post reply on HN