Live data from Hacker News

Show HN: Local voice assistant using Ollama, transformers and Coqui TTS toolkit

github.com

1–10 of 30 posts

Re: Show HN: Local voice assistant using Ollama, transformers and Coqui TTS toolkit

#5
post #4

Looks interesting! Is the latency low enough for it to feel natural? How's the Coqui speech quality?

It supports XTTSv2 which is currently the open-weight state of the art. So, pretty damn good (https://huggingface.co/coqui/XTTS-v2/blob/main/samples/en_sa...).

Too bad that the project is in limbo after Coqui (the company) folded. The license limits the use of the weights to non-commercial usage unless you buy a commercial license, and there's nobody left to sell you one now.

Re: Show HN: Local voice assistant using Ollama, transformers and Coqui TTS toolkit

#6
post #5
post #4

Looks interesting! Is the latency low enough for it to feel natural? How's the Coqui speech quality?

It supports XTTSv2 which is currently the open-weight state of the art. So, pretty damn good ( https://huggingface.co/coqui/XTTS-v2/blob/main/samples/en_sa... ). Too bad that the project is in limbo after Coqui (the company) folded. The license limits the use of the weights to non-commercial usage unless you buy a commercial license, and there's nobody left to sell you one now.

is there anyone to sue you? (how does that work?)

Re: Show HN: Local voice assistant using Ollama, transformers and Coqui TTS toolkit

#8
post #4

Looks interesting! Is the latency low enough for it to feel natural? How's the Coqui speech quality?

When I gave "Matt", my loyal local assistant[1], a voice xTTSv2 performed better for long form text. While in longform emotions seemed well balanced in the text, in short replies the emotion patterns frequently felt off and therefore unnatural. What I liked about xTTsv2 though is that voice cloning is fairly easy by just providing a .wav file with the intended voice pattern.

[1]https://open.substack.com/pub/jdsemrau/p/teaching-your-agent...

Re: Show HN: Local voice assistant using Ollama, transformers and Coqui TTS toolkit

#9
we have made an open source orchestration which enables you to plug in your own TTS/ASR/LLM for end-to-end voice conversations at -> https://github.com/bolna-ai/bolna.

We are also working on a complete open source stack for ASR+TTS+LLM and will be releasing it shortly.

Re: Show HN: Local voice assistant using Ollama, transformers and Coqui TTS toolkit

#10
Honestly, there are so many Project on Github doing STT - LLM - TTS that I lost count. The only revolutionary thing that feels like magic is if the STT supports Voice Activity Detection and low latency LLM inference on Groq, so conversations feel natural.
Post reply on HN