Live data from Hacker News

Pocket TTS: A high quality TTS that gives your CPU a voice

kyutai.org

141–150 of 164 posts

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#141

Question: does anyone recommend a TTS that automatically recognizes emotion from the text it self?

Gradium (https://gradium.ai/), a commercial company offshoot of Kyutai (open source lab), are focusing on emotion (both being able to recognise emotion and also understanding what emotion to use depending on context). I don't think any of their public existing models already does that, but they demoed it pretty impressively at the ai-Pulse conference.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#142

Is there any TTS engine that doesn't need cloning and has some sort of parameters one can specify? Like what if I want to graft on TTS to an existing text chat system and give each person an unique, randomly generated voice? Or want to try to get something that's not quite human, like some sort of alien or monster?

You can use voice prompting; it's supported on ElevenLabs and Hume.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#144

Is there any TTS engine that doesn't need cloning and has some sort of parameters one can specify? Like what if I want to graft on TTS to an existing text chat system and give each person an unique, randomly generated voice? Or want to try to get something that's not quite human, like some sort of alien or monster?

You could use an old-school formant synthesizer that lets you tune the parameters, like espeak or dectalk. espeak apparently has a klatt mode which might sound better than the default but i haven't tried it.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#145
post #31

Eep. So, on my M1 mac, did `uvx pocket-tts serve`. Plugged in > It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was the season of Light, it was the season of Darkness, it was the spring of hope, it was the winter of despair, we had everything before us, we had nothing before us, we were all go…

Václav from Kyutai here. Thanks for the bug report! A workaround for now is to chunk the text into smaller parts where the model is more reliable. We already do some chunking in the Python package. There is also a more fancy way to do this chunking in a way that ensures that the stitched-together parts continue well (teacher-forcing), but we haven't implemented that yet.

Is this just sort of expected for these models? Should users of this expect only truncation or can hallucinated bits happen too?

I also find Javert in particular seems to put in huge gaps and spaces... side effect of the voice?

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#146
post #111

Earlier quoted context omitted.

> The good voice seems to be hidden somehow. How am I supposed to enable this?

My mistake, seems like I was refering to the Siri voice, which seems to be the default. It sounds good. It is selectable and to my surprise - even configurable in speed, pitch and volume - in the OS Accessibility settings -> System Voice -> Click on the (i) symbol. (macOS Tahoe)

Or via $ say --voice "?"

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#147
post #87

The speed of improvement of tts models reminds me of early days of Stable Diffusion. Can't wait until I can generate audiobooks without infinite pain. If I was an investor I'd short Audible.

An all-TTS audiobook offering is just about as appealing as an all-stable-diffusion picture gallery (that is, not at all).

There already are audiobooks on audible that are 100% TTS, while it's playable, it's no substitute (yet) for a real human.

It's just too flat/dead compared to a human reader.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#149

Love this. It says MIT license but then readme has a separate section on prohibited use that maybe adds restrictions to make it nonfree? Not sure the legal implications here.

Tried to use voice cloning but in order to download the model weights I have to create a HuggingFace account, connect it on the command line, give them my contact information, and agree to their conditions. The open source part is just the client and chunking logic which is pretty minimal.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#150

Perhaps I have been not talking to voice models that much or the chatgpt voice always felt weird and off because I was thinking it goes to a cloud server and everything but from Pocket TTS I discovered unmute.sh which is open source and I think is from the same company as Pocket TTS/can I think use Pocket TTS as well I saw some agentic models at 4B or similar which can punch above its weights or even some basic model…

Great find! unmute was a trip to play with
Post reply on HN