Live data from Hacker News

Pocket TTS: A high quality TTS that gives your CPU a voice

kyutai.org

31–40 of 164 posts

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#31
Eep.

So, on my M1 mac, did `uvx pocket-tts serve`. Plugged in

> It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was the season of Light, it was the season of Darkness, it was the spring of hope, it was the winter of despair, we had everything before us, we had nothing before us, we were all going direct to Heaven, we were all going direct the other way—in short, the period was so far like the present period, that some of its noisiest authorities insisted on its being received, for good or for evil, in the superlative degree of comparison only

(Beginning of Tale of Two Cities)

but the problem is Javert skips over parts of sentences! Eg, it starts:

> "It was the best of times, it was the worst of times, it was the age of wisdom, it was the epoch of belief, it was the epoch of incredulity, it was the season of Light, it was the spring of hope, it was the winter of despair, we had everything before us, ..."

Notice how it skips over "it was the age of foolishness,", "it was the winter of despair,"

Which... Doesn't exactly inspire faith in a TTS system.

(Marius seems better; posted https://github.com/kyutai-labs/pocket-tts/issues/38)

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#32
post #24
post #17

Earlier quoted context omitted.

Kokoro is better for tts by far For voice cloning, pocket tts is walled so I can't tell

What are the advantages of PocketTTS over Kokoro? It seems like Kokoro is the smaller model, also runs on CPU in real time, and is more open and fine tunable. More scripts and extensions, etc., whereas this is new and doesn't have any fine tuning code yet. I couldn't tell an audio quality difference.

Being able to voice clone with PocketTTS seems major, it doesn't look like there's any support for that with Kokoro.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#33
post #11

Good quality but unfortunately it is single language English only.

I echo this. For a TTS system to be in any way useful outside the tiny population of the world that speaks exclusively English, it must be multilingual and dynamically switch between languages pretty much per word. Cool tech demo though!

I'm Martian so everything you create better support my language on day 1

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#34
post #17
post #4

Oh this is sweet, thanks for sharing! I've been a huge fan of Kokoro and event setup my own fully-local voice assistant [1]. Will definitely give Pocket TTS a go! [1] https://github.com/acatovic/ova

Kokoro is better for tts by far For voice cloning, pocket tts is walled so I can't tell

Chatterbox-turbo is really good too. Has a version that uses Apple's gpu.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#35

Love this. It says MIT license but then readme has a separate section on prohibited use that maybe adds restrictions to make it nonfree? Not sure the legal implications here.

Good question. If a license says "you may use this, you are prohibited from using this", and I use it, did I break the license?

If memory serves, the license is the ultimate source of truth on what is allowed or not. You cannot add some section that isn't in the text of the license (at least in the US and other countries that use similar legal systems) on some website and expect it to hold up in court because the license doesn't include that text. I know of a few other bigger-name projects that try to pull these kinds of stunts because they don't believe anyone is going to actually read the text of the license.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#37

Earlier quoted context omitted.

I echo this. For a TTS system to be in any way useful outside the tiny population of the world that speaks exclusively English, it must be multilingual and dynamically switch between languages pretty much per word. Cool tech demo though!

That's a pretty crazy requirement for something to be "useful" especially something that runs so efficiently on cpu. Many content creators from non-english speaking countries can benefit from this type of release by translating transcripts of their content to english and then running it through a model like this to dub their videos in a language that can reach many more people.

Uh, no? This is not at all an absurd requirement? Screen readers literally do this all the time, with voices that are the classic way of making a speech synthesizer, no AI required. ESpeak is an example, or MS OneCore. The NVDA screen reader has an option for automatic language switching as does pretty much every other modern screen reader in existence. And absolutely none of these use AI models to do that switching, either.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#38
post #24

Earlier quoted context omitted.

What are the advantages of PocketTTS over Kokoro? It seems like Kokoro is the smaller model, also runs on CPU in real time, and is more open and fine tunable. More scripts and extensions, etc., whereas this is new and doesn't have any fine tuning code yet. I couldn't tell an audio quality difference.

Being able to voice clone with PocketTTS seems major, it doesn't look like there's any support for that with Kokoro.

Zero shot voice clones have never been very good. Fine tuned models hit natural speaker similarity and prosody in a way zero shot models can't emulate.

If it were a big model and was trained on a diverse set of speakers and could remember how to replicate them all, then zero shot is a potentially bigger deal. But this is a tiny model.

I'll try out the zero shot functionality of Pocket TTS and report back.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#39
Perhaps I have been not talking to voice models that much or the chatgpt voice always felt weird and off because I was thinking it goes to a cloud server and everything but from Pocket TTS I discovered unmute.sh which is open source and I think is from the same company as Pocket TTS/can I think use Pocket TTS as well

I saw some agentic models at 4B or similar which can punch above its weights or even some basic models. I can definitely see them in the context of home lab without costing too much money.

I think atleast unmute.sh is similar/competed with chatgpt's voice model. It's crazy how good and (effective) open source models are from top to bottom. There's basically just about anything for almost everyone.

I feel like the only true moat might exist in coding models. Some are pretty good but its the only industry where people might pay 10x-20x more for the best (minimax/z.ai subscription fees vs claude code)

It will be interesting to see if we will see another deepseek moment in AI which might beat claude sonnet or similar. I think Deepseek has deepseek 4 so it will be interesting to see how/if it can beat sonnet

(Sorry for going offtopic)

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#40
post #11

Good quality but unfortunately it is single language English only.

I echo this. For a TTS system to be in any way useful outside the tiny population of the world that speaks exclusively English, it must be multilingual and dynamically switch between languages pretty much per word. Cool tech demo though!

This is a great illustration that nothing you ever do will be good enough without people whining.
Post reply on HN