Live data from Hacker News

Pocket TTS: A high quality TTS that gives your CPU a voice

kyutai.org

71–80 of 164 posts

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#72
post #18

>If you want access to the model with voice cloning, go to https://huggingface.co/kyutai/pocket-tts and accept the terms, then make sure you're logged in locally with `uvx hf auth login` lol

I’ve tried the voice clinking and it works great. I added a 9s clip and it captured the speaker pretty well.

But don’t do the fake mistake I did and use a hf token that doesn’t have access to read from repos! The error message said that I had to request access to the repo, but I’ve had already done that, so I couldn’t figure out what was wrong. Turns out my HF token only had access to inference.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#74
post #31

Eep. So, on my M1 mac, did `uvx pocket-tts serve`. Plugged in > It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was the season of Light, it was the season of Darkness, it was the spring of hope, it was the winter of despair, we had everything before us, we had nothing before us, we were all go…

interesting; it skipped "we had everything before us," in my test. Yeah, not a good sign.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#75

Nice! Just made it an MCP server so claude can tell me when it's done with something :) https://github.com/Marviel/speak_when_done

macOS already has some great intrinsic TTS capability as the OS seems to include a naturally sounding voice. I recently built a similar tool to just run the "say" command as a background process. Had to wrap it in a Deno server. It works, but with Tahoe it's difficult to consistently configure using that one natural voice, and not the subpar voices downloadable in the settings. The good voice seems to be hidden somehow.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#76

Earlier quoted context omitted.

That's a pretty crazy requirement for something to be "useful" especially something that runs so efficiently on cpu. Many content creators from non-english speaking countries can benefit from this type of release by translating transcripts of their content to english and then running it through a model like this to dub their videos in a language that can reach many more people.

You mean youtubers? And have to (manually) synchronise the text to their video, and especially when youtube apparently offers voice-voice translation out of the box to my and many others' annoyance?

YouTube's voice to voice is absolutely horrible though. Having the ability for the youtubers to clone their own voice would make it much, much more appealing.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#78

I'm psyched to see so much interest in my post about Kyutai's latest model! I'm working on part of a related team in Paris that's building off Kutai's research to provide enterprise-grade voice solutions. If anyone building in this space I'd love to chat and share some our upcoming models and capabilities that I am told are SOTA. Please don't hesitate to ping me via the address in my profile.

Just want to say amazing work. It's really pushing the envelope of what is possible to run locally on everyday devices.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#79

Love this. It says MIT license but then readme has a separate section on prohibited use that maybe adds restrictions to make it nonfree? Not sure the legal implications here.

From my understanding, the code is MIT, but the model isn't? What consitutes a "Software" anyway? Aren't resources like images, sounds and the likes exempt from it (hence, covered by usual copyright unless separately licensed)? If so, in the same vein, an ML model is not part of "Software". By the way, the same prohibition is repeated on the huggingface model card.

Re: Pocket TTS: A high quality TTS that gives your CPU a voice

#80
post #62

Earlier quoted context omitted.

> it must be multilingual and dynamically switch between languages pretty much per word Not abundantly obviously a satire and so interjecting: humans, including professional "simultaneous" interpreters, can't do this. This is not how languages work.

You can speak one language, switch to another language for one word, and continue speaking in the previous language.

But that's my point. You'll stop, switch, speak, stop, switch, resume. You're not going to be "I was in 東京 yesterday" as a single continuous sentence. It'll have to be broken up to three separate sentences spoken back to back, even for humans.
Post reply on HN