Live data from Hacker News

Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

huggingface.co

31–40 of 56 posts

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#31
post #23
post #18

Sounds horribly in chrome with an amd gpu, why is that?

Are you somehow implying that everyone in the AI arms race believes that only CUDA exists?! /s But, in a more serious tone: the story that I hear about AMD GPUs is that they are, in fact, shittier because AMD themselves give fewer shits. GIGO

What is this comment saying? You think the results are different just because of AMD hardware? If there is a difference it would be a software bug.

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#32
post #2

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!

This is brilliant. All we need now is for someone to code a frontend for it so we can input an article's URL and have this voice read it out loud... built-in local voices on MacOS are not even close to this Kokoro model

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#33
This is great but far from real-time.

(I get the joke that for some definition of real-time this is real-time).

The reason why I use an API is because time to first byte is the most important metric in the apps I'm working on.

That aside, kudos for the great work and I'm sure one day the latency on this will be super low as well.

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#34
post #2

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!

This is brilliant. All we need now is for someone to code a frontend for it so we can input an article's URL and have this voice read it out loud... built-in local voices on MacOS are not even close to this Kokoro model

There are a few already, I assume MacWhisper will add it. That being said, I am also working on a (crossplatform, in Flutter) UI for this.

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#36
post #23

Earlier quoted context omitted.

Are you somehow implying that everyone in the AI arms race believes that only CUDA exists?! /s But, in a more serious tone: the story that I hear about AMD GPUs is that they are, in fact, shittier because AMD themselves give fewer shits. GIGO

What is this comment saying? You think the results are different just because of AMD hardware? If there is a difference it would be a software bug.

Everyone in the space only caring about (and therefore testing on) Nvidia/CUDA as suggested in GP is exactly why a software bug that seriously impacts results but only effects AMD GPUs would get through into released software very easily.

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#37

Earlier quoted context omitted.

What is this comment saying? You think the results are different just because of AMD hardware? If there is a difference it would be a software bug.

Everyone in the space only caring about (and therefore testing on) Nvidia/CUDA as suggested in GP is exactly why a software bug that seriously impacts results but only effects AMD GPUs would get through into released software very easily.

That would be a webgpu bug or an AMD bug, not a bug in this software.

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#39
Fantastic work. My dream would be to use this for a browser audiobook generator for epubs. I made a cli audiobook generator with Piper [0] that got some traction and I wanted to port it to the browser, but there were too many issues. [1]

Is there source anywhere? Seems the assets/ folder is bundled js. In my opinion, there's a ton of opportunity for private, progressive web apps with this while WebGPU is still relatively newly implemented.

Would love to collaborate in some way if others are also interested in this

[0] https://github.com/C-Loftus/QuickPiperAudiobook/ [1] https://github.com/rhasspy/piper/issues/352

Post reply on HN