Sounds horribly in chrome with an amd gpu, why is that?
Are you somehow implying that everyone in the AI arms race believes that only CUDA exists?! /s But, in a more serious tone: the story that I hear about AMD GPUs is that they are, in fact, shittier because AMD themselves give fewer shits. GIGO
Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
31–40 of 56 posts
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#32It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#33(I get the joke that for some definition of real-time this is real-time).
The reason why I use an API is because time to first byte is the most important metric in the apps I'm working on.
That aside, kudos for the great work and I'm sure one day the latency on this will be super low as well.
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#34It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!
This is brilliant. All we need now is for someone to code a frontend for it so we can input an article's URL and have this voice read it out loud... built-in local voices on MacOS are not even close to this Kokoro model
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#35Sounds great on Chrome with an Nvidia 1650Ti.
Sounds great on Chrome on a Pixel 6.
Sound like being bitcrushed. Maybe a 64 vs 32 bit error? Solid results when working.
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#36Earlier quoted context omitted.
Are you somehow implying that everyone in the AI arms race believes that only CUDA exists?! /s But, in a more serious tone: the story that I hear about AMD GPUs is that they are, in fact, shittier because AMD themselves give fewer shits. GIGO
What is this comment saying? You think the results are different just because of AMD hardware? If there is a difference it would be a software bug.
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#37Earlier quoted context omitted.
What is this comment saying? You think the results are different just because of AMD hardware? If there is a difference it would be a software bug.
Everyone in the space only caring about (and therefore testing on) Nvidia/CUDA as suggested in GP is exactly why a software bug that seriously impacts results but only effects AMD GPUs would get through into released software very easily.
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#38Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#39Is there source anywhere? Seems the assets/ folder is bundled js. In my opinion, there's a ton of opportunity for private, progressive web apps with this while WebGPU is still relatively newly implemented.
Would love to collaborate in some way if others are also interested in this
[0] https://github.com/C-Loftus/QuickPiperAudiobook/ [1] https://github.com/rhasspy/piper/issues/352
Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser
#40https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_...