Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser • Hacker News Board

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#11

Post by Guillaume86 » Fri, Feb 07, 2025, 5:05 PM UTC

fallinditch wrote: post #8

Brave browser and Samsung Galaxy S22 ultra - gives horrible screeching noises

Same with chrome on Zenfone 8

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#12

Post by Ono-Sendai » Fri, Feb 07, 2025, 5:25 PM UTC

deivid wrote: post #10

xenova wrote: post #2

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!

Amazing! I'm interested in models running locally and Kokoro seems amazing. Are you aware of similar models but for Speech to text?

whisper

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#13

Post by [deleted] » Fri, Feb 07, 2025, 5:27 PM UTC

[deleted]

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#14

Post by shaneofalltrad » Fri, Feb 07, 2025, 5:28 PM UTC

fallinditch wrote: post #8

Brave browser and Samsung Galaxy S22 ultra - gives horrible screeching noises

same in MacOS intel Chrome browser.

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#15

Post by xenova » Fri, Feb 07, 2025, 5:31 PM UTC

deivid wrote: post #10

xenova wrote: post #2

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!

Amazing! I'm interested in models running locally and Kokoro seems amazing. Are you aware of similar models but for Speech to text?

We have released a bunch of speech recognition demos (using whisper, moonshine, and others). For example:

- https://huggingface.co/spaces/Xenova/whisper-web

- https://huggingface.co/spaces/Xenova/whisper-webgpu

- https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu

- https://huggingface.co/spaces/webml-community/moonshine-web

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#16

Post by magicalhippo » Fri, Feb 07, 2025, 5:43 PM UTC

fallinditch wrote: post #8

Brave browser and Samsung Galaxy S22 ultra - gives horrible screeching noises

Firefox on Samsung S21, worked fine albeit slow, around 20-25s for the demo text.

Quality sounded good compared to a lot of other small TTS models I've tried.

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#17

Post by djeastm » Fri, Feb 07, 2025, 5:58 PM UTC

Fyi I tried this on my Galaxy S21 with both Brave and Chrome browsers and just got screeching noises in the audio

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#18

Post by Asmod4n » Fri, Feb 07, 2025, 6:17 PM UTC

Sounds horribly in chrome with an amd gpu, why is that?

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#19

Post by amelius » Fri, Feb 07, 2025, 6:23 PM UTC

xenova wrote: post #2

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!

Now that's what I call "server-less" computing!

Re: Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser

#20

Post by bentt » Fri, Feb 07, 2025, 6:41 PM UTC

Sounded perfect for me. Brave/Win11/3090