31–40 of 101 posts
This looks like an extreme point for AI-based TTS, as formant/tract modeling synths tend to be more accurate if you want TTS in a tiny amount of compute, but sound distinctly robotic. TTS (neural diphone synth @ 16 kHz) ~1.8 MiB voice pack This is in the realm of Microsoft Sam.
So at that tiny 500kb size I imagine it could be compiled to web assembly, and run entirely in the browser right? Couldn’t find a link, is that hard to do?
This looks like an extreme point for AI-based TTS, as formant/tract modeling synths tend to be more accurate if you want TTS in a tiny amount of compute, but sound distinctly robotic. TTS (neural diphone synth @ 16 kHz) ~1.8 MiB voice pack This is in the realm of Microsoft Sam.
The project credits does mention espeak (which is formant based) as well as various other TTS projects, although it sounds like they are only using the pronunciation part of espeak, not the voice synthesis.
Given the tiny size of this, I wonder about possible future integration with esphome compatible hardware https://esphome.io/
Quick link to the video where he demos it: https://www.youtube.com/watch?v=kMliOFYBiz4
this is good to see. i also trained a stt under 500kb for sub dollar chips. it had about 20 words that it could understand(like start, stop, left, right, go, up etc) and then the spell mode where you could say the word spell and then say the individual english alphabets and close with spell. it was super fun to work on. these tend to be extremely unstable though, like confusion between p and t (at least for my accent…
Quick link to the video where he demos it: https://www.youtube.com/watch?v=kMliOFYBiz4