[deleted]
Speech Recognition and TTS in less than 500kb
21–30 of 101 posts
Re: Speech Recognition and TTS in less than 500kb
#22Do you have any accuracy benchmarks? I’ve worked in this space. TTS in a small footprint isn’t the hard part —- it’s doing it accurately that’s hard. Although for the use cases OP is targeting, lower accuracy may be good enough!
> I’ve worked in this space. TTS in a small footprint isn’t the hard part —- it’s doing it accurately that’s hard. This actually holds for everything in AI.
Very true!
Re: Speech Recognition and TTS in less than 500kb
#23this is good to see. i also trained a stt under 500kb for sub dollar chips. it had about 20 words that it could understand(like start, stop, left, right, go, up etc) and then the spell mode where you could say the word spell and then say the individual english alphabets and close with spell. it was super fun to work on. these tend to be extremely unstable though, like confusion between p and t (at least for my accent…
I remember someone training smart kettle to use its speaker as microphone
Re: Speech Recognition and TTS in less than 500kb
#24This looks like an extreme point for AI-based TTS, as formant/tract modeling synths tend to be more accurate if you want TTS in a tiny amount of compute, but sound distinctly robotic.
TTS (neural diphone synth @ 16 kHz) ~1.8 MiB voice pack
This is in the realm of Microsoft Sam.
Re: Speech Recognition and TTS in less than 500kb
#25The voice activity detection alone here is compelling - very useful for doing things like highlighting a speaker who's transmitting in realtime. At that rate the impact on perf will be so minimal that you could easily run it in the browser across devices.
Re: Speech Recognition and TTS in less than 500kb
#26very nice I love it
Re: Speech Recognition and TTS in less than 500kb
#27Is the dataset open
Re: Speech Recognition and TTS in less than 500kb
#28this is good to see. i also trained a stt under 500kb for sub dollar chips. it had about 20 words that it could understand(like start, stop, left, right, go, up etc) and then the spell mode where you could say the word spell and then say the individual english alphabets and close with spell. it was super fun to work on. these tend to be extremely unstable though, like confusion between p and t (at least for my accent…
IIRC the Alexa enabled voice remotes also used a similarly small model though perhaps not this small
Re: Speech Recognition and TTS in less than 500kb
#29So at that tiny 500kb size I imagine it could be compiled to web assembly, and run entirely in the browser right?
Couldn’t find a link, is that hard to do?
Re: Speech Recognition and TTS in less than 500kb
#30This looks like an extreme point for AI-based TTS, as formant/tract modeling synths tend to be more accurate if you want TTS in a tiny amount of compute, but sound distinctly robotic. TTS (neural diphone synth @ 16 kHz) ~1.8 MiB voice pack This is in the realm of Microsoft Sam.
[deleted]