Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
1–10 of 37 posts
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#2this is exciting! it's still at prototype stage: 'getting about 90% accuracy [distinguishing between the spoken digits 'zero' to 'nine',] with the code as it stands.'
i wonder if modern continuous optimization algorithms could yield a neural network that would do better than this mfcc approach at, perhaps, even lower computational cost
they seem to have gotten more expensive lately, though (11.83¢ in quantity 500), and lcsc is out of stock on the ch32v003. they only have in stock ch32v203 and up, which costs 37.5¢. https://www.lcsc.com/products/Microcontroller-Units-MCUs-MPU...
digi-key, as usual, doesn't list the part at all
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#3Is there a recorded demo? Reading about speech-to-text is different from hearing it.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#4this is exciting! it's still at prototype stage: 'getting about 90% accuracy [distinguishing between the spoken digits 'zero' to 'nine',] with the code as it stands.' i wonder if modern continuous optimization algorithms could yield a neural network that would do better than this mfcc approach at, perhaps, even lower computational cost they seem to have gotten more expensive lately, though (11.83¢ in quantity 500), a…
Replacing the codebook approach with a statistical/DNN is more likely to give higher accuracy than getting rid of mfccs as spectral representation (at least in general ASR). (Arguably, using Mel spectra was the least controversial design choice made for Whisper.)
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#5It's really cool how people are taking these tiny cheap MCUs and making them do fun things for hobbyists. There's nothing better than a project with zero real-world use-case but that's done just because it was a challenge.
Eg:
Making the CH32V003 programmable via USB: https://www.youtube.com/watch?v=j-QazXghkLY
CH32V003 "Super-Cluster": https://www.youtube.com/watch?v=lh93FayWHqw
Powering a Nixie Tube from USB with a CH32V003: https://www.youtube.com/watch?v=-4d3PgEXhdY
(A good rule in life in general is to just always watch CNLohr and Bitluni if you're into "useless but amazing hardware projects")
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#6Is there a recorded demo? Reading about speech-to-text is different from hearing it.
Speech to text, not text to speech. There's nothing to hear but your own voice.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#7About 10 years ago, I used a basic flip phone, vendor locked to a $15/month Verizon plan.
The Wal Mart page for a similar device is still up at
https://www.walmart.com/ip/Verizon-Wireless-Samsung-Gusto-3-...
Among other things, it had limited speech recognition -- you could say "Call" followed by a name, and it would match that against the address book on device.
We live in strange times.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#8Is there a recorded demo? Reading about speech-to-text is different from hearing it.
Speech to text, not text to speech. There's nothing to hear but your own voice.
Well, considering everything outside/before whisper would be less than a 40% accurate on my voice (don’t know the reason and now whisper is close to 100% even with tech stuff/abbreviations). Things like Siri, Google, Alexa, Dragon etc all never understand (I stopped trying, so it might have improved, but I did try not long ago) anything I say. When I ask for the weather, something like Siri looks on Google what the border is etc. I am not native english, however I am fluent (work in English fulltime) and humans never have any issues; also, in my own language, none of them work either, except whisper, even locally running (which, like said, might’ve improved recently).
So it would be interesting to hear how articulated you would need to speak and have different people with accents and such.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#9Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#10About 10 years ago, I used a basic flip phone, vendor locked to a $15/month Verizon plan. The Wal Mart page for a similar device is still up at https://www.walmart.com/ip/Verizon-Wireless-Samsung-Gusto-3-... Among other things, it had limited speech recognition -- you could say "Call" followed by a name, and it would match that against the address book on device. We live in strange times.
Yeah, even 24 year-old Nokia 3310 had some form of voice dialling [1].
OS/2 Warp 4.0 (1996) came with speech recognition and dictation software [2]. The CPUs it supported back then weren't much better than a 10-year old phone.
[1] https://en.wikipedia.org/wiki/Nokia_3310
[2] https://www.os2world.com/wiki/index.php?title=OS/2_Warp_4:_%...