90% accuracy on 10 digits is pretty disappointing but cool project.
On a $0.10 (10 cents) chip with 16K storage and 2K (2048 bytes) RAM? That runs at a maximum of 48 MHz?
Dunno boss, for a PoC seems pretty impressive to me.
Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
21–30 of 37 posts
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#22this is exciting! it's still at prototype stage: 'getting about 90% accuracy [distinguishing between the spoken digits 'zero' to 'nine',] with the code as it stands.' i wonder if modern continuous optimization algorithms could yield a neural network that would do better than this mfcc approach at, perhaps, even lower computational cost they seem to have gotten more expensive lately, though (11.83¢ in quantity 500), a…
If you search a part number in Google and the only datasheet result is from an unpronounceable Chinese website, there's a very good chance it's not going to be on digikey. LCSC or AliExpress will be your only options. Even when designing boards, you have to consider whether you want to pick parts from the LCSC library or Digikey because they don't carry all the same parts and even parts that you would think are jellybean don't have the exact same package on both sites (especially SOT packages, similarly sized but not the exact same).
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#23About 10 years ago, I used a basic flip phone, vendor locked to a $15/month Verizon plan. The Wal Mart page for a similar device is still up at https://www.walmart.com/ip/Verizon-Wireless-Samsung-Gusto-3-... Among other things, it had limited speech recognition -- you could say "Call" followed by a name, and it would match that against the address book on device. We live in strange times.
My 2006 Infiniti had voice commands for calling people in your address book. Road noise trashed the microphone quality so it only really worked well when you were at a stop.
Handsfree mics in cars still suck and Bluetooth handsfree audio quality sucks too, not sure why this is still a problem. I get backwards compatibility issues but is good compression that difficult in newer devices?
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#24I wonder how this performs compared to the "voice recognition"
VCP200 chip sold by Radio Shack in the eighties (maybe early nineties?).
https://21stdigitalhome.blogspot.com/2013/06/vcp200-voice-re...
Also be interesting to know if that Voice Control Products ever had a real design win.
I gather the VCP200 was a mask-programmed M6804 microcontroller. The M6804 was a strange and obscure beast, apparently a cost-reduced, internally serial ("1-bit"), partial reimplementation of the M6805, which was one of the first Motorola 8-bit microcontrollers based on the 6800. Max bus speed of 2.75MHz, with an instruction cycle time of 44 microseconds. 32 bytes of RAM and 1K mask-programmed ROM. No ADC. http://www.bitsavers.org/components/motorola/6804/M6804_MCU_...
One should be able to do better with about any modern microcontroller. Then again, for all I know the VCP200 was not fit to even the modest tasks (looks like toy/novelty/hobbyist) it was marketed for back then.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#2590% accuracy on 10 digits is pretty disappointing but cool project.
On a $0.10 (10 cents) chip with 16K storage and 2K (2048 bytes) RAM? That runs at a maximum of 48 MHz? Dunno boss, for a PoC seems pretty impressive to me.
Very cool for a PoC. I suspect a dense neural net approach would give much better results though.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#26If you uploaded some training data somewhere, perhaps to some links to simulators, you might get a crowd of people code-golfing this to maximize accuracy.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#27Projects like this really open the doors to coin sized devices which can record months of audio from a tiny battery.
You can imagine employers who might want a record of everything said on their premises for example.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#28What's the minimum spec chip you will need to run the smallest whisper model (looks like that's 39M parameters)?
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#29this is exciting! it's still at prototype stage: 'getting about 90% accuracy [distinguishing between the spoken digits 'zero' to 'nine',] with the code as it stands.' i wonder if modern continuous optimization algorithms could yield a neural network that would do better than this mfcc approach at, perhaps, even lower computational cost they seem to have gotten more expensive lately, though (11.83¢ in quantity 500), a…
If you search a part number in Google and the only datasheet result is from an unpronounceable Chinese website, there's a very good chance it's not going to be on digikey. LCSC or AliExpress will be your only options. Even when designing boards, you have to consider whether you want to pick parts from the LCSC library or Digikey because they don't carry all the same parts and even parts that you would think are jelly…
if you think chinese websites are 'unpronounceable' you probably shouldn't try to design hardware
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#30What's the minimum spec chip you will need to run the smallest whisper model (looks like that's 39M parameters)?
That's what I though seeing this. Wisper does English best but is the best iv seen when it comes to other languages.