Projects like this really open the doors to coin sized devices which can record months of audio from a tiny battery. You can imagine employers who might want a record of everything said on their premises for example.
Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
31–37 of 37 posts
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#32this is exciting! it's still at prototype stage: 'getting about 90% accuracy [distinguishing between the spoken digits 'zero' to 'nine',] with the code as it stands.' i wonder if modern continuous optimization algorithms could yield a neural network that would do better than this mfcc approach at, perhaps, even lower computational cost they seem to have gotten more expensive lately, though (11.83¢ in quantity 500), a…
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#33What's the minimum spec chip you will need to run the smallest whisper model (looks like that's 39M parameters)?
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#34It's really cool how people are taking these tiny cheap MCUs and making them do fun things for hobbyists. There's nothing better than a project with zero real-world use-case but that's done just because it was a challenge. Eg: Making the CH32V003 programmable via USB: https://www.youtube.com/watch?v=j-QazXghkLY CH32V003 "Super-Cluster": https://www.youtube.com/watch?v=lh93FayWHqw Powering a Nixie Tube from USB with a…
The software portion of this has a common real-world use case: keyword spotting (voice command) in interactive phone calls.
Maybe it could have an IRL use for efficient wake word spotting or the like though.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#35Earlier quoted context omitted.
The software portion of this has a common real-world use case: keyword spotting (voice command) in interactive phone calls.
The general concept has a real world use, but this specific implementation probably doesn't perform as well as most of the already available ones on more powerful hardware. Maybe it could have an IRL use for efficient wake word spotting or the like though.
Though tbf much more powerful arm processors are indeed still very low power.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#36this is exciting! it's still at prototype stage: 'getting about 90% accuracy [distinguishing between the spoken digits 'zero' to 'nine',] with the code as it stands.' i wonder if modern continuous optimization algorithms could yield a neural network that would do better than this mfcc approach at, perhaps, even lower computational cost they seem to have gotten more expensive lately, though (11.83¢ in quantity 500), a…
They also don't list any HBM memory of gddr7 which is frustrating as I'm trying to use kicad to design a cheaper PCI card.....but finding any decent documentation on those chips is impossible at the time.
Re: Simple Speech-to-Text on the '10 Cents' CH32V003 Microcontroller
#37Earlier quoted context omitted.
If you search a part number in Google and the only datasheet result is from an unpronounceable Chinese website, there's a very good chance it's not going to be on digikey. LCSC or AliExpress will be your only options. Even when designing boards, you have to consider whether you want to pick parts from the LCSC library or Digikey because they don't carry all the same parts and even parts that you would think are jelly…
if you think chinese websites are 'unpronounceable' you probably shouldn't try to design hardware