Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Non-cloud voice recognition for home use?

news.ycombinator.com

Post reply on HN
Print view View original

31–40 of 130 posts

Re: Ask HN: Non-cloud voice recognition for home use?

#31

Post by homarp »

perturbation wrote: post #12

If you don't mind getting your hands dirty a bit, I think Nvidia's model [Jasper]( https://arxiv.org/pdf/1904.03288.pdf ) is near SOTA, and they have [pretrained models]( https://ngc.nvidia.com/catalog/models/nvidia:jaspernet10x5dr ) and [tutorials / scripts]( https://nvidia.github.io/NeMo/asr/tutorial.html ) freely available. The first is in their library "nemo", but they also have it available in [vanilla Pytorch](…

and you have a version for the jetson nano: https://github.com/NVIDIA/OpenSeq2Seq/blob/master/example_co...

with install scripts: https://github.com/NVIDIA/OpenSeq2Seq/blob/master/scripts/je...

Re: Ask HN: Non-cloud voice recognition for home use?

#32

Post by rs23296008n1 »

perturbation wrote: post #12

If you don't mind getting your hands dirty a bit, I think Nvidia's model [Jasper]( https://arxiv.org/pdf/1904.03288.pdf ) is near SOTA, and they have [pretrained models]( https://ngc.nvidia.com/catalog/models/nvidia:jaspernet10x5dr ) and [tutorials / scripts]( https://nvidia.github.io/NeMo/asr/tutorial.html ) freely available. The first is in their library "nemo", but they also have it available in [vanilla Pytorch](…

Do you have any experience/opinions on those?

Re: Ask HN: Non-cloud voice recognition for home use?

#34

Post by thomas536 »

rs23296008n1 wrote: post #19
albertzeyer wrote: post #10

Are you searching for a complete solution including NLP and an engine to perform actions? Some of these are already posted, like Home Assistant, and Mycroft. Sphinx is just for the automatic speech recognition (ASR) part. But there are better solutions for that: Kaldi ( https://kaldi-asr.org/ ) is probably the most comprehensive ASR solution, which yields very competitive state-of-the-art results. RASR ( https://www-…

Already got the action engine: all the lights, hvac, tv, calculator, computers, etc are all controllable. None require internet now. Or any kind of location services for that matter. I really just want the speech-to-text. Ideally I'd also like it to recognise who's talking. But that's a bonus.

I'll second the recommendation for Kaldi. It's more complicated to get running vs pocketsphinx, but in my experience Kaldi has better accuracy/lower latency in general cases vs pocketsphinx (assuming caveats below).

https://github.com/gooofy/zamia-speech/ has been training good [acoustic] models which are worth looking at (including training with robustness against noise). They've also got lots of code and docker images and documentation.

pocketsphinx isn't actually that bad to use with their latest acoustic models and small vocabularies (so its utility depends on your exact use case). But it's not generally good with far field mics/dsp processed audio, not really good with noise, and in my experiments quite not as fast as Kaldi.

Better/larger language models in my experience make a world of difference (esp in the general vocab case) for improving accuracy for either of kaldi or pocketsphinx. Nobody really seems to talk about this(?), since everyone always uses the news corpus from like the 80s as the default language model.

I haven't really ever gotten the various ~deepspeech systems working, so I can't speak to them.

Re: Ask HN: Non-cloud voice recognition for home use?

#36

Post by coredog64 »

romwell wrote: post #28

TL; DR: Win 10 IoT for RasPi does it. ----------------- Windows 10 IoT for Raspberry Pi comes with offline speech recognition API. It was not hard to slap some code together that turns on a light when someone says "banana" at a hackathon. Sounds like exactly what you need. >If it helps I'm happy to reduce vocabulary to a dictionary of words You will do it with an XML grammar file for offline recognition[4]. [1] https…

The Microsoft offline speech recognizer is pretty good. I did some work with it many years ago [0]. The only problem we had was with accents: My French co-worker had to use his most obnoxiously over-the-top American accent for reasonable accuracy. ISTR that we could switch to Australian English for the Aussies and Kiwis.

[0] https://github.com/spc-ofp/ObserverLengthSampler

Re: Ask HN: Non-cloud voice recognition for home use?

#38

Post by rs23296008n1 »

thomas536 wrote: post #34
rs23296008n1 wrote: post #19

Earlier quoted context omitted.

Already got the action engine: all the lights, hvac, tv, calculator, computers, etc are all controllable. None require internet now. Or any kind of location services for that matter. I really just want the speech-to-text. Ideally I'd also like it to recognise who's talking. But that's a bonus.

I'll second the recommendation for Kaldi. It's more complicated to get running vs pocketsphinx, but in my experience Kaldi has better accuracy/lower latency in general cases vs pocketsphinx (assuming caveats below). https://github.com/gooofy/zamia-speech/ has been training good [acoustic] models which are worth looking at (including training with robustness against noise). They've also got lots of code and docker ima…

I'm happy to feed it plenty of voice logs as well as a training corpus as necessary. Sounds like an interesting journey.

Re: Ask HN: Non-cloud voice recognition for home use?

#39

Post by Havoc »

>I'm happy if they talk back via wifi to a server in my office for whatever real processing. The server might have 16 cores and 128Gb ram.

Pretty sure Mycroft is capable of that - in theory - you'll need to config it manually. The standard raspberry pi route isn't powerful enough for local.

Check out reespeaker for a raspberry microphone. You'll want one of the more expensive ones for range. Though at like 40 bucks they're not that wildly expensive.

Make sure it's a rasp 4 since wake word is processed locally. And you probably don't need 128gb RAM. No idea what they use but doubt that much.

Re: Ask HN: Non-cloud voice recognition for home use?

#40

Post by rs23296008n1 »

Havoc wrote: post #39

>I'm happy if they talk back via wifi to a server in my office for whatever real processing. The server might have 16 cores and 128Gb ram. Pretty sure Mycroft is capable of that - in theory - you'll need to config it manually. The standard raspberry pi route isn't powerful enough for local. Check out reespeaker for a raspberry microphone. You'll want one of the more expensive ones for range. Though at like 40 bucks t…

As discussed elsewhere in this thread by others, mycroft can't do offline processing, according to their faq at least.

128GB is the minimum I use for general purpose servers so this machine would be a repurposed machine rather than something specially ordered or built.

Post reply on HN