Live data from Hacker News

Ask HN: Non-cloud voice recognition for home use?

news.ycombinator.com

41–50 of 130 posts

Re: Ask HN: Non-cloud voice recognition for home use?

#41

Earlier quoted context omitted.

No I hadn't. This was why I asked: I know there's alternatives out there but there's so much noise. Thanks.

Almond has been posted on HN previously[1]. User voltagex_ commented[2] that self-hosting, while possible is not recommended in the official installation instructions[3] as it is considered significantly more challenging to manage. This may or may not effect your decision to go forward with Almond. [1] https://news.ycombinator.com/item?id=17532003 [2] https://news.ycombinator.com/item?id=17534793 [3] https://github.c…

Pertinent quote from [3] regarding "more challenging":

"You must also deploy custom NLP models, as the official ones will not be compatible. Use this setup only if you absolutely need custom Thingpedia interfaces, and cannot provide these interfaces on Thingpedia."

Re: Ask HN: Non-cloud voice recognition for home use?

#42
Hi, I'm the dev behind https://talonvoice.com

I've been working with Facebook's wav2letter project and the results (speed on CPU, command accuracy) are extremely good in my experience. They also hold the "state of the art" for librispeech (a common benchmark) on wer_are_we [1]. Granted, that's with a 2GB model that doesn't run very well on CPU, but I think most of the fully "state of the art" models are computationally expensive and expected to run on GPU. Wav2letter has other models that are very fast on CPU and still extremely accurate.

You can run their "Streaming ConvNets" model on CPU to transcribe multiple live audio streams in parallel, see their wav2letter@anywhere post for more info [2]

I am getting very good accuracy on the in-progress model I am training for command recognition (3.7% word error rate on librispeech clean, about 8% WER on librispeech other, 20% WER on common voice, 3% WER on "speech commands"). I plan to release it alongside my other models here [5] once I'm done working on it.

There's a simple WER comparison between some of the command engines here [3] Between this and wer_are_we [1] it should give you a general idea of what to expect when talking about Word Error Rate (WER). (Note the wav2letter-talonweb entry in [3] is a rather old model I trained, known to have worse accuracy, it's not even the same NN architecture).

----

As far as constraining the vocabulary, you can try train a kenlm language model for kaldi, deepspeech, and wav2letter by grabbing KenLM and piping normalized (probably lowercase it and remove everything but ascii and quotes) text into lmplz:

    cat corpus.txt | kenlm/build/bin/lmplz -o 4 > model.arpa
And you can turn it into a compressed binary model for wav2letter like this:

    kenlm/build/bin/build_binary -a 22 -q 8 -b 8 trie model.arpa model.bin
There are other options, like using a "strict command grammar", but I don't have enough context as to how you want to program this to guide you there.

I also have tooling I wrote around wav2letter, such as wav2train [4] which builds wav2letter training and runtime data files for you.

I'm generally happy to talk more and answer any questions.

----

[1] https://github.com/syhw/wer_are_we

[2] https://ai.facebook.com/blog/online-speech-recognition-with-...

[3] https://github.com/daanzu/kaldi-active-grammar/blob/master/d...

[4] https://github.com/talonvoice/wav2train

[5] https://talonvoice.com/research/

Re: Ask HN: Non-cloud voice recognition for home use?

#43
I wish you luck with this, and more importantly, hope that it inspires many people to start building similar projects.

I know virtually nothing about voice recognition, but my spidey sense tells me that it should be possible with the hardware you specify.

A Commodore 64 with a Covox VoiceMaster could recognize voice commands and trigger X-10 switches around a house. (Usually. My setup had about a 70% success rate, but pretty good for the time!) Surely a 16 core, 128GB RAM machine should be able to do far more.

Re: Ask HN: Non-cloud voice recognition for home use?

#44
Modern web browsers will support the Web Speech API (https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_...) which may or may not involve a cloud service.

Here is the Google Chrome Web Speech API demo page: https://www.google.com/intl/en/chrome/demos/speech.html

Re: Ask HN: Non-cloud voice recognition for home use?

#45

Modern web browsers will support the Web Speech API ( https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_... ) which may or may not involve a cloud service. Here is the Google Chrome Web Speech API demo page: https://www.google.com/intl/en/chrome/demos/speech.html

In which browser doesn't it involve a cloud service?

Re: Ask HN: Non-cloud voice recognition for home use?

#46
post #45

Modern web browsers will support the Web Speech API ( https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_... ) which may or may not involve a cloud service. Here is the Google Chrome Web Speech API demo page: https://www.google.com/intl/en/chrome/demos/speech.html

In which browser doesn't it involve a cloud service?

Use Firefox.

Google Chrome does use a cloud service.

Edit: Firefox does not support the Web Speech API at this time. There are not currently any offline versions of this API as far as I can tell.

Re: Ask HN: Non-cloud voice recognition for home use?

#47
post #45

Earlier quoted context omitted.

In which browser doesn't it involve a cloud service?

Use Firefox. Google Chrome does use a cloud service. Edit: Firefox does not support the Web Speech API at this time. There are not currently any offline versions of this API as far as I can tell.

According to MDN, Firefox doesn't support it?

https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_...

EDIT: According to other documentation, it is behind a config flag. If you enable it, it will send the data to Google's API through a Mozilla-operated proxy: https://wiki.mozilla.org/index.php?title=Web_Speech_API_-_Sp...

Re: Ask HN: Non-cloud voice recognition for home use?

#48

I wish you luck with this, and more importantly, hope that it inspires many people to start building similar projects. I know virtually nothing about voice recognition, but my spidey sense tells me that it should be possible with the hardware you specify. A Commodore 64 with a Covox VoiceMaster could recognize voice commands and trigger X-10 switches around a house. (Usually. My setup had about a 70% success rate, bu…

Its beginning to take shape. Already got a bunch of good candidates for experimentation next week based on the answers so far.

Re: Ask HN: Non-cloud voice recognition for home use?

#50
post #47

Earlier quoted context omitted.

Use Firefox. Google Chrome does use a cloud service. Edit: Firefox does not support the Web Speech API at this time. There are not currently any offline versions of this API as far as I can tell.

According to MDN, Firefox doesn't support it? https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_... EDIT: According to other documentation, it is behind a config flag. If you enable it, it will send the data to Google's API through a Mozilla-operated proxy: https://wiki.mozilla.org/index.php?title=Web_Speech_API_-_Sp...

You're right.

It looks like there is no offline version :(

Post reply on HN