Does anyone know if this is viable on a pi zero?
No, even on RPi 3 both pocketsphinx and Kaldi are very slow to the point of not being responsive enough for real use.
Rhasspy is an open source, fully offline voice assistant toolkit
31–40 of 56 posts
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#32Similar project (quite old): CMU Sphinx
Seems like this project uses sphinx as the actual recognition engine. This is just a wrapper.
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#33Author here, happy new year HN! Glad to answer any questions (also see https://community.rhasspy.org)
Bit of background: Rhasspy was originally designed for Home Assistant (https://www.home-assistant.io), but now works with lots of home automation projects (Hass.io, Node-RED, OpenHAB, Jeedom). Its sister project, voicej2son (http://voice2json.org), is for command-line use and has fewer options.
With Snips.ai being bought by Sonos, we're now focusing on compatibility with its MQTT protocol (https://docs.snips.ai/reference/hermes) so existing plugins/skills will just work. Supporting Snips-like number/duration/dateTime slots across over a dozen languages is going to be a major challenge, so please reach out if you speak a language besides English* :)
* Also consider donating to the Common Voice project: https://voice.mozilla.org
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#34I too am super interested in an offline-only voice assistant but really don't want to bother with setting up a mic connected to a pi. Even tough it's not super hard, it'll never be as good as the commercially available options. I think this project would really benefit from taking one of the excellent existing voice assistant/speakers on the market (Google home, echo dots, etc., and flashing them with some custom fir…
They do wake-word processing on device. Not sure how dedicated the hardware is to make that possible, and the requirements for this seem too high for that. Would love to have great hardware for custom tinkering though. With more development time and money behind this project, I hope it could grow into a great tool.
You can do offline voice processing if the grammar is small enough. Recognizing commands is a lot easier than open domain dictation.
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#35Similar project: Voice2JSON Website: https://voice2json.org GitHub: https://github.com/synesthesian/voice2json (I am not affiliated but am using it in my own pet project)
Correct link: https://github.com/synesthesiam/voice2json
For those wondering, Rhasspy and voice2json are from the same author (me). If you want a command-line tool for voice assistant tasks (wake word detection, speech to text, intent recognition, etc.), check out voice2json.
See the recipes for some interesting things you can do with voice2json: http://voice2json.org/recipes.html
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#36How good is the recognition?
The Kaldi models come from Zamia (https://github.com/gooofy/zamia-speech) and their accuracy is quite high. They're a bit slow on a Pi, though there are some performance improvements coming soon.
Rhasspy is designed to recognize user-specified voice commands, so the accuracy will highly depend on the complexity of your commands. If needed, you can also try doing open transcription: https://rhasspy.readthedocs.io/en/latest/speech-to-text/#ope...
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#37Does anyone know if this is viable on a pi zero?
Yes, Rhasspy will now run on a Pi Zero (armv6l) as of 2.4.15 (https://community.rhasspy.org/t/version-2-4-15-release/115). Kaldi is not yet supported, so you have to use pocketsphinx for speech recognition. You'll also have to do a virtual environment install (https://rhasspy.readthedocs.io/en/latest/installation/#virtu...)
The recommended use of a Pi Zero is as a recording/wake word detection/audio playback satellite. Other functions, like speech/intent recognition can be done remotely (e.g., https://rhasspy.readthedocs.io/en/latest/speech-to-text/#rem...)
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#38Does anyone know if this is viable on a pi zero?
No, based off of their hardware requirements. See here. https://rhasspy.readthedocs.io/en/latest/hardware/
Kaldi and Docker support are missing, but its possible to run on a Pi Zero using a virtual environment install: https://rhasspy.readthedocs.io/en/latest/installation/#virtu...
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#39Earlier quoted context omitted.
You can set it up for remote processing and use a zero W as just a remote, but you will definitely need something more powerful for speech.
AFAIK Snips.ai supports recognizing wake words on the pi zero w, and then have the actual speech recognition happen on some other machine. I guess something similar should be possible with Rhasspy? I was part way through a "smart speaker" project and planned to use Snips.ai, but I see now that they've been bought by Sonos so Rhasspy is looking pretty tempting now. However my plan was to use pi zero's at the speaker e…
Definitely possible! See https://rhasspy.readthedocs.io/en/latest/speech-to-text/#rem...
Re: Rhasspy is an open source, fully offline voice assistant toolkit
#40I recently came across Rhasspy, and while I haven't had time to play with it, I'm super excited. Often I like the sound of certain projects but want to plug in my own parts. Rhasspy appears to glue all the parts of a modern voice assistant together, but let you swap out any of the parts.
Going forward, Rhasspy is being split into multiple MQTT services that should be compatible with Snip.ai's protocol (https://github.com/rhasspy)
This should make it much easier to swap out parts, and distribute the computing across multiple devices.