Rhasspy is an open source, fully offline voice assistant toolkit • Hacker News Board

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#41

Post by GordonS » Wed, Jan 01, 2020, 4:28 PM UTC

This looks great!

I'm curious about extensibility - would it be possible integrate with a C# app running on Windows, for example?

I'm particularly interested for accessibility reasons, looking for ways to control tools like JetBrains Rider without shifting my hands from keyboard to mouse.

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#42

Post by [deleted] » Wed, Jan 01, 2020, 4:40 PM UTC

cmer wrote: post #4

This is really cool! Does anyone know if there's a way to hack an Echo Dot and use it as the speaker/mic for Rhasspy? Rolling out our own hardware that is as effective as a Dot would probably be very difficult?

[deleted]

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#43

Post by davewongillies » Wed, Jan 01, 2020, 6:01 PM UTC

jszymborski wrote: post #10

This looks like a lot of fun to hook up to something like this 6 mic hat for the Raspberry Pi https://respeaker.io/6_mic_array/

The ReSpeaker Core v2.0 looks like it could be fun too:

* Debian-Based Linux System

* SDK for Speech Algorithms with Full Documents

* C++ SDK and Python Wrapper

* Speech Algorithms and Features

* Keyword Spotting (Wake-Up)

* BF (Beamforming)

* DoA (Direction of Arrival)

* NS (Noise Suppression)

* AEC (Acoustic Echo Cancellation) and AGC (Automatic Gain Control)

* All-in-One Solution with High Performance SoC

* 8 Channel ADC for 6 Microphone Array and 2 Loopbacks (Hardware Loopback)

https://respeaker.io/rk3229_core/

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#44

Post by drKarl » Wed, Jan 01, 2020, 6:31 PM UTC

Mmm if there were only IP microphones to connect to something like a Raspberry Pi (An Odroid H2 in my case) to have multiple mics, one on each room without the need for multiple servers...

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#45

Post by wavefunction » Wed, Jan 01, 2020, 6:56 PM UTC

synesthesiam wrote: post #33

Author here, happy new year HN! Glad to answer any questions (also see https://community.rhasspy.org ) Bit of background: Rhasspy was originally designed for Home Assistant ( https://www.home-assistant.io ), but now works with lots of home automation projects (Hass.io, Node-RED, OpenHAB, Jeedom). Its sister project, voicej2son ( http://voice2json.org ), is for command-line use and has fewer options. With Snips.ai bei…

Just an aside, neither the logo nor the name make me think of "spee." Definitely going to check this out though, thanks!

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#46

Post by synesthesiam » Wed, Jan 01, 2020, 8:39 PM UTC

GordonS wrote: post #41

This looks great! I'm curious about extensibility - would it be possible integrate with a C# app running on Windows, for example? I'm particularly interested for accessibility reasons, looking for ways to control tools like JetBrains Rider without shifting my hands from keyboard to mouse.

I haven't ever tried running this on Windows. You may get lucky with Docker, but audio input might be difficult. A workaround might be to stream audio in: https://rhasspy.readthedocs.io/en/latest/audio-input/#gstrea...

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#47

Post by squanch » Wed, Jan 01, 2020, 10:43 PM UTC

jszymborski wrote: post #10

This looks like a lot of fun to hook up to something like this 6 mic hat for the Raspberry Pi https://respeaker.io/6_mic_array/

thank you for bringing these products to my attention :-)

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#48

Post by dicknuckle » Wed, Jan 01, 2020, 10:51 PM UTC

drKarl wrote: post #44

Mmm if there were only IP microphones to connect to something like a Raspberry Pi (An Odroid H2 in my case) to have multiple mics, one on each room without the need for multiple servers...

I would also love to do the same.

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#49

Post by dicknuckle » Wed, Jan 01, 2020, 11:02 PM UTC

donatj wrote: post #18

How is that useful? Most of the things I use assistants for is locating data online while I'm not on my phone.

If you're like me, various things in the house are controlled by voice like lights and small appliances. Just yesterday the internet was out and I couldn't control the wifi plugs for the noise machine, lamp, and humidifier. Had to crawl down behind furniture to turn them off manually so everything would work the same once we regained access to the internet. Super useful for heavily integrated homes, or even in the car while driving through areas with no cell signal.

Re: Rhasspy is an open source, fully offline voice assistant toolkit

#50

Post by jdboyd » Thu, Jan 02, 2020, 1:36 AM UTC

drKarl wrote: post #44

Mmm if there were only IP microphones to connect to something like a Raspberry Pi (An Odroid H2 in my case) to have multiple mics, one on each room without the need for multiple servers...

AES67 microphones exist. Shure, Audio-Technica, and Audix are just 3 manufacturers that make them. Some of them are called Dante mics and you have to turn on AES67 in a confirmation menu. I don't know that there are any good AES67 drivers in stock Debian or Raspbian, but a lot of AES67 devices can be used with any software that supports rtsp. Whether one install of rhasspy can handle multiple streams at once is a different question. Also, even the cheapest AES67 equipment is expensive enough that a new raspberry pi or odroid h2 per room would be cheaper.