This is cute, and definitely a good educational resource about mature foss HCI applications, but this will not give the degree of quality that many have come to expect from assistants as simple as even Amazon's Alexa. Sirius is much closer to what you want. http://sirius.clarity-lab.org/sirius-suite/
I wonder how good the results are compared to to Google's stack - http://googleresearch.blogspot.co.uk/2015/08/the-neural-netw... - check arxiv for more info. Haven't seen any open source implementations yet