Surprised that nobody mentioned this http://jasperproject.github.io/
Ask HN: Can we build Ironman's Jarvis with 2019 tech?
41–50 of 65 posts
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#42You could probably get 90% of the utility with a janky collection of shell scripts fronted by a voice recognition engine. Think Alexa/Google Assistant/Siri/etc with a bunch of company- or task- specific scripts. I purposefully ignore the robot-arm in an open universe capability, because that's still too far away, AFAIK. Jarvis in the movie was Hollywood smooth: made to look great in a movie. Even the goofs were great…
Actually you could've built Alexa/Siri etc back in 1997 with DragonDictate and a whole bunch of scripting. And in many areas it would've been just as good as what we have today.
I had a better UX around playing music with WinAMP, Microsoft Speech API, and a little program I wrote to glue the two together via Win32 API WM_ messages, in 2007, than I have today with Google Now.
Today the problem is a) the voice recognition part, which happens on-line though it shouldn't (introducing large latency and unnecessary Internet dependency), and b) scriptability, which is something none of the voice assistant vendors want to give to you, for business reasons. A better reality would have voice parsed on-device (possibly with models from on-line service providers), and available as a voice-to-text API that could be easily accessed by local scripts.
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#43I'm pretty much doing that very thing. I'm quadriplegic, so every single action I want to take in the world has to be mediated through a third party. That said party is anything from another person to one of the digital assistants. As another poster mentioned I think, I control pretty much everything in my house including but not limited to unlocking doors, windows, climate control, the lights, posting to Twitter and…
And if you want to add a 100% offline and private-by-design Voice AI which can run on a Raspberry Pi 3 (and iOS, Android, Linux), take a look at what we are building at https://snips.ai (it also integrates to Home Assistant)
It works for english, german, french, japanese, spanish, italian, and more coming soon!
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#44If you are really asking for it to be like Jarvis, where "like" implies some reasonably similar approximation, then:
No. Absolutely not. Not even close.
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#45I think we are closer than we think. The problem is that all voice control up until now is a closed app with simplified intents. In my opinion what we need is a programming language whose REPL UX is voice-oriented, that eases the separation between using and extending the system. Prolog or a lisp could be quite near but we would require some changes such as: syntax easily read (:- in prolog is not very good), the abi…
We need some type of Structured Query Language, call it SEQUEL, or maybe abbreviated SQL for short. /s Jokes aside, maybe a LISP-like Sentence Processing Language might be the future of this type of HCI.
Look into Attempto Controlled English for an alternative closer to what I was thinking about :)
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#46Surprised that nobody mentioned this http://jasperproject.github.io/
Shameless plug: https://github.com/synesthesiam/rhasspy
Rhasspy is inspired by Jasper, but works by having you specify intents/voice commands via a grammar (rather than via Python). It then trains a speech and intent recognition system together to recognize those commands. Recognized commands are published over MQTT or POST-ed directly into Home Assistant.
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#47I'm pretty much doing that very thing. I'm quadriplegic, so every single action I want to take in the world has to be mediated through a third party. That said party is anything from another person to one of the digital assistants. As another poster mentioned I think, I control pretty much everything in my house including but not limited to unlocking doors, windows, climate control, the lights, posting to Twitter and…
Do you have a good "beginners guide to the ultimate voice setup"?
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#48Siri is still half deaf and tries to send me to the chip shop when I ask it to send a message and they have a ridiculous amount of budget behind that so probably not. At the moment our technology is like Zorg’s desk in Fifth Element. Stuffed full of toys but ultimately will let you down too often to be relied upon.
"send me to the chip shop" Do you have an accent by any chance - pretty much all voice recognition technology (Android, Apple, cars...) appears to be utterly flummoxed by my fairly mild Scottish accent. [Edit: to be fair, my accent is probably fairly mild by Scottish standards, not compared to RP].
I’ve got a fairly heavy London accent.
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#49I'm pretty much doing that very thing. I'm quadriplegic, so every single action I want to take in the world has to be mediated through a third party. That said party is anything from another person to one of the digital assistants. As another poster mentioned I think, I control pretty much everything in my house including but not limited to unlocking doors, windows, climate control, the lights, posting to Twitter and…
>if my Fitbit notices that my heart rate has gone below 40 BPM for more than 10 seconds I get a notification, as it is almost indicative of an attack of Autonomic Dysreflexia. I can honestly say that this home automation system has actually saved my life without an ounce of hyperbole.
I'm a #FitbitEmployee but I don't speak for Fitbit. Speaking personally, I'm happy that it's worked well for you so far, but I'm concerned if it's likely that your life will depend on consistently good HR from a Fitbit. Although manufacturing has improved a lot since Charge HR days, they still aren't medical-grade devices. You should talk to a medical professional about what to use to monitor your heart rate.
Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?
#50Earlier quoted context omitted.
"send me to the chip shop" Do you have an accent by any chance - pretty much all voice recognition technology (Android, Apple, cars...) appears to be utterly flummoxed by my fairly mild Scottish accent. [Edit: to be fair, my accent is probably fairly mild by Scottish standards, not compared to RP].
I’ve got a fairly heavy London accent.
Maybe we should join forces and found a voice technology testing company!