Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Can we build Ironman's Jarvis with 2019 tech?

news.ycombinator.com

Post reply on HN
Print view View original

51–60 of 65 posts

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#51

Post by guzik »

oulipo wrote: post #43
escapologybb wrote: post #16

I'm pretty much doing that very thing. I'm quadriplegic, so every single action I want to take in the world has to be mediated through a third party. That said party is anything from another person to one of the digital assistants. As another poster mentioned I think, I control pretty much everything in my house including but not limited to unlocking doors, windows, climate control, the lights, posting to Twitter and…

And if you want to add a 100% offline and private-by-design Voice AI which can run on a Raspberry Pi 3 (and iOS, Android, Linux), take a look at what we are building at https://snips.ai (it also integrates to Home Assistant) It works for english, german, french, japanese, spanish, italian, and more coming soon!

Looks awesome! Any plans for FreeRTOS?

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#52

Post by escapologybb »

brlewis wrote: post #49
escapologybb wrote: post #16

I'm pretty much doing that very thing. I'm quadriplegic, so every single action I want to take in the world has to be mediated through a third party. That said party is anything from another person to one of the digital assistants. As another poster mentioned I think, I control pretty much everything in my house including but not limited to unlocking doors, windows, climate control, the lights, posting to Twitter and…

>if my Fitbit notices that my heart rate has gone below 40 BPM for more than 10 seconds I get a notification, as it is almost indicative of an attack of Autonomic Dysreflexia. I can honestly say that this home automation system has actually saved my life without an ounce of hyperbole. I'm a #FitbitEmployee but I don't speak for Fitbit. Speaking personally, I'm happy that it's worked well for you so far, but I'm conce…

Thank you for your concern, but I never and would never place my life in the hands of any one piece of anything really. Be that technology, person or process.

The Fitbit has given me a heads up a little earlier than I otherwise would have got it, the value added for me is that it's cheap and a great indicator. But an indicator is all it is and it is part of a wider protocol we have in the house for preventing and detecting Autonomic Dysreflexia. A vital part, but still just one component.

I do wish I could turn off the step counter though, and if it could detect when I'm asleep that would also be great. The former I don't think I'm ever going to do very well on and the latter is really not the fault of the device as I don't move around very much at all.

Thanks again for your concern! :-)

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#53

Post by escapologybb »

oulipo wrote: post #43
escapologybb wrote: post #16

I'm pretty much doing that very thing. I'm quadriplegic, so every single action I want to take in the world has to be mediated through a third party. That said party is anything from another person to one of the digital assistants. As another poster mentioned I think, I control pretty much everything in my house including but not limited to unlocking doors, windows, climate control, the lights, posting to Twitter and…

And if you want to add a 100% offline and private-by-design Voice AI which can run on a Raspberry Pi 3 (and iOS, Android, Linux), take a look at what we are building at https://snips.ai (it also integrates to Home Assistant) It works for english, german, french, japanese, spanish, italian, and more coming soon!

Can you email me, I would love to move more and more of this stuff inside the wire and if we can do something that we can then share with other quadriplegics so they can keep control of their own medical info; that would be very groovy.

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#54

Post by cferr »

oulipo wrote: post #43
escapologybb wrote: post #16

I'm pretty much doing that very thing. I'm quadriplegic, so every single action I want to take in the world has to be mediated through a third party. That said party is anything from another person to one of the digital assistants. As another poster mentioned I think, I control pretty much everything in my house including but not limited to unlocking doors, windows, climate control, the lights, posting to Twitter and…

And if you want to add a 100% offline and private-by-design Voice AI which can run on a Raspberry Pi 3 (and iOS, Android, Linux), take a look at what we are building at https://snips.ai (it also integrates to Home Assistant) It works for english, german, french, japanese, spanish, italian, and more coming soon!

This looks very close to what I was looking for about a year ago when I wanted to try my hand at making my own 'personal assistant'. I was thinking something like the Star Trek computer but just for data lookups and binary execution rather than calculations and data analysis.

e.g. "Computer, look up 'can cats eat pancakes?'" which would just open Firefox and input that in a DDG search, or, "Computer, play the song 'Never Gonna Give You Up'" which would open WMP and play that song from my offline music library. Ideally it would vocally respond with some pre-baked yes/no responses before executing the command.

Is that doable with your software? Does it have a Python API?

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#55

Post by thecupisblue »

new_guy wrote: post #8

Sure you can. Services like Alexa are just glorified paperweights and aren't reflective of real world capabilities. If you want to build your own Jarvis, don't listen to anyone else just get stuck in. You'll be surprised just how far you can get with it.

Exactly. They are all developed with the intent to have one party control the apps and partnerships, which in itself limits it's possibilities from the start.

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#56

Post by rebuilder »

icebraining wrote: post #32
rebuilder wrote: post #19

Earlier quoted context omitted.

Sounds very cool! What are you using for sensors and physical hardware? I mean light switches, temperature control etc - I browsed the home assistant site but didn't really come out with an understanding of what hardware the system can communicate with to, say, turn off a lightbulb.

You use a component to connect to some networked light control system. The "Light" category has 71 components: https://www.home-assistant.io/components/#light An example would be IKEA Trådfri ( https://www.home-assistant.io/components/tradfri/); you connect the lights to its gateway device, then Home Assistant will use the API provided by that gateway to control the lights.

Thank you, components is what I needed to find!

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#57

Post by silversconfused »

I wrote a little shell script that lets you move the mouse around with your voice, ask what time it is, etc. My thinking for future applications is that specific appliances should take specific commands, so there would be little intelligence needed. Oven: preheat to 350 degrees. Lights: on. Music: off. Etc.

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#58

Post by kaybe »

krick wrote: post #25
kaybe wrote: post #10

Earlier quoted context omitted.

You could also build on top of one of the open source versions, eg Mycroft. https://mycroft.ai/

That's interesting. Basically the only reason I don't use Alexa or something like this is that I don't want 3rd party listening to me 24/7, so an open source alternative would be of great use. But I don't understand: it says it's open-source, yet the first thing I have to do is to create an account on their platform. So, what's that "open source" thing I ought to download and install, is it just a client? Can I use t…

I haven't tried, but from what I've gathered you can either run it yourself on eg a raspberry pie or use their infrastructure instead if you don't want the hassle and expense. I have the same concerns.

Here's another project btw, which seems less commercial:

https://jasperproject.github.io/

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#59

Post by _bxg1 »

The movies (and the major real-life assistants) tend to focus on the idea that you're talking to your computer as if it were a person, but this makes the problem an order of magnitude more difficult than it needs to be. What if we looked at it more like a vocal command prompt? What if we applied the Unix philosophy of composing programs and data transformations into more complex use-cases? You'd have to memorize the commands (though there could be vocal "man pages" too), but could finally do more than toggling lights and asking what the weather is like.

There's some precedent for this; in Avengers Endgame (I'll keep it vague), Tony gives some very precise and technical commands to the system when running a scientific simulation. He's not conversing and quipping, he's basically calling parameterized functions with his voice. I think that would be very doable today.

Re: Ask HN: Can we build Ironman's Jarvis with 2019 tech?

#60

Post by kthejoker2 »

Everyone here is focusing on the voice assistant and IoT piece, but the thing that's really missing is the idea of a contextually rich personal API and some POSSE mechanism to selectively share that API with others and vice versa.

Quantified Self movement is maybe 30% of the way.

Until this space matures we're kind of a standstill. Commercial options have to be generic or face the wraith of GDPR, data breaches, and privacy advocates.

The only way to square the circle is let people own their data completely and then incentivize them to share with your service for the benefits you provide.

I think the killer app is an Alexa/JARVIS clone that "spies on you 24/7" but keeps your digital twin 100% offline and owned by you. It's the learning and the "personal schema" that's compelling.

When it knows why you want to turn on the lights we're getting somewhere.

Post reply on HN