Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Building Jarvis

facebook.com

Post reply on HN
Print view View original

21–30 of 263 posts

Re: Building Jarvis

#21

Post by hacker_9 »

Say what you will about Zuckerberg, but this is a really cool project! Steps he took:

1. Connect his home devices (lights, thermostat, doors, music player, TV, CCTV etc) to his computer, so he can turn them on and off from it and in general automate his house from his PC.

2. Add an NLP component to his computer, so he could text instructions to it and it would apply the correct automation task. This can learn preferences too and be told about mistakes so it does better in the future.

3. Add face recognition, so it can recognise people at his door and automatically open it if they are expected.

4. Add speech recognition, by creating an app for the phone that is constantly on and listening for his voice. This is then converted to automation tasks again.

All in all, an interesting way to spend 100 hours. Calling it AI is a bit of a stretch though; this is basically linking up a bunch of in-accurate sensory parsers, coupled with some limited machine learning, connected to a bunch of if statements. Still a long way off of Jarvis, who is basically a genius by human standards!

Re: Building Jarvis

#23

Post by dimino »

carlosdp wrote: post #18
dimino wrote: post #7

If it's literally Zuckerberg building all this, I bet it's full of security holes (not that he's a bad dev, I wouldn't know, just that one dev can't reasonably be expected to develop a secure app at a pace even remotely quickly). Dunno what that means, just that it would be mildly funny if someone used this fact to try to get a job at Facebook or something.

I've seen people go down this road before, even specifically toward Zuckerberg. It's never actually a good idea, it just makes you look like a psycho. Big difference between revealing an exploit on Facebook and demonstrating a proof of concept to their bug bounty and exploiting Mark's personal home. Not saying you would do that, just saying for other people reading that it's not really a joking matter when it really…

I don't recommend doing it, I was just commenting on the concept.

I recall reading someone trying to PM Zuckerberg their resumé by using a bug in Facebook to force him to be friends with her.

Though, I do disagree. I think it's mildly funny when someone does something like this. Not in an encouraging way, I guess, but more as a news item I get to read safely in my pseudo-anonymous home.

Re: Building Jarvis

#24

Post by [deleted] »

hacker_9 wrote: post #21

Say what you will about Zuckerberg, but this is a really cool project! Steps he took: 1. Connect his home devices (lights, thermostat, doors, music player, TV, CCTV etc) to his computer, so he can turn them on and off from it and in general automate his house from his PC. 2. Add an NLP component to his computer, so he could text instructions to it and it would apply the correct automation task. This can learn prefere…

[deleted]

Re: Building Jarvis

#25

Post by toomuchtodo »

spacemanmatt wrote: post #19
smaili wrote: post #13

More than anything else, what stood out to me was his discipline for knowing how to manage his time in a way that enabled him to build something like this while still juggling the n number of other things on his plate.

I find my discipline is much stronger when none of the things on my plate is a fire I lack tools to deal with.

Triage, delegate, action what's left.

Re: Building Jarvis

#26

Post by brianshaler »

wgyn wrote: post #15
brianshaler wrote: post #2

Anyone setting out to do something like this will quickly see how much of a hassle it is to exfiltrate data from relevant services and your own devices. APIs and SDKs cover a lot of use-cases, and that is all great and commendable, but we don't truly own our own devices, data, or the algorithms that make them useful. I think this will continue to hamper our ability to have a truly useful 3rd party (your home in this…

> My experience of ramping up in the Facebook codebase is probably pretty similar to what most new engineers here go through. I was consistently impressed by how well organized our code is, and how easy it was to find what you're looking for -- whether it's related to face recognition, speech recognition, the Messenger Bot Framework [messenger.com/platform] or iOS development. The open source Nuclide [github.com/face…

I haven't really dug into open source speech recognition, so I can't speak much to that side of things, except observing that advancements favor deep learning and cloud-based services over efficient on-device detection (aside from very specific "hey siri"/"okay google"/"hey alexa" recognizers). When it's not a library that can be included, but a service that must be maintained, it'll be that much hard for free and open solutions to get adoption.

For face detection & recognition, some of the greatest advancements are getting acqui-hired and locked away (e.g. Facebook acquiring Face.com) there is still progress being made with tools like OpenCV & Dlib. I just worry progress in the open-source space will lag behind and continue to be difficult to work with, as the delta grows between proprietary capabilities and open-source options.

Re: Building Jarvis

#27

Post by IanCal »

hacker_9 wrote: post #21

Say what you will about Zuckerberg, but this is a really cool project! Steps he took: 1. Connect his home devices (lights, thermostat, doors, music player, TV, CCTV etc) to his computer, so he can turn them on and off from it and in general automate his house from his PC. 2. Add an NLP component to his computer, so he could text instructions to it and it would apply the correct automation task. This can learn prefere…

I think what's particularly great about this in a way is that it's not too remarkable. I'm not knocking it, but it's awesome to be around when creating an natural language, speech controlled, available anywhere system with face recognition to automate your own home is something that can be done in 100 hours.

Re: Building Jarvis

#29

Post by IvyMike »

mgiannopoulos wrote: post #3

Honest question on the difficulty of this : >> In some ways, this challenge was easier than I expected. In fact, my running challenge (I also set out to run 365 miles in 2016) took more total time At a casual pace of 10 minutes per mile, that's around 60 hours. Does needing 60 hours to build all that sound plausible to anyone familiar with the task? Edit: at the end he notes that "I spent about 100 hours building Jar…

Change into running clothes, go to a trail/track, and shower afterwards and you easily add that much overhead.

Re: Building Jarvis

#30

Post by avitzurel »

Here's what I absolutely love about this...

He's still a hacker. CEO of one of the biggest internet companies of our time and he still hacks.

I explain to people all the time, true hackers are like true writers. I've heard writers talk about the same thing. It's like an urge of creativity inside you, you have to release it into something.

You can also see in the comments section, he's replying to people and providing feedback.

I really dig this.

Post reply on HN