Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

flutter.io

Post reply on HN
Print view View original

71–80 of 128 posts

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#71

Post by apu »

I believe one of the co-founders is Navneet Dalal, who, along with Bill Triggs, developed the "Histograms of Oriented Gradients" (HOG) features that are widely used across all of computer vision†. Thus, I'm guessing that there's some serious vision in use for this app, which is pretty awesome!

(My apologies to the other co-founders, who are likely just as talented!)

† http://en.wikipedia.org/wiki/Histogram_of_oriented_gradients

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#73

Post by savrajsingh »

fosk wrote: post #23

It would be interesting to know what piece of technology, or framework, they're using for recognizing gestures using the webcam.

I'm not sure, but this looks like a good starting point? http://www.movesinstitute.org/~kolsch/HandVu/HandVu.html

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#74

Post by mehuln »

savrajsingh wrote: post #70
mehuln wrote: post #58

Earlier quoted context omitted.

Legit concern. This is why we've built an app w/o a server component, so everything happens on your machine. We do not capture anything from your webcam. It all happens on your machine. On top of it, there's a turn off capability which will allow you to turn it off for time being.

I presume the connection opened to AWS on boot is just for tracking purposes, yes? :)

Yes, that is correct.

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#75

Post by hedgehog »

mehuln wrote: post #53
hedgehog wrote: post #52

Very cool although with CPU usage at about 30% on my Air I won't be able to use it much. If you can figure out a way to drop average CPU usage down to reduce heat & power usage that would be a big deal.

Hi Hedgehog - thats a great point. We thought of it, and when you're not doing a gesture, CPU usage should drop to around 2-3%. Let us know if it doesn't. In our test, average CPU usage was around 5%.

Interesting. It does seem to drop to about 5% if I'm not in front using the computer and not in front of it but otherwise floats between about 7% and 20%. This is on a MacBookAir4,2, based on a few minutes of testing it seems like it's about 65% additional power consumption when the machine is otherwise mostly idle. I'm actually impressed though that you got power consumption as low as it is. Photo Booth consumes about 6.5% so I'd guess that's the lower limit for Flutter, maybe default to disabling Flutter while the computer is on battery?

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#78

Post by mehuln »

andrewpi wrote: post #77

Flutter seems to keep the camera on 100% of the time which prevents apps like Skype from using the camera for video chats. I'm not sure if there is a good workaround for that?

Andrew - great observation. On top of your menubar, there's Flutter icon. Click on it, and it will give you simple flutter on and flutter off capability.

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#80

Post by cellularmitosis »

plasma wrote: post #18

Flutter in action: http://www.youtube.com/watch?v=IxsGgW6sQHI&feature=youtu...

Expected reaction, having just a blurred-out image on your landing page: "Sure, whatever, it probably doesn't work that well...".

Expected reaction, having a video demonstration of the product on your landing page: "THIS IS FRICKIN' AWESOME!".

Please, please, but a video on your landing page. You will thank yourself after checking your conversion rate.

Post reply on HN