Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

flutter.io

Post reply on HN
Print view View original

41–50 of 128 posts

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#42

Post by devin »

Really cool. I was just playing with it and my girlfriend walked over to ask me a question. I held up my hand to my computer as if to say "Hold on, computer."

It was a bit surreal. Very cool. Can't wait for more gestures or a generalized way to program my own gestures. I would love to be able to gesture "Switch to iTerm.app" by doing an OK sign or something. Sign language letters maybe?

Anyway, thanks. Really enjoy it already, can't wait for more. Also, I would pay money for this. If it had all of the play/pause/forward/back functionality I think I'd give you 4.99 if it was accurate. Just sayin'.

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#44

Post by mehuln »

ihodes wrote: post #19

Though I know there's a chance you'd not be willing to share the information, I'd love to learn a little bit about how you built this product. It appears as though you're using ML to recognize the gestures—anything else you could share would be fascinating. I'll be sending in a job application, as well!

You're right. We use image processing, computer vision & machine learning to detect Flutters. Our entire tech stack is custom written as we are solving some quite challenging & difficult AI problems.

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#45

Post by esharef »

siavosh wrote: post #37

What's nice about this is you don't need to switch screens to pause the music if you find yourself writing/coding and need some quiet when you're in the zone. Granted you can do this with the mac play/pause physical buttons but that would require your eyes to look down and pause your thought process. This happened to me just now after I installed Flutter, and it seemed to me that physical gestures didn't interrupt my…

That's what I like most about it too. Love not having to switch screens to stop the music when a call comes in. One thing: I didn't find the installation super intuitive. Probably some room to improve that experience

By the way I see great application in this for education, particularly with smaller kids

Re: Show HN: Flutter - Control Spotify or iTunes Using Gestures thru Webcam

#48

Post by rsbaskin »

lukev wrote: post #25

This is awesome. However, music control isn't a pain point for me. What I would pay for is a start/pause gesture for Netflix/Hulu/Amazon Video. Worst thing about TV on a computer.

My friend and I looked into controlling those apps for a program we made to control media players with your voice called Shoevox - http://shoevox.org

The hard part was that we used sending keyboard shortcuts as our method of sending commands (which works for programs we support like WMP or VLC), but we couldn't do that reliably to Flash. We thought about switching to UI Automation but haven't done so yet.

Post reply on HN