Live data from Hacker News

Show HN: AirBending – Hand gesture based macOS app MIDI controller

nanassound.com

11–20 of 27 posts

Re: Show HN: AirBending – Hand gesture based macOS app MIDI controller

#14
That looks great!

Do you have any suggestion for how to learn how to hook this up to Logic for anyone who hasn’t used midi before?

I wonder how this would perform under live stage lighting conditions, i.e coloured strong lights and high contrast.

Re: Show HN: AirBending – Hand gesture based macOS app MIDI controller

#15

That looks great! Do you have any suggestion for how to learn how to hook this up to Logic for anyone who hasn’t used midi before? I wonder how this would perform under live stage lighting conditions, i.e coloured strong lights and high contrast.

Open the app and open Logic Pro. Create a MIDI track on Logic, try waving to the app it should automatically receive MIDI message from all channels and all MIDI devices.

Then if you want to filter the track to receive specific MIDI channel from specific device, for example AirBending channel 2, then find it in the dropdown in the MIDI inspector section in the same MIDI track.

Re: Show HN: AirBending – Hand gesture based macOS app MIDI controller

#18

Not just a ‘theremin’ — that totally downplays the power of midi. Someone else mentioned the mimu gloves, and I love the idea of a vision based controller - almost everyone has a phone, tablet or laptop with a camera, especially if theyre making music. I also love that this could blur the lines of music playing and dance. Great job OP, thanks for sharing.

The Leap Motion Controller came out in 2014 already (11 years ago, wow!) and isn't very expensive. The SDK was lacking in the beginning if I recall correctly, but a webcam seems to be inferior. Technology isn't the limiting factor for a quite some time now. I'm sure many projects existed to translate gestures to MIDI, some less polished, some more polished[0][1].

Reminds me... I even used two PlayStation Eyes (EUR 5 each) with OpenCV and the EVM algorithm[2] on a ThinkPad X230 for a dance performance piece back in 2015. Movements rather than gestures and OSC instead of MIDI, but it worked great!

[0]: https://midipaw.com/

[1]: https://uwyn.com/geco/

[2]: https://people.csail.mit.edu/mrub/evm/

Re: Show HN: AirBending – Hand gesture based macOS app MIDI controller

#19

I wonder if Linux version will be available.

Since I developed it using Vision framework from Apple, the current focus is still for Apple devices. So, not in the near future to develop for Linux and Windows.

Thanks for the confirmation!
Post reply on HN