Viewing profile — getToTheChopin

Thank you! I spent a lot of time tuning the synth parameters in tonejs to try to get something I was happy with. The scales are based on the Japanese "in" pentatonic scale (sometim…

I'm experimenting with a musical instrument design, using hand rotation to change tempo and note cycles. Created with javascript, mediapipe computer vision, tonejs, threejs. This r…

* level 1: show a banana * level 2: slice 20 fruits * level 3: play snake with your head built with tensorflow, mediapipe computer vision, threejs, vanilla javascript this project …

here's the demo video on youtube as well: https://youtu.be/XBn5F72aIbg

thank you. I thought of this on a roadtrip and was very keen to start building it when I got home.

I made a hands-free HN reader using speech and face recognition Speak to navigate the feed; eat doritos to scroll an article Live demo (please use Desktop Chrome): https://funwithc…

This uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) Also using threejs for visuals and tonejs for …

I'm creating a fitness game on the web, where you do exercises to save pets Here's a live demo (camera access required): https://www.funwithcomputervision.com/chinup/ I've added pu…

I made a game that forces me to work out Do a chin-up, save a cat! Created with mediapipe AI vision (for body tracking) and threejs (for visuals and animations) It runs in real-tim…

I made a body movement game. You jump around your living room to dodge lava. Created with threejs and mediapipe computer vision. You can play the game here, it runs on the web with…

This is a computer vision experiment, using voice + hand gestures to control a shader animation. This uses a liquid Chladni pattern, with controls for color and wave frequency / am…

Hand-controlled arpeggiator, drum machine, and audio reactive visualizer. Runs in real-time in the browser. Built with threejs, mediapipe computer vision, and tone.js. Video demo: …

This is a demo video showing a hand-controlled arpeggiator, drum machine, and audio reactive visualizer Runs in real-time on the web, using a laptop webcam Created with threejs, ro…

Created using threejs, mediapipe computer vision, and rosebud AI. Runs in real-time in the browser. Live demo: https://rosebud.ai/p/3683087f-5fed-4e2c-9db2-d31831a5cf46 I'm plannin…

Thank you for the feedback. I'll continue to work on it!

I'll try it, thank you! I separated them into completely different interaction modes to avoid misfires, but there's definitely room for efficiencies

It's a shame that computer vision tech like Leap / Eyetoy / Kinect didn't have lasting power. So much fun to build with

I made a demo game where you need to dodge the evil bouncing DVD logo by moving your body: https://x.com/measure_plan/status/1924830500541157570 I'm working on a couple other body …

Good points, maybe a second camera (phone?) pointed downwards at the tabletop would be good for that. Then the user can rest their hands in a "normal" position. Thank you for the f…

yes I'd love to go further with this concept so that 3D / CAD designers could easily present their models during video calls. thank you!

Sorry about that, the instructions need to be improved. Does this video demo help? https://x.com/measure_plan/status/1929900748235550912 If it makes it clearer, I'll upload it to t…

Here's a quick video demo showing how it works: https://x.com/measure_plan/status/1929900748235550912

I'm sharing my project to control 3D models with voice commands and hand gestures: - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gesture…