Very cool! I like the different modes. I've always been fascinated with this space and products like Leap Motion: https://www.youtube.com/watch?v=zXghYjh6Gro
Show HN: Controlling 3D models with voice and hand gestures
21–29 of 29 posts
Re: Show HN: Controlling 3D models with voice and hand gestures
#22Re: Show HN: Controlling 3D models with voice and hand gestures
#23Awesome, nice work! This type of tech opens up a world of physical games.
I made a demo game where you need to dodge the evil bouncing DVD logo by moving your body: https://x.com/measure_plan/status/1924830500541157570 I'm working on a couple other body movement concepts and hope to share soon :)
It uses a bit simpler approach, only detecting movement, but it works good enough for such games.
Re: Show HN: Controlling 3D models with voice and hand gestures
#24Sounds very cool, but I could not make sense of the on-screen instructions. Some images or animations would go a long way to explain the controls.
Sorry about that, the instructions need to be improved. Does this video demo help? https://x.com/measure_plan/status/1929900748235550912 If it makes it clearer, I'll upload it to the github repo directly
Great area to develop though. There's so much untapped potential in applying Mediapipe.
Re: Show HN: Controlling 3D models with voice and hand gestures
#25Amazing! Maybe use specific finger positions/gestures to trigger a rotation and scale functions (index finger up and within a bounding box of the model perhaps for rotation, similar for pinch to fingers to scale).
Re: Show HN: Controlling 3D models with voice and hand gestures
#26Earlier quoted context omitted.
Sorry about that, the instructions need to be improved. Does this video demo help? https://x.com/measure_plan/status/1929900748235550912 If it makes it clearer, I'll upload it to the github repo directly
That video did help. I think I was thrown off by two things: 1) I was expecting 3D controls with more direct mapping (e.g. rotating my hand rotates the model). This is more like gesture mouse controls. 2) Some of the controls were too subtle. The scaling between my gesture size and effect on screen was smaller than I expected. Great area to develop though. There's so much untapped potential in applying Mediapipe.
Re: Show HN: Controlling 3D models with voice and hand gestures
#27Re: Show HN: Controlling 3D models with voice and hand gestures
#28Slightly on topic - anyone remember LeapMotion and is anyone aware of any current support for that? Found an original one in a drawer when I was having a clearout the other day
Re: Show HN: Controlling 3D models with voice and hand gestures
#29Amazing! Maybe use specific finger positions/gestures to trigger a rotation and scale functions (index finger up and within a bounding box of the model perhaps for rotation, similar for pinch to fingers to scale).
I'll try it, thank you! I separated them into completely different interaction modes to avoid misfires, but there's definitely room for efficiencies