I’ve been doing something similar to control racing video games while biking on an indoor exercise bike. I convert pedal speed into brake and acceleration keys (there’s some middle amount of pedaling that’s neutral) with pynput. I used OpenCV for webcam input and MediaPipe’s models to convert lean angle into left and right keyboard presses, and head tilt into up and down. It’s really fun but the slight latency in recognizing my pose is tough for fast courses. Now I’m thinking about some Arduino with a sensor or low res IR camera or something else that could detect changes a lot quicker.
Show HN: Gamebody, a full-body game controller
21–30 of 31 posts
Re: Show HN: Gamebody, a full-body game controller
#22I'm still sad the MS didn't stick to their kinect concept.
Re: Show HN: Gamebody, a full-body game controller
#23Re: Show HN: Gamebody, a full-body game controller
#24I’ve been doing something similar to control racing video games while biking on an indoor exercise bike. I convert pedal speed into brake and acceleration keys (there’s some middle amount of pedaling that’s neutral) with pynput. I used OpenCV for webcam input and MediaPipe’s models to convert lean angle into left and right keyboard presses, and head tilt into up and down. It’s really fun but the slight latency in rec…
People like you exist and do stuff like that and yet no one has an upgraded version of the NES Zapper after all these years.
Re: Show HN: Gamebody, a full-body game controller
#25I’ve been doing something similar to control racing video games while biking on an indoor exercise bike. I convert pedal speed into brake and acceleration keys (there’s some middle amount of pedaling that’s neutral) with pynput. I used OpenCV for webcam input and MediaPipe’s models to convert lean angle into left and right keyboard presses, and head tilt into up and down. It’s really fun but the slight latency in rec…
People like you exist and do stuff like that and yet no one has an upgraded version of the NES Zapper after all these years.
Any VR shooting game?
Re: Show HN: Gamebody, a full-body game controller
#26This reminded me of the full body keyboard controller someone else shared a few weeks back... My ideas for body games are growing https://github.com/everythingishacked/Semaphore
Same author!
Re: Show HN: Gamebody, a full-body game controller
#27Re: Show HN: Gamebody, a full-body game controller
#28this goes so hard. I think I would prefer this to vr.
Re: Show HN: Gamebody, a full-body game controller
#29I'm still sad the MS didn't stick to their kinect concept.
Yeah, it is a pity. You can still buy their Azure Kinect DK Developer kit, though.
Re: Show HN: Gamebody, a full-body game controller
#30Wow! I've built dozens of stabs at exactly this and the consistency you've achieved is really good! Cool. Very cool.