The underlying project MediaPipe looks pretty cool: https://github.com/google/mediapipe/blob/master/mediapipe/do...
I wonder why they didn't build it on top of one of the gazillion flow-based visual programming languages instead?
On-Device, Real-Time Hand Tracking with MediaPipe
11–20 of 70 posts
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#12This is neat. I'm curious about a limitation though.
Was this trained on people with missing or partially missing digits? Like if someone is missing the top part of their third and fourth finger does it always predict Spiderman or Rock for an open hand?
I don't think this is a necessary thing for an openly released piece of software that's not aimed at edge cases like these. I'm just curious about limitations and how it deals with edge cases. I also don't currently have a friend with a missing finger to test with.
(Also you could probably fine tune this model to pick up those cases. Would be curious how good results would be because I imagine it'd be difficult)
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#13Cant wait for the pixel 4. No doubt this will be put to use.
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#14I'd like to see this kind of technology employed in VR headsets to allow for more natural interaction using my hands and fingers instead of controllers.
You can buy a LeapMotion and stick it to the front of Rift right now. I've done it, it's amazingly immersive and feels fantastic.
I really wonder how this compares to the LeapMotion tracking. My suspicion is that the leap tracking is now hardened by years of real world experience, so it's probably ahead of anything that's still in the R&D stage. But hard to know without testing it.
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#15Remember that HN post the other day about someone going on a massive mission on voice recog because they can't use a mouse due to pain? Stuff like this makes me hopeful even if it seems like a gimmick when viewed in isolation.
Remember that HN post the other day
No. Link? Or can you remember any other details?
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#16Remember that HN post the other day about someone going on a massive mission on voice recog because they can't use a mouse due to pain? Stuff like this makes me hopeful even if it seems like a gimmick when viewed in isolation.
Remember that HN post the other day No. Link? Or can you remember any other details?
If I'm thinking of the same thread, the mentioned user created a speech to text accessibility platform with a partner developer (2 people operation) for disabled users.
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#17Thinking of all the baseball applications here: catcher signals, third base coach, head coach etc.
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#18Remember that HN post the other day about someone going on a massive mission on voice recog because they can't use a mouse due to pain? Stuff like this makes me hopeful even if it seems like a gimmick when viewed in isolation.
Remember that HN post the other day No. Link? Or can you remember any other details?
http://nsaphra.github.io/post/hands/
This one perhaps
Re: On-Device, Real-Time Hand Tracking with MediaPipe
#19Cant wait for the pixel 4. No doubt this will be put to use.
There is this, from July: https://www.youtube.com/watch?v=KnRbXWojW7c