I think these tools are super interesting, but I tools like this marginalize users with non-standard number of limbs or fingers.
Show HN: YoHa – A practical hand tracking engine
11–20 of 67 posts
Re: Show HN: YoHa – A practical hand tracking engine
#12I think these tools are super interesting, but I tools like this marginalize users with non-standard number of limbs or fingers.
What do you suggest be done about it?
Re: Show HN: YoHa – A practical hand tracking engine
#13I've been working on a couple of chording keyboard designs and was thinking I might be able to create a virtual keyboard using this library. It would be nice to also be able to recognize the hand from the back. A keyboard would also obviously be necessary to track two hands at a time. How does the application deal with different skin-tones?
That's an interesting idea. I have not tried to build something similar but a humble word of caution that I want to put out is that no matter what kind of ML you use the mechanical version of the instrument will always be more precise (you likely are aware of it, just want to make sure). However, you might be able to approximate precision of the mechanical version.
Two hand support would be nice and I would love to add it in the future.
The engine should work well with different skin tones as the training data was collected from a set of many and diverse individuals. The training data will also grow further over time making it more and more robust.
Re: Show HN: YoHa – A practical hand tracking engine
#14An "undo" gesture seems necessary, it was a bit too easy to accidentally wipe the screen. Aside from that, this is fantastic! Love to see what WASM is enabling these days on the web.
Re: Show HN: YoHa – A practical hand tracking engine
#15Was wondering how easy it'd be to port to native mobile, so went looking for the source code, but doesn't appear to actually be open source. The meat is distributed as binary (WASM for "backend" code and a .bin for model weights). Aside from being a cool hand tracker, it's a very clever way to distribute closed source JavaScript packages.
Thank you for the feedback. You are right that the project is not open source right now. It's "only" MIT licensed. That's why I also don't advertise it as open source (if you see the word open source somewhere it would be a mistake on my end, feel free to tell me if you see it somewhere). I wanted to start out from just an API contract so that it is easier to manage and get started. In general I have no problem open sourcing the JS part. But first there is some refactoring to do so it is easier to maintain upon open sourcing. Stay tuned!
As a side note: The wasm files are actually from the inference engine (tfjs).
Please let me know if you have any more questions in that regard.
Re: Show HN: YoHa – A practical hand tracking engine
#16I think these tools are super interesting, but I tools like this marginalize users with non-standard number of limbs or fingers.
This is a very valid point, but as a counter argument the technique implemented here could be adapted to help users with other needs like say, a browser extension that can help you navigate back and forward with the blink of an eye.
Re: Show HN: YoHa – A practical hand tracking engine
#17Hi, I'm not sure if you've looked into this or not, but another area that is interested in this sort of thing and might be very excited is musical gesture recognition.
Also look at leap motion.
https://www.ultraleap.com/product/leap-motion-controller/ (tip: mouser has them in stock and usually the best price) with midipaw http://www.midipaw.com/ (free)
Latency is very low which is very important for this use case. Look on YouTube for demos.
Re: Show HN: YoHa – A practical hand tracking engine
#18My first question is whether this has the capability of being adapted to interpret/translate American Sign Language (ASL)?
Re: Show HN: YoHa – A practical hand tracking engine
#19[deleted]
Re: Show HN: YoHa – A practical hand tracking engine
#20[deleted]
[deleted]