Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: YoHa – A practical hand tracking engine

handtracking.io

Post reply on HN
Print view View original

41–50 of 67 posts

Re: Show HN: YoHa – A practical hand tracking engine

#41

Post by mkl »

itake wrote: post #36
rpmisms wrote: post #27

Earlier quoted context omitted.

So does the real world. Things are hard to do with disabilities. That's what the word means. This has great potential, and it's not worth shutting down because some people aren't able to use it. I can also see this being very helpful for people who have cerebral palsy, for example. Larger movements are easier, this might help someone use the web more easily.

What if a bank used this for authentication and disable people can't use their custom interface devices? Does that mean that disabled people shouldn't access to their bank accounts? Maybe if this was the input device that interacts with the standard web, then there is potential here, but it would be unfortunate if a company used this as a primary means of input.

That's the bank's mistake, not this library's.

Re: Show HN: YoHa – A practical hand tracking engine

#42

Post by layer8 »

What would be nice is a version that can be used to paint on the screen with your fingers, such that the lines are visible on a remotely shared screen. The use-case is marking up/highlighting on a normal desktop monitor (i.e. non-touch) while screen-sharing, which is awkward using a mouse or touchpad (think circling stuff in source code and documents, drawing arrows etc.). That would mean (a) a camera from behind (facing the screen), so that the fingers can touch (or almost touch) the screen (i.e. be co-located to the screen contents you want to markup), and (b) native integration, so that the painting is done on a transparent always-on-top OS window (so that it's picked up by the screen-sharing software); or just as a native pointing device, since such on-screen painting/diagramming software already exists.

Re: Show HN: YoHa – A practical hand tracking engine

#43

Post by rafamct »

b-3-n wrote: post #28
inetsee wrote: post #18

My first question is whether this has the capability of being adapted to interpret/translate American Sign Language (ASL)?

Thank you for this inspiring question. For interpreting sign language you need multi-hand support which YoHa is currently lacking. Apart from that you likely also need to account for the temporal dimension which YoHa also does not do right now. If those things were implemented I'm confident that it would produce meaningful results.

It's worth noting that movements of the mouth are extremely important in ASL (and other sign languages) and so this probably isn't as useful as it might seem at first.

Re: Show HN: YoHa – A practical hand tracking engine

#46

Post by eminence32 »

The demo doesn't seem to work on my chromebook. Maybe it's too underpowered?

Web page doesn't say anything after `Warming up...` and the latest message in the browser console is:

    Setting up wasm backend.
I expected to see a message from my browser along the lines of "Do you want to let this site use your camera", but I saw no such message.

Re: Show HN: YoHa – A practical hand tracking engine

#47

Post by boxfire »

programmarchy wrote: post #10

Was wondering how easy it'd be to port to native mobile, so went looking for the source code, but doesn't appear to actually be open source. The meat is distributed as binary (WASM for "backend" code and a .bin for model weights). Aside from being a cool hand tracker, it's a very clever way to distribute closed source JavaScript packages.

This architecture was also used in the link referenced when bringing up alternative implementations:

https://github.com/google/mediapipe/issues/877#issuecomment-...

Re: Show HN: YoHa – A practical hand tracking engine

#48

Post by cloudking »

b-3-n wrote: post #5
gitgud wrote: post #2

The demo really sells it here [1]. It's amazingly intuitive and easy to use, it should be a part of video-conferencing software. [1] https://handtracking.io/draw_demo/

Thank you for the feedback. Such an integration would be nice indeed.

You could integrate it with all video-conferencing software building it as a virtual camera plug-in that works with OBS

Re: Show HN: YoHa – A practical hand tracking engine

#49

Post by canada_dry »

smoyer wrote: post #9

I've been working on a couple of chording keyboard designs and was thinking I might be able to create a virtual keyboard using this library. It would be nice to also be able to recognize the hand from the back. A keyboard would also obviously be necessary to track two hands at a time. How does the application deal with different skin-tones?

Similar thought here. I'd like to track two hands above a real keyboard (size/position established via 2 X QR stickers) to feed into a VR piano training simulation.

The tech is all there, really it's just having the time and effort to get all the pieces together!

Post reply on HN