Show HN: YoHa – A practical hand tracking engine • Hacker News Board

Show HN: YoHa – A practical hand tracking engine

#1

Post by b-3-n » Mon, Oct 11, 2021, 7:41 AM UTC

Show HN: YoHa – A practical hand tracking engine
handtracking.io

Re: Show HN: YoHa – A practical hand tracking engine

#2

Post by gitgud » Mon, Oct 11, 2021, 11:16 AM UTC

The demo really sells it here [1]. It's amazingly intuitive and easy to use, it should be a part of video-conferencing software.

[1] https://handtracking.io/draw_demo/

Re: Show HN: YoHa – A practical hand tracking engine

#3

Post by iainctduncan » Mon, Oct 11, 2021, 2:41 PM UTC

Hi, I'm not sure if you've looked into this or not, but another area that is interested in this sort of thing and might be very excited is musical gesture recognition.

Re: Show HN: YoHa – A practical hand tracking engine

#4

Post by b-3-n » Mon, Oct 11, 2021, 3:04 PM UTC

iainctduncan wrote: post #3

Hi, I'm not sure if you've looked into this or not, but another area that is interested in this sort of thing and might be very excited is musical gesture recognition.

Hey, I believe there are multiple things you could have meant. From the top of my head one thing that might be interesting would be an application that allows conductors to conduct a virtual orchestra. But there are other possibilities in this space too I'm sure! If you had something else in mind feel free to share.

I have not explored this space much so far as my focus is rather to build the infrastructure that enables such applications rather than building the applications myself.

Re: Show HN: YoHa – A practical hand tracking engine

#5

Post by b-3-n » Mon, Oct 11, 2021, 3:06 PM UTC

gitgud wrote: post #2

The demo really sells it here [1]. It's amazingly intuitive and easy to use, it should be a part of video-conferencing software. [1] https://handtracking.io/draw_demo/

Thank you for the feedback. Such an integration would be nice indeed.

Re: Show HN: YoHa – A practical hand tracking engine

#6

Post by tomcooks » Mon, Oct 11, 2021, 4:48 PM UTC

This is a GREAT website, I can understand what it does with zero clicks, zero scrolls.

Really great, congratulations, I hope that I can find a way to apply this lesson to my SaaS.

Re: Show HN: YoHa – A practical hand tracking engine

#7

Post by tomcooks » Mon, Oct 11, 2021, 4:50 PM UTC

BTW this would be great for spaced repetition foreign character learning (Chinese, Arabic, Japanese, Korean, etc.): if the drawn figure is similar enough to the character the student is learning mark it as studied.

Congrats again

Re: Show HN: YoHa – A practical hand tracking engine

#8

Post by b-3-n » Mon, Oct 11, 2021, 4:58 PM UTC

tomcooks wrote: post #7

BTW this would be great for spaced repetition foreign character learning (Chinese, Arabic, Japanese, Korean, etc.): if the drawn figure is similar enough to the character the student is learning mark it as studied. Congrats again

Thank you for your feedback and for sharing this potential use case. I think it is a very creative idea.

Re: Show HN: YoHa – A practical hand tracking engine

#9

Post by smoyer » Mon, Oct 11, 2021, 4:59 PM UTC

I've been working on a couple of chording keyboard designs and was thinking I might be able to create a virtual keyboard using this library. It would be nice to also be able to recognize the hand from the back. A keyboard would also obviously be necessary to track two hands at a time.

How does the application deal with different skin-tones?

Re: Show HN: YoHa – A practical hand tracking engine

#10

Post by programmarchy » Mon, Oct 11, 2021, 5:04 PM UTC

Was wondering how easy it'd be to port to native mobile, so went looking for the source code, but doesn't appear to actually be open source. The meat is distributed as binary (WASM for "backend" code and a .bin for model weights).

Aside from being a cool hand tracker, it's a very clever way to distribute closed source JavaScript packages.