On-Device, Real-Time Hand Tracking with MediaPipe

#1

Post by neversaydie » Fri, Aug 30, 2019, 9:37 PM UTC

On-Device, Real-Time Hand Tracking with MediaPipe
ai.googleblog.com

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#2

Post by controlweather » Fri, Aug 30, 2019, 10:15 PM UTC

Yes! Build for oculus quest

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#3

Post by jedimastert » Fri, Aug 30, 2019, 10:18 PM UTC

I've started to get really interested in lower-budget and/or easier motion tracking for special effects. I've been looking at optical motion tracking with a multi camera setup, and optical facial tracking. With the right math and assumptions, you could capture a full performance with little to no specialized equipment. I've been wondering if ML could output enough detail to make it feasible.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#4

Post by Havoc » Fri, Aug 30, 2019, 10:19 PM UTC

Remember that HN post the other day about someone going on a massive mission on voice recog because they can't use a mouse due to pain?

Stuff like this makes me hopeful even if it seems like a gimmick when viewed in isolation.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#5

Post by krilly » Fri, Aug 30, 2019, 10:36 PM UTC

Wasn't this posted here about 2 days ago?

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#6

Post by scribu » Fri, Aug 30, 2019, 10:41 PM UTC

krilly wrote: post #5

Wasn't this posted here about 2 days ago?

11 days ago, but with no comments: https://news.ycombinator.com/item?id=20739a577

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#7

Post by neversaydie » Fri, Aug 30, 2019, 10:47 PM UTC

krilly wrote: post #5

Wasn't this posted here about 2 days ago?

Might have been, sorry - came across this via a fresh story on Gamasutra this evening, just realised the original blog post is from last week.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#8

Post by thorum » Fri, Aug 30, 2019, 10:51 PM UTC

I'd like to see this kind of technology employed in VR headsets to allow for more natural interaction using my hands and fingers instead of controllers.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#9

Post by auslander » Fri, Aug 30, 2019, 10:57 PM UTC

realtime hard tracking tech. Typo.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#10

Post by TheRealSteel » Fri, Aug 30, 2019, 11:01 PM UTC

thorum wrote: post #8

I'd like to see this kind of technology employed in VR headsets to allow for more natural interaction using my hands and fingers instead of controllers.

You can buy a LeapMotion and stick it to the front of Rift right now. I've done it, it's amazingly immersive and feels fantastic.