Live data from Hacker News

On-Device, Real-Time Hand Tracking with MediaPipe

ai.googleblog.com

51–60 of 70 posts

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#51
post #48

Earlier quoted context omitted.

My thoughts exactly. Ten or 15 years ago I would think "cool, they are going to make something awesome with it". Three years ago: "they'll shut it down when they get another exciting idea". Today: "userbinator beat me to it only I am worried they will come up with something worse". Sorry to all googlers here. I'm trying not picking on you individually but the company you work for has worked long and hard to erode mou…

It’s an open source library, so you can’t “shut it down”, it’s a gift to the community and people can continue to use it if Google doesn’t. Honestly these kinds of comments are getting silly and applied out of context, it’s almost like there needs to be. Godwin’s law for dredging up Reader’s cancellation or conspiracy theories about how finger tracking is going to be used for ad recommendation.

Edit: upvoted for the point that it is open source.

I never cared about Reader.

For me it was 5 or 10 or even more different other things like

- Killing xmpp through extend, embrace extinguish

- Creating Google+ without making it open

- Killing Google+

- ReCaptcha v2 and v3

- Constantly pushing the boundaries for tracking, now also buying credit card logs

- etc etc

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#52
post #46
post #42

Earlier quoted context omitted.

> A combination voice recognition + gesture recognition + eye tracking would make ... retail surveillance much more effective and privacy eroding...

if they do it all on device and do not transmit out, then the privacy concern seems squelched. On retail tracking yeah it's messed, practically no one knows their movements are tracked on their phones - cell tower triangulation, GPS, then the kicker NFC. I love / hate tech. It's powerful stuff. [edit] - the cell tower triangulation is forever given the nature of the tech.

Cell tower is rather trilateration, right?

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#53
post #46
post #42

Earlier quoted context omitted.

> A combination voice recognition + gesture recognition + eye tracking would make ... retail surveillance much more effective and privacy eroding...

if they do it all on device and do not transmit out, then the privacy concern seems squelched. On retail tracking yeah it's messed, practically no one knows their movements are tracked on their phones - cell tower triangulation, GPS, then the kicker NFC. I love / hate tech. It's powerful stuff. [edit] - the cell tower triangulation is forever given the nature of the tech.

GPS is passive and NFC is very short range. I think it'd be easier to track people by bluetooth or wifi MAC.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#55
post #21

Earlier quoted context omitted.

Why would it be useful to have technology detect signals? Aren't people already going to be doing it? Genuine question, I don't know how baseball works.

Hand signals are commonly used in baseball to surreptitiously communicate intent to teammates without giving away your strategy to opponents. I think what GP was getting at is that this technology could be used to automate the reading of hand signals. I'm not sure it would be effective, as the pro baseball players are already quite sophisticated at both reading and obfuscating hand signals, at least at the highest le…

I'm not sure if the complexity of the codes is significantly higher in the pro teams, but I found this video on baseball code decoding pretty fun.

https://youtu.be/PmlRbfSavbI

Combined with this, it certainly seems like there's potential for a fully automated pipeline

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#56

Given the company behind it, I can't get out of my head the thought that this will find a lot of other applications... Please give a thumbs-up to acknowledge your engagement with this ad Sorry, the middle finger is not acceptable. Please give a thumbs-up.

https://www.techdirt.com/articles/20141101/07493529015/dysto...

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#57
post #46

Earlier quoted context omitted.

if they do it all on device and do not transmit out, then the privacy concern seems squelched. On retail tracking yeah it's messed, practically no one knows their movements are tracked on their phones - cell tower triangulation, GPS, then the kicker NFC. I love / hate tech. It's powerful stuff. [edit] - the cell tower triangulation is forever given the nature of the tech.

Cell tower is rather trilateration, right?

I believe the scale is too small for height to make an impact.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#58
post #43

Earlier quoted context omitted.

Probably because it uses TensorFlow (lite) and there aren't many (any?) VPLs supporting C++ integration. And also Google has NIH syndrome, it's hard to think of any outside projects they use besides the Linux software stack and LLVM.

Python? Git?

Git is mainly for external consumption. They've got their own VCS called Piper that comes with a client called CitC (sit-see).

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#59
post #11

The underlying project MediaPipe looks pretty cool: https://github.com/google/mediapipe/blob/master/mediapipe/do... I wonder why they didn't build it on top of one of the gazillion flow-based visual programming languages instead?

Probably because it uses TensorFlow (lite) and there aren't many (any?) VPLs supporting C++ integration. And also Google has NIH syndrome, it's hard to think of any outside projects they use besides the Linux software stack and LLVM.

Google depends on thousands of external software projects.

They heavily support a VPL, Scratch.

Re: On-Device, Real-Time Hand Tracking with MediaPipe

#60
post #39

Earlier quoted context omitted.

> so little Nature took 85 million years to perfect the hand, and dexterous use takes 1-2 years of training for babies. Interpreting the hands of other takes longer.

Try drawing hands. (If you're a non-artist like myself.) It's impressively hard --- they are complex artefacts we can't quite see clearly because we are so used to them. There are a lot of, as it were, polygons. If, after staring at these things for several decades, I still can't draw them with my eyes closed, I will assume that an AI would not find it easy to think about them either.

I think it’s the opposite problem. I can see an AI being able to very easily draw what it sees but struggle at interpreting it. When you learn to draw, one of the first step is relearning to see without interpretation. A better example is example is how kids draw stick figures so easily and how hard it is for computer to do so: for decades we had to put reflector interpreted as dots used to render vector... use to render stick figures
Post reply on HN