Live data from Hacker News

Apple is sharing your facial wireframe with apps

washingtonpost.com

51–60 of 152 posts

Re: Apple is sharing your facial wireframe with apps

#51
post #50

You know how some F2P games will allow you to watch video ads in order to e.g. earn extra in-game currency, activate a point multiplier, etc? As it stands, you can start one of these ads and then turn your phone upside down, or look away. How long until an advertising provider makes use of the attention API and makes it so that you can't look away? Seems bleak.

"15 Million Credits" from Black Mirror vibes there.

Re: Apple is sharing your facial wireframe with apps

#52
post #12

Earlier quoted context omitted.

> I'm honestly less worried about Apple than others. That's a pretty low bar. Yes, Apple at least gives lip service to security which other companies don't even bother to do, but Apple has had some pretty major security screwups lately (three in the last few weeks). You might be less worried about Apple than the competition, but you'd do well to be somewhat worried about them nonetheless.

Two other issues I'm worried about with iOS: - MAC address tracking (RTS packets thrwart MAC randomization[0], not immediately clear if WiFi is fully off[1]) - All-or-nothing access to photos on the phone (append-only for apps that request it) Discord in particular is bad for the photo permission, as I don't trust China's Tencent with access to all the photos on my phone (which can include lots of frequent location i…

Does Tencent not have an extension that pops up in the sharing sheet for images?

Re: Apple is sharing your facial wireframe with apps

#53
post #50

You know how some F2P games will allow you to watch video ads in order to e.g. earn extra in-game currency, activate a point multiplier, etc? As it stands, you can start one of these ads and then turn your phone upside down, or look away. How long until an advertising provider makes use of the attention API and makes it so that you can't look away? Seems bleak.

The good thing is that the first time an app does that you can just delete it.

You also don't have to use FaceID for your phone. You can just create an alpha numeric code if you'd like and use that as your password.

Re: Apple is sharing your facial wireframe with apps

#54
post #50

You know how some F2P games will allow you to watch video ads in order to e.g. earn extra in-game currency, activate a point multiplier, etc? As it stands, you can start one of these ads and then turn your phone upside down, or look away. How long until an advertising provider makes use of the attention API and makes it so that you can't look away? Seems bleak.

As far as I know there's no "Attention" API. It also seems intentional that Apple has omitted an eye-tracking API as well (even though it seems like that would be trivial for them to add from a technical perspective)

Is there anything stopping them from doing this with the front-facing camera on existing phones?

Re: Apple is sharing your facial wireframe with apps

#56

Earlier quoted context omitted.

Apps get a coarse depth map - this cannot be used to replicate your face in perfect 3D, nor can it be used to bypass FaceID.

I'm not a security expert but this seems like are giving out a coarse approximation of my username (that has no password protection). I would think it is significantly easier to break into FaceID starting with the coarse depth map than no depth map at all. But again, I could just be out of my depth on this topic and the difference isn't that big of a deal?

It's possible but I 3D printed the face mesh from their API and it didn't work to unlock Face ID on my phone.

It did a pretty good job of scanning my face though: https://twitter.com/braddwyer/status/930594896523567104

Re: Apple is sharing your facial wireframe with apps

#57
post #13

I've been playing with the TrueDepth Camera APIs on the iPhone X. Some things I've noticed: 1) The ARKit "Face Mesh" seems to be a standard model that is scaled and skewed to fit your face (for example, it ignores glasses, still works if you put your hand in front of your face, etc). It is _not_ a 3D scan. 2) The "TrueDepth" data is not really all that granular. It seems similar to the depth map you get from the rear…

Re 3) I don’t know any details of Apples implementation, but typically computer vision algorithms integrate data from multiple sensors to generate a 3D model. The more data you have, the more robust the output will be.

It’s possible to generate reasonable 3D models of faces from a single photograph. [1]

The highest resolution 3D scans I’ve seen are produced by aligning data from multiple high resolution photographies.

The big problem with that aproach is that it requires a lot of detail in the source material. Smooth surfaces, blurry images, or noise because of poor lighting makes it impossible for the algorithm to find features to align.

This is where the dot matrix projector comes in: by projecting a bunch of dots on your face, you get features that the algorithm can align, making the scan faster and more robust in low light.

[1]: http://kunzhou.net/2015/hqhairmodeling.pdf

Re: Apple is sharing your facial wireframe with apps

#58

Earlier quoted context omitted.

> What if I don't want to have my face scanned, but nevertheless need to pick up somebody's lost-phone/detonation-device? Shall I just wear a mask? Well...yeah. If you're out in public and your face is visible, you don't have a reasonable expectation of privacy.

What does this have to do with "out in public"? I have by law, custom, and common sense an expectation of not being 3D-scanned in a gas station bathroom, even if I pick up the phone that the previous visitor had dropped on the floor.

Honestly, I can't fathom why you're being downvotes, and this is exactly the predicament I'm most concerned about, personally.

Like, its a cool technology - sure. But has nobody thought of the militarisation of it? Sheesh.

Re: Apple is sharing your facial wireframe with apps

#59

What is this 'facial wireframe' this Jeff Bezos owned newspaper is speaking about? Looks invented just to write this article.

It's unclear whether he's talking specifically about the ARSCNFaceGeometry[1] or the ARFrame.capturedDepthData[2] or some combination of both.

[1] https://developer.apple.com/documentation/arkit/arscnfacegeo...

[2] https://developer.apple.com/documentation/arkit/arframe/2928...

Re: Apple is sharing your facial wireframe with apps

#60
post #7

I'm honestly less worried about Apple than others. They've at least made some measures to prove that they are willing to go some distance to protect privacy, even losing ground to competitors in voice recognition. Now thinking about co's like Facebook that not only has access to far more imagery of faces tied to sentiments and moments but have shown time and time again that privacy is a secondary concern AND that the…

[deleted]
Post reply on HN