Live data from Hacker News

3D Face Reconstruction from a Single Image

cs.nott.ac.uk

11–20 of 47 posts

Re: 3D Face Reconstruction from a Single Image

#11
post #4

It definitely constructs a face, but how accurate is it? Would be interesting to see a measurement of error against a known result. Maybe try rendering an image of a 3d model of a face, then attempt to reconstruct it from the rendered image and measure the displacement from the original model.

If you look at the .obj model file that you can download you can see exactly how accurate it it. The mesh is dense and the detail is not. The detail that it does have however is very plausible.

Re: 3D Face Reconstruction from a Single Image

#12
post #5
post #3

Earlier quoted context omitted.

Probably not. Apple specifically said that they've tested Face ID against masks (even Hollywood quality ones). Also, Face ID checks for user attention, so a static 3d-printed would not work. I wonder though if it worked if you put a mask over your face with eye cutouts? When the devices arrive I'm pretty sure some very clever people will try to tackle this problem, this should be interesting :)

Man are they good at marketing. They just knew this precise conversation would come up and created the perfect brief counter-argument preemptively ("hollywood quality masks").

Is it good marketing or engineering (the latter implies both)? I guess we'll find out soon enough.

Re: 3D Face Reconstruction from a Single Image

#13
post #5
post #3

Earlier quoted context omitted.

Probably not. Apple specifically said that they've tested Face ID against masks (even Hollywood quality ones). Also, Face ID checks for user attention, so a static 3d-printed would not work. I wonder though if it worked if you put a mask over your face with eye cutouts? When the devices arrive I'm pretty sure some very clever people will try to tackle this problem, this should be interesting :)

Man are they good at marketing. They just knew this precise conversation would come up and created the perfect brief counter-argument preemptively ("hollywood quality masks").

[deleted]

Re: 3D Face Reconstruction from a Single Image

#16
post #4

It definitely constructs a face, but how accurate is it? Would be interesting to see a measurement of error against a known result. Maybe try rendering an image of a 3d model of a face, then attempt to reconstruct it from the rendered image and measure the displacement from the original model.

It's fitting faces to some kind of assumed model.

I tried it on a few Japanese faces; it basically gave them a Caucasian-looking side profile: big foreheads with over-hanging eyebrow ridges; big noses.

Completely unrecognizable after turning more than a few degrees from front view.

Which is not to flame the project---nice work!---but as a potential improvement for certain applications, it would be useful to simply have these details as parameters that could be interactively tweaked.

Being able to adjust the overall roundness of the face, and prominence of the chin/forehead/nose would probably go a long way.

Re: 3D Face Reconstruction from a Single Image

#17
post #4

It definitely constructs a face, but how accurate is it? Would be interesting to see a measurement of error against a known result. Maybe try rendering an image of a 3d model of a face, then attempt to reconstruct it from the rendered image and measure the displacement from the original model.

If you look at the .obj model file that you can download you can see exactly how accurate it it. The mesh is dense and the detail is not. The detail that it does have however is very plausible.

One of the authors here. You are very right in saying that the there aren't many details. This limitation, we believe, is due to a lack of large, high quality training sets. The data we trained from was very smooth, which means our method is unable to pick out features such as wrinkles and dimples.

Re: 3D Face Reconstruction from a Single Image

#18
post #3
post #2

I wonder whether this could be used to crack face id.

Probably not. Apple specifically said that they've tested Face ID against masks (even Hollywood quality ones). Also, Face ID checks for user attention, so a static 3d-printed would not work. I wonder though if it worked if you put a mask over your face with eye cutouts? When the devices arrive I'm pretty sure some very clever people will try to tackle this problem, this should be interesting :)

> static 3d-printed would not work

right, but adding in fake eyeballs should do the trick.

For inspiration, check out how these guys fool Samsung's iris scanner: https://www.youtube.com/watch?v=4VrqufsHpS4

Re: 3D Face Reconstruction from a Single Image

#20
post #18
post #3

Earlier quoted context omitted.

Probably not. Apple specifically said that they've tested Face ID against masks (even Hollywood quality ones). Also, Face ID checks for user attention, so a static 3d-printed would not work. I wonder though if it worked if you put a mask over your face with eye cutouts? When the devices arrive I'm pretty sure some very clever people will try to tackle this problem, this should be interesting :)

> static 3d-printed would not work right, but adding in fake eyeballs should do the trick. For inspiration, check out how these guys fool Samsung's iris scanner: https://www.youtube.com/watch?v=4VrqufsHpS4

They mentioned an infrared camera, bet they're checking temperature too.
Post reply on HN