ML turns video of a 360° turn into 3D model of a person

#1

Post by mikeyanderson » Sat, Apr 14, 2018, 2:21 PM UTC

ML turns video of a 360° turn into 3D model of a person
sciencemag.org

Re: ML turns video of a 360° turn into 3D model of a person

#2

Post by mtgx » Sat, Apr 14, 2018, 2:49 PM UTC

This is what should give you pause before using face authentication technology for anything.

Re: ML turns video of a 360° turn into 3D model of a person

#3

Post by symisc_devel » Sat, Apr 14, 2018, 4:07 PM UTC

Link to the paper: https://arxiv.org/abs/1803.04758

Re: ML turns video of a 360° turn into 3D model of a person

#4

Post by egypturnash » Sat, Apr 14, 2018, 4:39 PM UTC

As an artist, my first thought is I wonder what happens if you try giving this a series of drawings.

Re: ML turns video of a 360° turn into 3D model of a person

#5

Post by codetrotter » Sat, Apr 14, 2018, 4:48 PM UTC

This is awesome. I wish someone will implement this as a piece of open source software. Imagine the potential!

Re: ML turns video of a 360° turn into 3D model of a person

#6

Post by nitrogen » Sat, Apr 14, 2018, 5:01 PM UTC

Structure from motion is an existing technique. What is the contribution of ML in this case (it seems like joint positioning maybe?)?

https://en.m.wikipedia.org/wiki/Structure_from_motion

Re: ML turns video of a 360° turn into 3D model of a person

#7

Post by fsloth » Sat, Apr 14, 2018, 5:09 PM UTC

nitrogen wrote: post #6

Structure from motion is an existing technique. What is the contribution of ML in this case (it seems like joint positioning maybe?)? https://en.m.wikipedia.org/wiki/Structure_from_motion

SFM does not automatically provide joint locations. Also, a casual 360 video around a subject does not provide enough data for producing a full body mesh.

Re: ML turns video of a 360° turn into 3D model of a person

#8

Post by interfixus » Sat, Apr 14, 2018, 5:18 PM UTC

It seems determined to put visible toes on everybody, no matter that they're wearing socks.

Is this a bug or a feature?

Re: ML turns video of a 360° turn into 3D model of a person

#9

Post by haZard_OS » Sat, Apr 14, 2018, 5:42 PM UTC

mtgx wrote: post #2

This is what should give you pause before using face authentication technology for anything.

Can you elaborate?

Re: ML turns video of a 360° turn into 3D model of a person

#10

Post by toomuchtodo » Sat, Apr 14, 2018, 6:35 PM UTC

haZard_OS wrote: post #9

mtgx wrote: post #2

This is what should give you pause before using face authentication technology for anything.

Can you elaborate?

Makes forging facial biometrics easier.