Live data from Hacker News

ML turns video of a 360° turn into 3D model of a person

sciencemag.org

31–33 of 33 posts

Re: ML turns video of a 360° turn into 3D model of a person

#31

Earlier quoted context omitted.

In the case of Face ID, at least, you’d still have to transfer the measurements into the physical world, in a way that fools a system that has ostensibly been designed not to be fooled by masks.

Like a 3D printed model?

Doesn’t work for high quality face reco systems like iPhone X. You’d also need to get the IR reflectance, as well as a sign of life from the eyes.

Re: ML turns video of a 360° turn into 3D model of a person

#32

Earlier quoted context omitted.

It's someone standing in front of a green screen. You don't need ML to find a person's silhouette.

To be fair, they do have examples that aren’t chroma keyed; they just lead with one that is. Which is not to say that ML is necessary for this sort of computer vision task, but I wonder if it yields better or sharper results than other techniques?

Same. As someone who has spent an embarrassing amount of time keying and tracking video footage over the years, I’m surprised ML isn’t being used for this more often in studios by now.

Re: ML turns video of a 360° turn into 3D model of a person

#33
post #19

I wonder if will see a future soon where a director can fully edit the positions and physical actions of the actors at post production. basically, the whole scenes will be transferred to believable 3d models seemlessly, and you can reanimate parts of everything. I feel like that's doing to happen for sure, for big Hollywood productions at least (like the Marvel stuff)

This already happens a lot, most VFX heavy productions will have digital doubles of the main cast, and they can be used for as simple a reason as reframing a shot.

Your comment could give the impression this is drastically more simple to do than it is in reality. This is considered as something like the last frontier of VFX, and there still remains a lot of work to be done.

While you’re essentially correct, it is currently an overwhelmingly manual process. The amount of work and time necessary is substantial (some would say outrageous), and exponentially higher for certain types of shots. Many shots remain impossible or cost-defeating.

Post reply on HN