Unsupervised learning of probably symmetric deformable 3D objects from images
1–10 of 39 posts
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#2Not loading properly for me :( I think server may be being overloaded by HN traffic?
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#3Stuff like this can obviously be used to make things like deepfakes 'better'. But i think it might be cool for creating virtual meeting rooms, where you can take a webcam shot of a persons face, normalize the skin tones for lighting, map to a 3d surface, then relight it for the virtual room.
When you can rig the meshes to drive each other you could wear 'masks' of other peoples faces (or critters).
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#4[deleted]
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#5I think we slammed it dead.
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#6because we can
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#7Not loading properly for me :( I think server may be being overloaded by HN traffic?
Unsupervised Static Asset Server Converts Probably Simple HTTP Requests to 404 Errors.
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#8Video here: https://youtu.be/5rPJyrU-WE4
Can anyone explain why people would use text to speech for something like this, when they have perfectly good voices themselves?
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#9Stuff like this can obviously be used to make things like deepfakes 'better'. But i think it might be cool for creating virtual meeting rooms, where you can take a webcam shot of a persons face, normalize the skin tones for lighting, map to a 3d surface, then relight it for the virtual room. When you can rig the meshes to drive each other you could wear 'masks' of other peoples faces (or critters).
> But i think it might be cool for creating virtual meeting rooms, where you can take a webcam shot of a persons face, normalize the skin tones for lighting, map to a 3d surface, then relight it for the virtual room.
You might be interested in project HeadOn at TU München:
https://www.niessnerlab.org/projects/thies2018headon.html
Justus Thies gave a presentation at our University about a year ago. IIRC they don't use any fancy NN stuff but instead extract the face geometry using a stereo camera and use interpolation to project the movement onto a target mesh. Using stereo goggles for a VR meeting and various other applications were discussed during the presentation, but the main focus was of course on entertaining the audience with fake videos.
On a side note: This is probably the closest to a real-life Max Headroom that we have so far. Not sure if that influenced the name.
Re: Unsupervised learning of probably symmetric deformable 3D objects from images
#10"We store a copy of the uploaded image ..."
Is this really happening with a "deep network in the browser"? It looks like it is happening on a server, then the 3D result is viewed in a browser.