Welp, looks like one of the entry level jobs in VFX is now fully automated: the role was called "Trackers" and they did camera motion recovery, set/prop placement recovery, and actor match moving, including facial performances (sometimes, that's had a lot of automation attention for years.)
Wonder Animation – Video to 3D Animation
11–16 of 16 posts
Re: Wonder Animation – Video to 3D Animation
#12Earlier quoted context omitted.
You have to provide rigged 3d character models yourself(or use their premade ones)- it does camera tracking + motion matching or whatever algo/ai fun to track the biped animation- so yeah you feed it a video and the 3d models and it spits out either a video of the composite or you can download the 3d scene for further use/massaging in other applications. btw Animation filmmaker here- tested a previous version- it was…
I appreciate this information. Saves me some time. Thanks
We've looked at a number of FOSS and Commercial options for a project recently, and found most options were not much better than https://freemocap.org/ with video occlusions.
However, we did purchase the https://faceit-doc.readthedocs.io/en/latest/mocap_general/ commercial seats for Blender, and have found it workable with the results from the iPhone 3D camera App compared to other options (52 marker lip sync, gaze, and blink cycles will still need cleaned up to look less glitched in complex lighting.)
Combined with Auto-Rig Pro in Blender, it is fairly trivial re-targeting for Unreal Engine with volumetric preserving rigs (can avoid secondary transforms, so elbows don't fold in weird ways by default like Makehuman rigged assets.)
Best of luck, we concluded after dropping/donating a few grand into several dozen addon projects... there were still quite a few version rotted or broken add-ons for Blender around that people had zero interest in maintaining (some already made redundant by FOSS work etc.) However, there were also a few tools that were surprisingly spectacular... will still likely need to run both 3.6.x and 4.x ... YMMV =3
Re: Wonder Animation – Video to 3D Animation
#13Welp, looks like one of the entry level jobs in VFX is now fully automated: the role was called "Trackers" and they did camera motion recovery, set/prop placement recovery, and actor match moving, including facial performances (sometimes, that's had a lot of automation attention for years.)
The quality of wonder dynamics is still significantly far away from handling more complex real world shots, or more fine grained movement.
It’ll certainly help but the death of manual tracking is greatly exaggerated.
Re: Wonder Animation – Video to 3D Animation
#14It's 2044. You wake up at 8am as a freelance VFX artist in the slums of Miami Islands. You pay 3.0 dogecoin to activate your Internet connectivity and refresh your ACACV degree. There's a 12pm deadline for the 4D VR animations in the New New Yorker's October 18th anniversary celebration of Jeffrey Toobin's Zoom call. An update to Wonder Animation 35 is released, saying "New: Retargeting for testicles." Rejoice! Your brain sheath rewards you with a lower dose of GLP-1 agonists. You spend the time you saved to earn points to claim an airdrop by watching a withered Elon Musk rant about electric boats.
Re: Wonder Animation – Video to 3D Animation
#15Welp, looks like one of the entry level jobs in VFX is now fully automated: the role was called "Trackers" and they did camera motion recovery, set/prop placement recovery, and actor match moving, including facial performances (sometimes, that's had a lot of automation attention for years.)
The quality of wonder dynamics is still significantly far away from handling more complex real world shots, or more fine grained movement. It’ll certainly help but the death of manual tracking is greatly exaggerated.
That's good to know. The end of this month, today, marks 20 years since I worked as a tracker.
Re: Wonder Animation – Video to 3D Animation
#16It's 2044. You wake up at 8am as a freelance VFX artist in the slums of Miami Islands. You pay 3.0 dogecoin to activate your Internet connectivity and refresh your ACACV degree. There's a 12pm deadline for the 4D VR animations in the New New Yorker's October 18th anniversary celebration of Jeffrey Toobin's Zoom call. An update to Wonder Animation 35 is released, saying "New: Retargeting for testicles." Rejoice! Your…
>"New: Retargeting for testicles."
someone in a long past IRC said once that all the (visual) details in a human is in their fingerprints and their ballbags, everything else is generic.
I don't do vfx really, so I can't speak to the truth of that :
/s but at least it sounds like we're automating the hard work for our VFX colleagues. /s