Wonder Studio: this AI-powered tool might be a preview of the future of VFX
1–10 of 37 posts
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#2Their official website: https://wonderdynamics.com/
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#3Seems way too good to be true, but I guess we'll see. IF it does end up working as advertised, I can see a very bright future ahead for indie filmaking, as well as a lot of shovelware style CGI heavy movies and shows due to the lower bar for entry, not that that is a bad thing.
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#4There's no way this is real.
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#5[deleted]
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#6I'll believe it when I see it - that is, the results verified by some 3rd parties. Now it's just a company pitch with some cherry-picked results put up together for a demo.
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#7When you get Spielberg to be on your board of directors, it really seems like it is legit.
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#8Imagine the possibilities once tools like this become capable of doing live-edits. That lying rat of a politician turns into a real rat in the news...
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#9There's no way this is real.
Why not? I see just two deceptions:
1. You can only choose from pre-build characters (the poster-style thumbnails of the characters implies something different)
2. I don't think you can actually move the camera (or just wiggle it a bit)
They just carefully chained a bunch of things:
- segmentation to isolate character
- in-paint for character removal and a 360 HDR photo sphere for lighting
- pose estimation (and something equivalent for the face, but that was a bit weak I felt)
- estimate camera position from tracking points on the floor
- render hand built 3D model from poses and with light sphere
So the shortcomings for now are:
- you can only use pre-build humanoid 3D models
- you still need to film it with real actors
- face tracking doesn't seem that good yet
- lighting is semi-convincing
- no interaction with the environment (not even shadows)
- some visual artifacts from the character removal (I think mostly segmentation failing and hairs getting out of bounds, you can see it in the last shot)
Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX
#10All of the examples are extremely easy shots. Anything complicated is likely still going to need real mocap type work.
Also look at the faces of all of the characters - they have very little facial movement. Lipsync is much easier to visually match than something like subtle facial expressions.
What this may do well is automate the low hanging fruit (easy shots) and provide a nice starting point. It also very well might end up being mostly a temp tool before a final high quality pass is done by a competent artist (and temp VFX is a whole sub industry that is quite important!)
Source: Used to work in VFX