Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Wonder Studio: this AI-powered tool might be a preview of the future of VFX

3dvf.com

Post reply on HN
Print view View original

11–20 of 37 posts

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#11

Post by Solano »

Melatonic wrote: post #10

All of the examples are extremely easy shots. Anything complicated is likely still going to need real mocap type work. Also look at the faces of all of the characters - they have very little facial movement. Lipsync is much easier to visually match than something like subtle facial expressions. What this may do well is automate the low hanging fruit (easy shots) and provide a nice starting point. It also very well mi…

jeah they really shouldn't exist because their product may not be 110% perfect. have you even used it even?

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#12

Post by quadcore »

You guys say "no way it's real". I actually dont see what's difficult here (big short cut). It's like motion capture but AI finds and tracks the landmarks or "ping pong balls" on the actor for you. To be clear, the AI isnt rendering, the engine is rendering the character the AI helped to pose. The AI just says where the bones are essentially.

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#14

Post by bsenftner »

quadcore wrote: post #12

You guys say "no way it's real". I actually dont see what's difficult here (big short cut). It's like motion capture but AI finds and tracks the landmarks or "ping pong balls" on the actor for you. To be clear, the AI isnt rendering, the engine is rendering the character the AI helped to pose. The AI just says where the bones are essentially.

Former VFX developer/artist/analyst & VFX patent holder here. This is a combination of known techniques integrated with a nice UI. I expect current VFX studios are already past this point in their internal tools.

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#15

Post by eps »

anotheryou wrote: post #9
ramijames wrote: post #4

There's no way this is real.

Why not? I see just two deceptions: 1. You can only choose from pre-build characters (the poster-style thumbnails of the characters implies something different) 2. I don't think you can actually move the camera (or just wiggle it a bit) They just carefully chained a bunch of things: - segmentation to isolate character - in-paint for character removal and a 360 HDR photo sphere for lighting - pose estimation (and some…

At 00:37 robot's hand is way thinner than the original actor's, but the missing parts of the background are perfectly reconstituted. I realize that Photoshop could do this few years ago, but here it looks a bit too flawless.

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#16

Post by Philip-J-Fry »

Looks cool and would be a neat tool for independent film makers on small budgets or creators on things like YouTube. But I don't see how consolidating motion tracking, rotoscoping, animation, lighting, compositing etc. into a single web app (!) would really help any serious VFX studio.

Seems like it'd be better as a set of distinct tools. E.g. a camera motion tracker, an actor motion tracker, a clean plate generator, HDRI generator, etc. That way it would be easier for a studio to add it to their existing VFX pipeline.

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#17

Post by anotheryou »

eps wrote: post #15
anotheryou wrote: post #9

Earlier quoted context omitted.

Why not? I see just two deceptions: 1. You can only choose from pre-build characters (the poster-style thumbnails of the characters implies something different) 2. I don't think you can actually move the camera (or just wiggle it a bit) They just carefully chained a bunch of things: - segmentation to isolate character - in-paint for character removal and a 360 HDR photo sphere for lighting - pose estimation (and some…

At 00:37 robot's hand is way thinner than the original actor's, but the missing parts of the background are perfectly reconstituted. I realize that Photoshop could do this few years ago, but here it looks a bit too flawless.

why is it "too flawless" if photoshop can do it for years :) ?

You can see flaws if you look at the head around 1:56 to 1:58

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#18

Post by ekianjo »

Melatonic wrote: post #10

All of the examples are extremely easy shots. Anything complicated is likely still going to need real mocap type work. Also look at the faces of all of the characters - they have very little facial movement. Lipsync is much easier to visually match than something like subtle facial expressions. What this may do well is automate the low hanging fruit (easy shots) and provide a nice starting point. It also very well mi…

> All of the examples are extremely easy shots

Indeed there's no crowd going on on screen, it's mostly one or two characters maximum at once on very clear backgrounds.

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#19

Post by [deleted] »

quadcore wrote: post #12

You guys say "no way it's real". I actually dont see what's difficult here (big short cut). It's like motion capture but AI finds and tracks the landmarks or "ping pong balls" on the actor for you. To be clear, the AI isnt rendering, the engine is rendering the character the AI helped to pose. The AI just says where the bones are essentially.

[deleted]

Re: Wonder Studio: this AI-powered tool might be a preview of the future of VFX

#20

Post by aceazzameen »

the_third_wave wrote: post #8

Imagine the possibilities once tools like this become capable of doing live-edits. That lying rat of a politician turns into a real rat in the news...

Don't Snapchat filters already do stuff like this in real-time? And that tech is the infancy of where it's going.
Post reply on HN