Live data from Hacker News

It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

youtube.com

41–50 of 119 posts

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#41
post #23

There's still a bug: the glass with water does not distort the checker pattern in the background at 24:12.

I wouldn't call it a bug. This is a first step, not a final step. Maintaining the refraction might be more realistic, but it's not necessarily what the creator wants.

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#42
post #13

Earlier quoted context omitted.

Don't humans and other warm objects also radiate IR?

That is far-IR, thermal stuff, Near-IR, 700 nanometer-ish is right below red in human vision. Camera sensors can pick up a little near-IR so they have have a filter to block it. If that filter was removed and a filter to block visable light was used in place you would have a camera that can only see non-visable light. Poorly, the camera was not engineered to operate in this bandwidth, but it might be good enough for…

> Poorly, the camera was not engineered to operate in this bandwidth

At least for cheap sensors in phones and security cameras that engineering consists of installing an IR filter. They pick it up just fine but we often don't want them to.

Keep in mind that sensors are inherently monochrome. They use multiple input pixels per output pixel with various filters in order to determine information about color.

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#43

The sad thing about this is the problems encountered during post from the production team saying "fix it post" during the shoot. I've been on set for green screen shoots where the lighting was not done properly. I watched the gaffer walk across the set taking readings from his meter before saying the lighting was good. I flip on the waveform and told him it was not even (which never goes down well when camera dept te…

> TL;DR They solved something to make post less expensive because they cut corners during production.

FWIW having watched the entire thing, they never blamed bad production staff or unavoidable constraints. Those are things that anyone working with others experiences when making anything, whether it's YouTube videos or enterprise software products. My TLDR is: "Chroma keying is an fragile and imperfect art at best, and can become a clusterf#@k for any number of reasons. CorridorKey can automatically create world-class chroma keys even for some of the most traditionally-challenging scenarios."

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#44
post #34
post #23

There's still a bug: the glass with water does not distort the checker pattern in the background at 24:12.

True, but with visual art there is what is correct and what looks correct. When things are moving and the area small no one is going to notice. But now that is problem is solved a director will come along and say... I want a scene with a big glass of water and the camera will zoom in on it and will see the monster refracted through the glass.

At that point it's better to do the glass entirely in post.

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#45
post #6

Pretty impressive results! Seems like someone has even made a GUI for it: https://github.com/edenaion/EZ-CorridorKey Still Python unfortunately.

Like 90% of the other tooling in VFX...

Is it? That's a shame. I assumed this is Python because of Pytorch.

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#46
post #9

I'm a software engineer that, like the vast majority of you, uses AI/agents in my workflow every day. That being said, I have to admit that it feels a little weird to hear someone who does not write code say that they built something, without even mentioning that they had an agent build it (unless I missed that).

This is interesting. I had the exact opposite reaction. You don't hear architects get hounded because they say they "built" some building even though it was definitely the guys swinging hammers that built it. But yet, somehow because he didn't artisanally hand-craft the code, he needs to caveat that he didn't actually build it?

architects i know say "i designed that", "i worked on that", "i specified that" or "i chose that", they don't say "i built that"

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#47

Earlier quoted context omitted.

You’d have to track it, render it, and comp it in. It’s not ridiculously difficult, but there’s no way that’s going to happen automatically.

>there’s no way that’s going to happen automatically They train their model in a pretty straightforward way, it can also be used to capture the distortion as well, just use a non-monochrome (possibly moving) background optimized for this. It's a matter of effort and attention to detail during training (uneven green screen lighting, reflections, etc), not fundamental impossibility

Yes. But the main issue is in the way they formulate the problem. Their output is always a transparency mask, which of course will never handle distortions.

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#48

The sad thing about this is the problems encountered during post from the production team saying "fix it post" during the shoot. I've been on set for green screen shoots where the lighting was not done properly. I watched the gaffer walk across the set taking readings from his meter before saying the lighting was good. I flip on the waveform and told him it was not even (which never goes down well when camera dept te…

I fully agree but I think for them making it possible to cut corners during production is the whole point. Think about it: The choice is between 5 minutes of work plus a one time purchase of a decent GPU and a big room with a complex lighting setup with a post supervisor present. Now, quality of the end result will not be the same, for sure. You and me would opt for the quality setup whenever we can, but many others…

If you're on such a low production budget that you just physically do not have the lamps to light a screen, then you really have to ask if green screen is the right option. Maybe flip it and shoot black limbo so you do not need lights, and the lights you do have can be better used as key lights for separation. You also don't have to worry about the color cast from your light screen. Essentially, you just need a garbage matte for the key, and then clean up what might be getting keyed that you don't actually need. Detecting foreground subject from background is so capable now that a screen isn't necessary, and matte clean up is pretty much unnecessary. Of course you lose street cred of not being able to say you used green screen, but who cares as long as the shot works out.

Re: It Took Me 30 Years to Solve This VFX Problem – Green Screen Problem [video]

#49

The sad thing about this is the problems encountered during post from the production team saying "fix it post" during the shoot. I've been on set for green screen shoots where the lighting was not done properly. I watched the gaffer walk across the set taking readings from his meter before saying the lighting was good. I flip on the waveform and told him it was not even (which never goes down well when camera dept te…

... did you watch the video?
Post reply on HN