Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Unscreen – Remove Video and GIF Backgrounds

unscreen.com

Post reply on HN
Print view View original

21–30 of 43 posts

Re: Show HN: Unscreen – Remove Video and GIF Backgrounds

#21

Post by ygra »

atoav wrote: post #18

As a freelance VFX-artist the thing that annoys me about examples like these is that they don't honestly shou you the edge cases where things start falling apart (and they usually do). A guy with dark hair in front of a white wall? I could luma key that in 10 seconds. The book example is more interesting, but there you can already see a bit of chatter (which might have to do with compression and noise tho). In your d…

Well, the first video with the girl in the desert shows a case where things usually break down and they do so here too.

Re: Show HN: Unscreen – Remove Video and GIF Backgrounds

#22

Post by ithkuil »

tenryuu wrote: post #13
a_t48 wrote: post #10

Earlier quoted context omitted.

It would also make an excellent OBS plugin for streamers, if such a thing doesn't already exist.

For webcams? You can use xsplit vcam. https://www.xsplit.com/ja/vcam It uses whatever AI systems they made to single out the foreground objects from the background objects. And then it's basically just taking the camera input, applying filters or transparency and outputting it as a new video device.

Any chance there is anything good like that that would run on macos ?

Re: Show HN: Unscreen – Remove Video and GIF Backgrounds

#26

Post by numpad0 »

ashraymalhotra wrote: post #14

Are there similar tools to automate even the green screen removal process? It's super inefficient right now, especially dealing with green screen light bleed. Tweaking parameters etc on Premiere Pro/After effects takes forever.

Mandalorian solved it by completely replacing all lighting with an LED videowall room showing camera tracked cubemap texture fed realtime from Unreal

Re: Show HN: Unscreen – Remove Video and GIF Backgrounds

#27

Post by julvo »

amerine wrote: post #3

Nice! How are you doing it?

My guess would be U-Net-like ConvNets, trained on images annotated with foreground/background segmentations. Probably with all kinds of tricks like multi-scale inference etc.

However, simple frame-by-frame segmentation will probably not be enough to get temporal consistency, so for each frame's segmentation they probably take previous and following frames into account.

Re: Show HN: Unscreen – Remove Video and GIF Backgrounds

#28

Post by joosters »

Their example green-screen photo shows two chairs against a green background. I would love to see how their technology would work in their equivalent kind of setup. If you have two people sitting in chairs, talking to each other, then presumably the chairs will be static and will most likely be deemed to be part of the background, to be cut out.

Re: Show HN: Unscreen – Remove Video and GIF Backgrounds

#30

Post by dillonmckay »

numpad0 wrote: post #26
ashraymalhotra wrote: post #14

Are there similar tools to automate even the green screen removal process? It's super inefficient right now, especially dealing with green screen light bleed. Tweaking parameters etc on Premiere Pro/After effects takes forever.

Mandalorian solved it by completely replacing all lighting with an LED videowall room showing camera tracked cubemap texture fed realtime from Unreal

I think the poor man’s version of this would be a fixed camera position and using a projector from the rear of the screen.
Post reply on HN