Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open-Source Virtual Background

elder.dev

Post reply on HN
Print view View original

41–50 of 85 posts

Re: Open-Source Virtual Background

#41

Post by shrx »

porjo wrote: post #38
benoliver999 wrote: post #36

Earlier quoted context omitted.

On Jitsi Meet, in the browser, there is a menu on the bottom right. Click it and there are loads of options there including blur background.

I'm confused. Parent was asking about virtual background. I've checked with meet.jit.si using Chrome and there is no virtual background option in the menu.

It seems that Jitsi uses the tensorflow NN to detect the background, but only for the purpose of blurring it, not replacing it with a virtual background.

Re: Open-Source Virtual Background

#43

Post by tpetry »

knotty66 wrote: post #18

Good article, thanks. BTW, this is the method Jitsi-meet uses. They also use BodyPix. https://github.com/jitsi/jitsi-meet/blob/master/react/featur...

Sadly bodypic is very slow. You're only achieving 8-15fps, so any motion is very sluggish. Additionally the detection is on many cases very inaccurate: Too much or too less is detected belonging to the body so you can really only use a blur filter because a virtual background looks very strange if parts of your shoulders/hair or half an ear is missing etc.

But i am really impressed by the detection of Microsoft Teams, i would love having this quality and speed available in a browser.

Re: Open-Source Virtual Background

#44

Post by soylentcola »

I'd love to see something like this as a plugin for OBS. I've been using it lately due to all the video conferencing we're all growing to love since it's got basic color correction/manual controls for my webcam feed.

It's got the option for "real" chromakey, but like the author, I don't have a green screen, Amazon isn't scheduling any deliveries for another month, and I don't feel like a trip to the fabric store would count as "essential" travel (especially if it's only so I can screw around with stupid backgrounds).

Tried a few different sheets/blankets I had at home, but none are a suitable color or uniform/matte enough to work well, even with proper lighting. I admit this is such a non-issue and only something I want to play around with, but it would be fun nonetheless.

Re: Open-Source Virtual Background

#48

Post by wdfx »

Using video loopback opens up some great creative possibilities for fun with video conferencing.

There's one thing I'd love to achieve though, which seems not possible on Linux desktop (specifically kubuntu)....

I want to be able to use the loopback as the source for screen share instead of webcam; i.e. to use the loopback as the conference presentation.

Has anyone got any ideas how to achieve this? Given most conference solutions on Linux do not seem to support either 'share this window' or 'share this screen region'. It seems to be the whole desktop or nothing.

Re: Open-Source Virtual Background

#49

Post by dh2424 »

This is pretty awesome work, but I just wanted to point out that Zoom doesn't actually require a green screen. If you uncheck the "I have a green screen" button, choosing your own virtual background still looks really good, although of course you're not going to get any crazy effects like this script adds.
Post reply on HN