Open-Source Virtual Background

#1

Post by jcastro » Thu, Apr 09, 2020, 2:50 PM UTC

Open-Source Virtual Background
elder.dev

Re: Open-Source Virtual Background

#2

Post by futhey » Fri, Apr 10, 2020, 4:28 AM UTC

Thanks for sharing! I have been working on the exact same project with Tensorflow & BodyPix, really helpful to compare notes & see the pyfakewebcam approach!

Re: Open-Source Virtual Background

#3

Post by qrv3w » Fri, Apr 10, 2020, 4:49 AM UTC

I love the added hologram effect! That is a very creative addition.

Re: Open-Source Virtual Background

#4

Post by raghava » Fri, Apr 10, 2020, 4:58 AM UTC

Brilliant!

Now, I know that there are many companies that force people to be on with a live video feed, and that many don't really like it.

How about recording a 3-min clip and playing that in an infinite loop - creating a fake feed (remember Keanu Reeves' Speed?) - so that people can avoid not being seen, but still get things done better? A mask on the face is a simple addition to avoid detection. As the saying goes, modern problems require modern solutions!

Re: Open-Source Virtual Background

#5

Post by BenTheElder » Fri, Apr 10, 2020, 5:17 AM UTC

futhey wrote: post #2

Thanks for sharing! I have been working on the exact same project with Tensorflow & BodyPix, really helpful to compare notes & see the pyfakewebcam approach!

:-) Great minds think alike!

I'm iterating on it again tonight, and tentatively virtualvideo [1][2] gives better results by just piping frames into ffmpeg vs pyfakewebcam

[1]: https://github.com/Flashs/virtualvideo/ [2]: https://pypi.org/project/virtualvideo/

I'll have to update the post or do a follow-up at some point.

Re: Open-Source Virtual Background

#6

Post by nojvek » Fri, Apr 10, 2020, 5:21 AM UTC

Pretty cool write up of how this can be replicated with opencv and out of the box libraries like bodypix. I imagine Zoom is using something like this too.

Re: Open-Source Virtual Background

#7

Post by BenTheElder » Fri, Apr 10, 2020, 5:22 AM UTC

raghava wrote: post #4

Brilliant! Now, I know that there are many companies that force people to be on with a live video feed, and that many don't really like it. How about recording a 3-min clip and playing that in an infinite loop - creating a fake feed (remember Keanu Reeves' Speed?) - so that people can avoid not being seen, but still get things done better? A mask on the face is a simple addition to avoid detection. As the saying goes…

You could actually pipe in a video clip with just ffmpeg and v4l2loopback pretty easily without writing any code I think :-)

The virtualvideo readme has an example of looping a single frame. https://github.com/Flashs/virtualvideo#errorhandling

Re: Open-Source Virtual Background

#8

Post by [deleted] » Fri, Apr 10, 2020, 5:26 AM UTC

raghava wrote: post #4

Brilliant! Now, I know that there are many companies that force people to be on with a live video feed, and that many don't really like it. How about recording a 3-min clip and playing that in an infinite loop - creating a fake feed (remember Keanu Reeves' Speed?) - so that people can avoid not being seen, but still get things done better? A mask on the face is a simple addition to avoid detection. As the saying goes…

[deleted]

Re: Open-Source Virtual Background

#9

Post by pcc09 » Fri, Apr 10, 2020, 5:57 AM UTC

Really cool.

Re: Open-Source Virtual Background

#10

Post by mlaretallack » Fri, Apr 10, 2020, 6:14 AM UTC

Very interesting,

The magic is pyfakewebcam and v4l2loopback, I was looking foe a way to turn myself into a potato on Teams. The bit I was missing was how to create a virtual webcam.