Live data from Hacker News

Two Way Mirror Improves Video Conferencing

hackaday.com

51–60 of 92 posts

Re: Two Way Mirror Improves Video Conferencing

#52

At the end of the video, he tried it with his friend who's not using the apparatus. Yet, her eyes seem to be looking at him too. What do you think?

Me too. I felt like she was looking more into my eyes than he was.

Maybe I've just gotten too used to video calls...

Re: Two Way Mirror Improves Video Conferencing

#53
post #7

Couldn't you lie the screen completely flat and build it the other way (reflecting the screen and passing through the camera), avoiding the keyboard problem?

Why not use an iPad. IPad on a flat surface and a webcam or any other camera behind the mirror. You can even build a custom mirror-camera using a raspberry-pi, a rip webcam and a small lcd screen. Sounds like a nice DIY project.

Re: Two Way Mirror Improves Video Conferencing

#54

Earlier quoted context omitted.

Even with multi-camera setups?

Seems possible. If the user is actually looking at the center of the screen then we only need to shift the view, not digitally move their eyes. That seems very doable with some GPU code.

Yeah, I've long thought this should be pretty doable. At least with a good TOF camera.

Most of the literature I've seen has been on specifically gaze correction, which isn't actually what you would want.

Re: Two Way Mirror Improves Video Conferencing

#56

Earlier quoted context omitted.

Even with multi-camera setups?

Seems possible. If the user is actually looking at the center of the screen then we only need to shift the view, not digitally move their eyes. That seems very doable with some GPU code.

> That seems very doable with some GPU code.

This seems about as hard as digitally moving eyes.

I think the main source of artifacts is going to be lighting and reflections. Specular color or reflections are only possible to see when light, surface position and normal, and observer are arranged in a specific way. If you have 2 or more cameras positioned elsewhere, there's no way to find out what color is visible to another camera in the center.

Modern AI can try to guess, but fundamentally there's no that info anywhere in the video. It can assume the object surface is made of small count of uniform materials, and extrapolate materials across picture and across frames, but this gonna fail too often for biologicals subjects like people.

Re: Two Way Mirror Improves Video Conferencing

#57
I haven't actually had a single video-conference since lockdown started. Plenty of audio-conferences with 50+ people for show and tells, and if two people turn their cameras on it's suprising.

Personally I'm very happy with this. Means you can tune out and keep working on stuff that matters to you when the call starts going off-track or out of your area.

Re: Two Way Mirror Improves Video Conferencing

#59

With so much multi-image computational photography and video processing these days, I've been wondering whether we could have a multiple camera system (with cameras on the top, bottom, left, and right of the screen) and a processor that can simulate a camera in the center of the screen - or even dynamically moved to the eyes of the caller. I know there's a bunch of research on viewpoint interpolation, but how close m…

That doesn’t work right if you wear glasses with any significant optical distortion. In fact, the current takes on this make it significantly worse since they can’t figure out (or accurately simulate) eye position behind the lenses.

Re: Two Way Mirror Improves Video Conferencing

#60

With so much multi-image computational photography and video processing these days, I've been wondering whether we could have a multiple camera system (with cameras on the top, bottom, left, and right of the screen) and a processor that can simulate a camera in the center of the screen - or even dynamically moved to the eyes of the caller. I know there's a bunch of research on viewpoint interpolation, but how close m…

May be the in-display camera will solve it easier, where the camera is integrated beneath the display seeing through a semi transparent OLED panel.

Yes, doesn't the latest generation of smartphones already do this for the front camera?
Post reply on HN