Two Way Mirror Improves Video Conferencing

Tracking speakers is best done via audio already linked to camera control. Now face tracking by camera's in VC was something I first encountered late 90's - can't recall kit, but Sony was first on that - which was good for presentations in which the person speaking was standing and moving.

As for perspective shifting based upon multiple inputs - processing wise look at raytracing as would need to map each camera input to extrapolate the suface details and then map that out to the virtual visulisation. Basicly you would need to 3D map, including textures and re-render that viewpoint required.

However, do you need the whole face - you just really need to fix the eye's IMHO and eyeline contact.

But that is down to how we interact in meetings with people - try doing a video conference in which everybody is wearing dark sunglasses - that is insightful as you find people focus more upon what they hear more then.

Quite cool although:

1.) I find if you put the video conference window top and center of a monitor--preferably a larger one--it works pretty well so long as you make at effort to keep your eyes towards the top of the screen. This is especially important (and takes some discipline) if you're presenting from slides.

2.) The general recommendation, which is my experience as well, is that the webcam should be up at eye level or maybe a bit above. So if you are using a laptop, it should be up on some books or other type of stand.

The GlideGear iPad teleprompter is under $200 and saves a lot of time if you’re pressed for time:

https://smile.amazon.com/gp/product/B019AJOLEM/

The setup is to use an iPad hosting Sidecar wireless display from your Mac. Use Moom or similar screen management app that detects kicking on the new display, and pops your meeting video windows onto it at full dimensions (but not ‘full screen’ mode).

If the other person is both on video and sometimes sharing content, you need to flip the video horizontally, which isn’t obvious. There are three options:

1. Check if your display can flip the video.

2. Use SwitchResX if your graphics card can do it for that particular monitor:

https://www.madrau.com/

If it can, great. If it cannot, then ...

3. Use the Flip Mac Window utility from here, so you’ll see it the right way around in the mirror:

https://www.freetelepromptersoftware.com/mac/

How this works is it screen captures the original window, and plays it back flipped over top of the window. That means actual buttons / icons are not moved, only the rendering of the window is flipped. If you need to navigate the window, unflip it first.

Note that 12.9” iPads only fit in this GlideGear if you re-shape the mirror brace, but the mirror is large enough for a 12.9” iPad and it looks fantastic.

I like coupling this with Logitech Brio (best) or Logitech Streamcam (good).

I‘ve used it extensively with WebEx, Zoom, and Teams.

Oh, I didn't say no one would find it enjoyable. It's quite the opposite, actually: videos optimized for engagement tend to be more enjoyable for most people. You don't get to 2.4 million subscribers by making videos that no one likes to watch, after all.

We're not suffering from autism spectrum disorders; we're suffering from people starting at us.