I solve hard problems for a living. This doesn't even register.
My post-vaccine plan is to have a "mulmen day" where I set the expectation with my teammates and stakeholders that I am in the office and a "float" day where I come in to align with someone else's day who I need to work with face-to-face for whatever reason. If everyone works this way then we can meet most scheduling needs. If we expand this to two float days a week then it is trivial.
There's no reason for the whole team to be colocated on the same day on a regular basis. Those kind of team-wide meetings never benefit from whiteboarding or any other in-person process. In fact the limitations of remote work make that kind of collaboration better because you have to actually prepare your thoughts and material.
Even pre-covid getting calendar time required a week of notice. Office hours were once-a-week and required at least 24 hours notice. Personally my office hours are on Wednesday. If someone books a session I come in, if not I don't. Nothing changes.
In Covid times I have had the most productive period of my career while my team grew by 50%. I have no problem getting coworker time ad-hoc, even remote. Communication is not difficult. We got better at using tooling to write documents and draw diagrams. We don't use whiteboard analogies.
I honestly see no downside to the remote work and a long list of personal, professional and environmental benefits.