Earlier quoted context omitted.
The sweet spot in my experience has been for WFH orgs to get together periodically for extended offsites. A one week gathering twice a year has forged some incredible bonds on my distributed team.
Ugh. Multi-day work offsites are the worst. Along with conferences. You have to make arrangements to be away, (try to) sleep in a hotel room, end up eating and drinking too much, getting a workout in is nearly impossible, they just completely disrupt all your routines and responsibilities.
All of your complaints are (usually) easily solved by experienced travelers. It's okay to not like travel, but it doesn't condemn the concept of a weeklong company offsite a couple times a year.