I have done remote work for a long time (because ...Canada), and the real issue is that it requires management to have their shit together. I also assess companies for acquisitions now so I talk every month to companies about what's working and what isn't. I've seen some very successful companies with partially remote or even 100% remote teams. And... they have their shit together. Managers have to actually know what…
It is just that remote working mercilessly exposes some of the flaws in the organization.
For example, people who look for a way to slack off now can do this much easier. The problem really is selecting right personnel and motivating them. If you try to treat the problem with a stick it most likely will fail with remote people.