Spatial computing will be the dominant paradigm for the vast, vast majority of all history once it is nailed down. The mouse/keyboard/monitor paradigm will be a small footnote in the early history of HCI once it is obliviated. Apple, as always, is showing the rest of the industry the way forward here.
I think the opposite. Even the lack of controllers is a downside for the apple vision. Controllers allow for multiple simultaneous modes of complex inputs that gestures don't and don't rely on being in the view of a camera. Making controllers optional for activities that don't need complex inputs would have been better.
This is basically the case though. Vision isn't a walled garden toy device like Quest. It's a full blown general purpose computer with an M2 chip. Any peripheral that works with macOS/iOS will work with it. I have no doubt the third-party controller market will be robust, and I can even see Apple releasing their own for specialized applications like gaming.