Earlier quoted context omitted.
But does a plus that happens once or twice a year outweigh minuses that happen multiple times per day?
And would the plus have even been necessary if the environment were not highly distracting? The best way to fix a bug is to prevent it from happening.
And while yes, some discussions will still take place outside of the chat rooms, if this is your default way of working then there should be enough discussion of anything critical that everything makes it's way to chat eventually.
Once everyone's comfortable working this way you can encourage a lot more working from home (or working from wherever in the world you want to be, if your employees aren't all married with kids yet), etc. And that will save you even more on office space.