I've got a totally different experience... I own three HHKB: two HHKB Pro JP (for they have a narrower spacebar and more modifiers: so less thumb travel: I do have very close Japanese family but I don't speak Japanese) and one HHKB Pro 2 (the first I got).
They are, to me, out of this world. They ruined me forever in that I'll never be able to use something else than a Topre. I've got lots of IBM Model Ms, several Cherry boards (including the ultimate Cherry MX brown: the split MX 5000), I worked for years (when I was doing typesetting) on the best keyboard Apple ever made (Apple Extended Keyboard II is the name I think, from the early 90s): it wasn't bad.
But Topre is the best thing that ever happened to keyboards: I don't know how to put it in any other way.
My only gripe is that there are so little models to chose from: all the enthusiasts making their own keyboards are using Cherry MX switches but it's not because they're better than Topre, it's because they have no choice. There are many MX switches to choose from, yet, to me, they're not anywhere near close the greatness of Topre.
I'd totally be in the "build your own keyboard" community if I could easily build one using Topre switches. Heck, I considered cutting two HHKB Pro JP in half each to build me a split one... (it's doable).
Regarding the noise: I'm that guy crazy enough to go live somewhere quiet. Not the city, not full rural either because I don't want to hear animal farms and tractors. I'm the crazy one who'll splurge $$$ to get a high-end luxury car only for the sound insulation.
I'm also one of those dinosaurs who know what it was it was like to type in a room full of IBM Model M terminal keyboards (or similar) hooked to an AS/400.
Topre switches aren't that loud: no need to apologize for coworkers (moreover there are different Topre switches, some of which are quieter than others).
I'm not saying it's for everybody but I do really think anyone who's never tried one should try: it may be the keyboard switch they'll use until their last day.
I know I'm not the only one who's tried everything that exists out there and settled on Topre for life.