I don't really care what other people use in terms of keyboard layout or non-layout, but loud clicking is incredibly distracting. I had to get active noise cancellation headphones to be able to work in one room with a fellow developer who insisted on using such a monster.
There are two sounds with the typical Cherry MX blue keyswitch: the pleasant and satisfying "click" as the key activates and the annoying "clack" of it bottoming out.
The dampeners only affect the clack; not the click.
Of course, being considerate to one's coworkers is always #1. No substitute for that.
When I have coworkers sharing my office, I show them that I have a non-clicky keyboard right here in my desk drawer, and make them swear to let me know if the clicky keyboard ever becomes even slightly annoying. I show them where the other keyboard sits and tell them they can literally just swap it out themselves if they like. I like my (modified to be quieter) clicky keyboard but I like my coworkers 100x more. :)