Freedom is the right to be wrong. If I am free only to agree with the popular consensus, I'm not free. If I can't have a quiet chat with friends in public making clear I'm a gay, atheist, muslim, vegan, witch, then I'm not free. If I can't have a private chat with any other member(s) of the populace, I'm not free. Someone will always think I'm living my life wrong.
Or, for that matter, if you're a fundamentalist Christian, Trump supporter, gay marriage opponent.