That’s the really ugly flip side of this, and I know it’s been said elsewhere but: conservative politics in the US make some people’s entire existence political, full stop.
So you do a lot more than just cut out “distracting” conversations this way. You uninvited certain people entirely, and in doing so have taken a hell of a stance on that persons inherent worth.
You can’t disconnect this from the current US political situation. They’re joined at the hip.