Then why would race be relevant? Why would someone not just say "you're too privileged to understand"? Why would they instead say "you're just a privileged white male and don't understand"?
I disagree with that logic you are using. Your logic seems racist to me. You are assuming a black person = less privileged and a white person = more privileged. I view both of these assumptions as racist. I think it is wrong to associate a race with a level or privilege. I think it is wrong to assume someone's race, gender, and level of privilege due to a view someone holds. I think it is even more wrong to then use someone's race and gender to dismiss their points.
If someone is having a discussion what positive effect would calling someone those derogatory (and in my opinion: racist) terms be helpful? It's not going to make me see their point of view. No matter how good of a rebuttal and explanation they may have had for me I am no longer going to care. Once someone is making assumptions and calling you names the whole conversation loses substance and value. This kind of bullshit just continues to propagate further divide and hatred between races.
I think it is perfectly valid to think that maybe someone holds a viewpoint because of their status in life. But I don't think that is a valid reason to attack them. I would rather look at that as an opportunity to exchange views and have a conversation. But unfortunately especially on sites like Reddit I no longer am able to do that. I used to be able to, but now anytime I have a view that is slightly conservative leaning I am called names or called racist. And what's ironic is that I really couldn't give a shit about political sides or parties. I have a lot of views that would be classed as pretty "liberal" while I also have a lot of views that would be classed as pretty "conservative". For some reason there always has to be a divide. It always has to be an Us versus Them mentality.
So people will assume status, race, gender in order to create an imaginary enemy and destroy any conversation that could be had.
Whether you think someone's viewpoint is something typical of a "privileged white male" is not relevant to almost any conversation.
If someone gives me a recipe online I don't assume they are a chef. Nor do I assume they don't know what they are talking about if they are not a chef. Someone being white or a male doesn't imply they are privileged. They may have had a harder life than most black people. I don't like using a stereotype to dismiss what someone else has to say. I think it is incredibly toxic and creates further hatred and divide.
Nobody will ever understand the other "side" if they are viewed like an enemy they can't talk to.