> If success to them looks like an equal number of white/black/asian/women it's an unreachable goal
It's not the goal. You've created a strawman and wasted your own time fighting it.
> In my mind it's equality of opportunity. I don't care what color your skin is
That doesn't magically erase that they grew in up in a racist society that does care what color their skin is.
It's insulting to many people of color to hear "I don't care what color your skin is". An appropriate and honest response from a person of color might be "Must be nice. I wouldn't know what that's like because I never had the privilage of not caring what color my skin is". Probably not the great start you were hoping for.
It sounds like you want imagine the starting line was in the same place for every person who arrives to you as a candidate. When in fact some people got to you with a head start. Ignoring the starting line does the opposite of creating equality of opportunity. But ignoring the starting line is far simpler. And even useful for those who benefit from maintaining the status quo.
The best candidate for the work might just be the person who arrives less qualified and slightly behind the winner. Someone who started from far behind and almost caught up. If racism exists outside your interview, then equal opportunity at your interview must take into consideration that someone's race might have put up many obstacles on the long journey that got them to your interview.
Let's do a thought experiment. You're in a room with 57 white people and 12 black people. Those are the numbers you used. 10% of people in the room are racist. Every racist in the room gets to insult every person of the other race one time. Do the math. How many times is each white person insulted? How many times is each black person insulted? Is there "equality of opportunity" for everyone to leave that room and head to a job interview with the same level of self esteem? Multiple that by a lifetime.
If US demographics were in fact 50% white, 50% black, it would make things far easier to understand. Living in a society where race matters and you are hugely outnumbered is something the majority will always have great difficulting in relating to.
By not caring what someone's skin color is, you're passing over candidates who worked far harder to get where they are compared to someone who had fewer obstacles. Of course not every obstacle in life comes from race and some people of color may have even experienced a life of privilage.
So let's take a deaf candidate applying to your job. Like skin color, it's not something they chose nor something they can change. It very likey created obstacles for them in life that you never experienced. Would you treat them the same as non-deaf candidates? Speak to them with your back turned perhaps? Or would you adapt to who they really are?