Let's take a look at education for an example: USA ranks pretty low on global education rankings despite the fact that we have some of the best schools in the world across all levels, its hard to think why that may be the case but when you consider the inequality in school systems due to property tax law and de facto segregation it makes a lot more sense.
Look at the criminal justice system: we have over 1 million prime aged men who are basically frozen out of achieving economic prosperity and contributing to this countries success because of bad policing and disproportionate enforcement of law.
Look at healthcare, there is a huge gap (although closing) of life expectancy between races.
India and China are not utopias by any means, but they have 1B+ people: these countries are growing larger and larger in influence and will create a middle class that contains hundreds of millions of people. The US is getting more and more in-equal and at a certain point we will reach an inflection point where we are too damn lopsided for our own good. People want to talk about lower productivity and lower wages, when you have 1.5 missing men from the workforce what do you expect?[0]
0: https://www.nytimes.com/interactive/2015/04/20/upshot/missin...