The fundamental reason for this is simple. Humans are prone to cognitive dissonance. Meaning, we do absurd things to avoid painful thoughts. And anything that questions our sense of identity, is a painful thought. So if my self-image is, "I've advanced our understanding of the fundamental nature of reality," then the idea that my contributions weren't useful becomes painful. So we avoid thinking it, challenge people…
And reinforces my general below-the-line (layperson) fear about the state of physics today (as reinforced ofc by the likes of Sabine Hossenfelder & Eric Weinstein).