Earlier quoted context omitted.
What do you do when that equilibrium point is hopelessly above what the average person can afford?
That means there’s an invisible hand keeping prices up, or basically that the market is not free enough. That’s caused most of the time due to excessive regulation. Another reason is high demand in locations where offer is limited due to physical limitations. There’s always demand to live in Broadway, and offer can never catch up due to its physical limitations.
Nowhere in the economic theory there is a proposition stating that prices should fall below affordable levels, given enough competition.