That is the opposite of what you would expect if incentives and business models around this most basic utility were not broken.
If people can build collectively incredibly useful resources like wikipedia and openstreetmap why not an index of the web as a public good that is devoid of the race to the bottom dynamics of SEO and adtech and whatnot.
Why do we need to worry about privacy violation and/or gross commercial bias when trying to access the most important information machinery invented in recent decades, the web?
Imagine you try to find your way in an unknown city and the only maps available are the sketchy freebies handed out at hotels, choke full of commercial ads, spam and fake entries.
We have normalized too much, we are accepting as inevitability suboptimal services. This is not theoretical and without systemic implications. Knowledge worker productivity - which is a large fraction of modern economies - depends on the speed and quality of information retrieval.
At some point people must snap out of the spell and work towards a sane internet that puts the interests of billions of users first.