Earlier quoted context omitted.
If you don't like Google’s results use another service. Sure, but Google has two kinds of customers: searchers and websites. Maybe you believe websites shouldn't hide from Google because it makes no strategic sense. Twitter and Facebook don't let Google index their content. Why would they let Google front-run ads on their content? It's not a catchall rule, to hide with robots.txt. Maybe websites should just pay up: t…
No, google has one customer: advertisers. Searchers don't directly make Google any money, advertisers do. Google is not a public utility, it's the most successful online advertising machine ever.
Google has to get searchers to sell to advertisers. That said, the generic 'websites' mentioned above are not Google customers. Google does not "owe" them anything – they owe the searchers the best results and the advertisers clicks at a certain cost. The only thing those other websites do with their free listings are attract eyeballs to Google's engine.