Ultimately I think it’s because the internet is just too big! Google were only able to do it because they had the right algorithm early in the age of the internet. They were then able to grow with it to achieve the scale required. Starting from scratch now on a general internet search engine would be close to impossible without 10s, if not 100s, billions of investment. And you would need that to build the index befor…
Isn't this exactly the reason why one should do it, as Google is the essence of the online advertising industry and this very regulation could threaten its existence?
>I think there is massive opportunity for domain specific search engines though
Challenge with niche search engine is discoverability. Imagine you had 10 of the greatest vertical search engines available today - how do you remember which one to use and how? The beauty of a general web search is that it is an easy to remember entry point to all of what is out there.
> You then potentially move towards a building “meta” search engines
Ever wondered why is this called meta search engine, and an email software that connects to multiple email servers is called email client and not "meta email". "Search engine client" sounds like a more appropriate name.