This article misses one of the primary reasons for AV's demise -- we didn't update our primary index for several months just as Google was gaining mindshare. A ridiculously high percentage of our front page links were 404s, while Google was always fresh. This was particularly bad because one of our earlier strong points was fresh indexes. Our ability to refresh the supplementary index on the fly was awesome. When you…
Why did you not consider promoting the latest supplemental index into being main one and trigger reindexing?
Altavista: The rise and fall of the biggest pre-Google search engine
321–323 of 323 posts
Re: Altavista: The rise and fall of the biggest pre-Google search engine
#322Earlier quoted context omitted.
It's not necessarily about ranking sites which actually contain the key, or which google already decided should be relevant to the search (where page rank seems to be the most relevant factor, thanks for your interesting data point!). When Google receives a search query, it first broadens the search phrase (see [0]). The user's clickstream and search refinements are helpful in both training the model for doing the br…
Ah, that's interesting and does explain a bit, thank you. Might the perceived quality decrease be based on a misclassification of the user entering the search, and therefore a problematic refinement? I'm thinking similar to Amazon's recommendation engine that for some reason (I'd wager my terribe fashion sense) has decided I'm likely a women and now gets most recommendations completely wrong.
Exactly! Search engine performance can be assessed by measuring precision and recall [0]. Full text search engines have really high precision. Additionally, when the user has been socialized with full text searches, they've built a model of how the search engine works ("it will find documents which contain my search phrase"), so false negatives are perceived to be less severe, as they can be readily explained by the model. "Ah, this document about helicopers contains 'Apache', no wonder it's in the results. I'll add 'webserver' to narrow it down" (And experienced users will already start off with all necessary key terms).
While full text search engines have high precision, they also have bad recall. This can be improved, but there is a tradeoff when tuning the algorithm: to increase recall, the search context is broadened. That necessarily decreases precision as well, because there is no way the search engine is always correct when adding context. Also, when at first all documents on the frontpage at least contained the search term, now there is not even a good explanation why some documents were retrieved. And the more precise the query itself (something we learned by using full text searches) the higher the probability of misclassification, and the worse the effects of broadening. The relevant results are somewhere in the list, but now every second result on the frontpage is from the wrong bucket. And with no explanation, those false positives weight heavy for us users from the old days.
[0] Precision is the probability that a random document in the result set is relevant. Recall is the probability that a random relevant document is in the result set.