Live data from Hacker News

Show HN: Imagine a search engine that removed top million sites from its index

millionshort.com

71–80 of 204 posts

Re: Show HN: Imagine a search engine that removed top million sites from its index

#71
post #59

It means that our ranking algorithms have good recall but very poor precision. We value web page connectivity more than its content. We don't know how to teach machines to evaluate web page for its merit so we hope that a large number of Twitting, Liking and Plusing non-experts will approximate single expert. Millionshort shows that this model isn't good enough.

We value web page connectivity more than its content.

That's pretty much precisely how PageRank (in its original form) changed web search. At the time, at least, it worked because we were really bad at automatically analyzing content, and the connectivity signal provided better results.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#74
post #16

I'd be fascinated to see the kind of SEO that would go on if this took off. "Bad news-- we're a top 100 hit for several of our main keywords. We'll have to change our URL scheme again."

We can call it Search Engine Pessimization!

Re: Show HN: Imagine a search engine that removed top million sites from its index

#75

Is it just me, or are the results fairly congruent with standard results from a search engine?

They are to a degree. We just remove remove the top million most popular sites. So, searching for "social network" would normally yield Facebook.com, but with MillionShort you discover a social network that that didn't make it past the noise.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#77
Searching for 'python global interpreter lock' yields some interest blog articles describing the problems, also some related articles about approaches to the C10k problem with python (preforking, worker processes, etc.)

A++ would search again.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#79
post #74
post #16

I'd be fascinated to see the kind of SEO that would go on if this took off. "Bad news-- we're a top 100 hit for several of our main keywords. We'll have to change our URL scheme again."

We can call it Search Engine Pessimization!

clap........................clap
Post reply on HN