Live data from Hacker News

Show HN: Imagine a search engine that removed top million sites from its index

millionshort.com

91–100 of 204 posts

Re: Show HN: Imagine a search engine that removed top million sites from its index

#92
post #65
post #59

It means that our ranking algorithms have good recall but very poor precision. We value web page connectivity more than its content. We don't know how to teach machines to evaluate web page for its merit so we hope that a large number of Twitting, Liking and Plusing non-experts will approximate single expert. Millionshort shows that this model isn't good enough.

I was able to rank for some moderately competitive terms just by paying someone minimum wage to go leave nice comments on dofollow blogs. The whole "Content is king" meme is a joke, really.

Interesting. How do you find blogs that don't implement nofollow?

Re: Show HN: Imagine a search engine that removed top million sites from its index

#94
There's one pretty big flaw with this approach... For certain searches that do not have "millions of results", you get completely unrelated results.

If I search my name then the results are for names similar to mine, but not actually my name. This makes it completely useless for searching my name. I would think that there are many searches with this problem.

I think there needs to be some kind of weighting system used that dynamically decides the cutoff point. One million is a huge over-generalization for all search terms.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#95
post #49

The results are surprisingly good. I did some searches for recipes, and frankly without the top 1000 you really start getting some fresh hits. Entries by real people, rather than sites raking up recipes for a hit.

Wow, I didn't know until today that Google doesn't serve more than the top 1000 hits. (A result of me thinking, "can't I just ask Google to show me the million-first through the million-tenth hits?)

Re: Show HN: Imagine a search engine that removed top million sites from its index

#96
post #94

There's one pretty big flaw with this approach... For certain searches that do not have "millions of results", you get completely unrelated results. If I search my name then the results are for names similar to mine, but not actually my name. This makes it completely useless for searching my name. I would think that there are many searches with this problem. I think there needs to be some kind of weighting system use…

The number of results aren't a factor. We are removing results from sites that are in the list of top 1 million most popular web sites. Hope that helps.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#97
I'm really liking this. Instead of being bombarded with content that's just blasted with keywords, I get relevant well-written articles. Not only that, but no more W3Schools in my SERP's. The chance to read an article that's written with humans in mind, instead of Google is more than enough reason to spend some more time using this.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#98

I would prefer if my previous search was populated in the search box after completing a search (since I might want to try the search with a different filter). It appears you have an "off by one issue" in the sidebar. There's always a blank entry in the list of ignored sites. Filtering does not seem to be working (or I don't understand it). Searching on "chicken" produced the same results with 1million or 100k removed…

Will add that feature. Thx

I neglected to mention... Awesome idea!

Re: Show HN: Imagine a search engine that removed top million sites from its index

#99
post #92
post #65

Earlier quoted context omitted.

I was able to rank for some moderately competitive terms just by paying someone minimum wage to go leave nice comments on dofollow blogs. The whole "Content is king" meme is a joke, really.

Interesting. How do you find blogs that don't implement nofollow?

Plenty of blogs promote themselves as DoFollow Blogs. It's a bit sad, really. They basically trade their "link juice" for your insincere, contrived comments.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#100
post #94

There's one pretty big flaw with this approach... For certain searches that do not have "millions of results", you get completely unrelated results. If I search my name then the results are for names similar to mine, but not actually my name. This makes it completely useless for searching my name. I would think that there are many searches with this problem. I think there needs to be some kind of weighting system use…

The number of results aren't a factor. We are removing results from sites that are in the list of top 1 million most popular web sites. Hope that helps.

Ah, this seems to be the case. It looks like you are dropping my name down to "thousand from results" despite it still saying "million from results".

Very nice!

Post reply on HN