Live data from Hacker News

Show HN: Imagine a search engine that removed top million sites from its index

millionshort.com

51–60 of 204 posts

Re: Show HN: Imagine a search engine that removed top million sites from its index

#53
post #18

I'd really like to see randomization instead. Return results picked randomly from within the top 10 million or something.

I'm not sure this is a great idea. Predictability is a staple of a good user experience. Getting different results for the same query between users or sessions is bound to lead to broken expectations and frustration.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#54

I searched for "Hero Academy" and the first result was Google's 5th result, a site called Hero Academy with the url "hero-academy.com". That's not very "million short", IMHO.

The site removes the top million sites by popularity, not the first million results returned by a Google search. "hero-academy.com" is likely not in the top million most popular sites.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#55
post #46

Well that's one way to break out of the filter-bubble/echo-chamber I suppose. If only our best search technology was based on something better than a popularity contest :(

Popularity I think is important. But not at the expense of relevance. It's not a easy nut to crack.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#56
post #53
post #18

I'd really like to see randomization instead. Return results picked randomly from within the top 10 million or something.

I'm not sure this is a great idea. Predictability is a staple of a good user experience. Getting different results for the same query between users or sessions is bound to lead to broken expectations and frustration.

Think of this as more of a discovery engine. And predictability takes the fun out of discovery.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#57
post #49

The results are surprisingly good. I did some searches for recipes, and frankly without the top 1000 you really start getting some fresh hits. Entries by real people, rather than sites raking up recipes for a hit.

We're surprising ourselves too.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#59
It means that our ranking algorithms have good recall but very poor precision. We value web page connectivity more than its content. We don't know how to teach machines to evaluate web page for its merit so we hope that a large number of Twitting, Liking and Plusing non-experts will approximate single expert. Millionshort shows that this model isn't good enough.

Re: Show HN: Imagine a search engine that removed top million sites from its index

#60
post #49

The results are surprisingly good. I did some searches for recipes, and frankly without the top 1000 you really start getting some fresh hits. Entries by real people, rather than sites raking up recipes for a hit.

First thing i used it for was recipes too! Started to find little blogs, or sites outside of north america, with some great Vegetarian recipes.
Post reply on HN