Wow... It felt like using Google 10 years ago. I think you are onto something.
Show HN: Imagine a search engine that removed top million sites from its index
21–30 of 204 posts
Re: Show HN: Imagine a search engine that removed top million sites from its index
#22Great idea, although I think if you could explain it a bit better you could avoid the confusion like several of these comments are showing. I like how my Hacker Newsletter project shows up #2 when searching for Hacker News. :)
And how do you determine the "top" million sites?
Re: Show HN: Imagine a search engine that removed top million sites from its index
#23Wow... It felt like using Google 10 years ago. I think you are onto something.
Wow.. awesome comliment..
Re: Show HN: Imagine a search engine that removed top million sites from its index
#24How did you build this? Are you indexing the entire web yourself? Or are you using Google's index/removing the top 1 million based on domain?
Re: Show HN: Imagine a search engine that removed top million sites from its index
#25I'd be fascinated to see the kind of SEO that would go on if this took off. "Bad news-- we're a top 100 hit for several of our main keywords. We'll have to change our URL scheme again."
High page rank pages / sites could start holding competitors' pages hostage by linking to them.
Maybe we'd see a resurgence in Flash.
Re: Show HN: Imagine a search engine that removed top million sites from its index
#26Only a little thing, could do with maintaining query strings between pages. It lost my query string and returned no results when I changed the drop down without me noticing.
Good catch. Will fix. Thx
Re: Show HN: Imagine a search engine that removed top million sites from its index
#27What is the ranking used for the top million sites? A search result for "Australia" returns as the top result http://australia.gov.au, which Alexa ranks as 20,615 globally. Actually, a lot of the queries I tried returned Australian sites.
http://millionshort.com/search.php?q=australia&remove=10...
http://millionshort.com/search.php?q=somalia&remove=1000... -- another Australian site.
Re: Show HN: Imagine a search engine that removed top million sites from its index
#28How did you build this? Are you indexing the entire web yourself? Or are you using Google's index/removing the top 1 million based on domain?
I think search APIs like Yahoo BOSS allow you pass arguments that contain a black list of domains. I think it's the 'sites' argument that may be used like this: &sites=-google.com
Re: Show HN: Imagine a search engine that removed top million sites from its index
#29Not sure if I found an anomaly or what, but a simple search of "Privacy" returns results from thesaurus.com, merriam-webster.com, truste.com, kelloggcompany.com, and many more that are all in the top few thousand according to QuantCast and Compete.
Great idea though, will definitely try this out some more.
Re: Show HN: Imagine a search engine that removed top million sites from its index
#30What is the ranking used for the top million sites? A search result for "Australia" returns as the top result http://australia.gov.au , which Alexa ranks as 20,615 globally. Actually, a lot of the queries I tried returned Australian sites. http://millionshort.com/search.php?q=australia&remove=10... http://millionshort.com/search.php?q=somalia&remove=1000... -- another Australian site.
Right now the filtering is not 100% working for non .com, .net, .org, .co.uk domains. So, .gov.au isn't being properly filtered yet. Soon.