Poll: Should this site be visible to Yahoo, MSN crawlers?
31–40 of 98 posts
Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#32If the main aim is to constrain growth, wouldn't it make more sense to block popular Google, and allow a less-used engine for utility search?
I got the impression a few weeks ago (from this comment -- http://news.ycombinator.com/item?id=146623) that you were OK with inlink-driven growth; has something changed?
Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#33I agree to the site being invisible to yahoo, msn, ask, etc. At the same time, please let the newer/upcoming search engines crawl the site, else, google would become IE circa 2000-2004 and there would be very little innovation in search. my 2 cents.
A principle of equal access by any well-behaved search engine is the only policy which supports startups and diversity. The market already has a winner-take-all quality; why make it even worse for competition?
Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#34Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#35And, I'd say that if there was a way to ban Google search, but have a decent way to search HN, then I'd say ban Google, too. But at very least I think that Yahoo and MSN search could be banned.
Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#36I assume that resource is not a problem for YC. This fact, coupled with YC not having a search feature, leads me to believe that it's better for YC community that this site is indexed by more than just one search engine.
One big reason, as pointed out by Tichy, is that not all of us use Google as our primary search engine. By cutting off Yahoo, MSN, etc, but not Google, you would essentially be forcing us to use it to search the content of this site. Do that and you could be going down a slippery slope.
And I agree with the "ban all or ban none" mentality.
Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#37Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#38Allow all or ban all. let's make fairness a rule on the internet, it gives a chance to all startup to emerge by giants side. If Yahoo was not fair to Google no one knows what would have happened.
Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#39why not block all search engines?
http://www.google.com/search?q=site%3Anews.ycombinator.com+y... There's no other search.
Re: Poll: Should this site be visible to Yahoo, MSN crawlers?
#40:)