Live data from Hacker News

Poll: Should this site be visible to Yahoo, MSN crawlers?

news.ycombinator.com

51–60 of 98 posts

Re: Poll: Should this site be visible to Yahoo, MSN crawlers?

#51

My vote is to constrain growth as much as possible, at least that which comes from stupid sources. Smart hackers will find this site just fine without Yahoo or MSN, probably even Google. As "evil" as blocking sites and crawlers may sound, I think these types of measures will be necessary to preserve the quality of content here. Whatever actions further that objective have my vote.

If we're sacrificing equal competitive access just to "constrain growth as much as possible", maybe we could block certain browsers, too?

IE users aren't smart enough to change their defaults; Safari users are mindless Apple fanboys; Opera users are weird and talk with funny accents. Smart hackers will take the trouble to launch FF to access News.YC.

Anything to preserve the quality of content here!

Re: Poll: Should this site be visible to Yahoo, MSN crawlers?

#53
post #43

Earlier quoted context omitted.

Because News.YC doesn't have it's own search engine. So I use google to search the site.

Why not solve the real problem and set up a search engine for News.YC? This has other advantages such as controlling what shows up in the results, different ways to sort them, etc. It's easy to do with open-source software such as Solr (lucene.apache.org/solr) or Hounder (hounder.org, shameless plug because it is our product), which powers the wordpress.com site. Edit: it looks like someone already did this: searchyc…

You must be new here.

The day PG & Co adopt some piece of software that is made in Java... well, I can't even finish the sentence.

Re: Poll: Should this site be visible to Yahoo, MSN crawlers?

#57
post #43

Earlier quoted context omitted.

Why not solve the real problem and set up a search engine for News.YC? This has other advantages such as controlling what shows up in the results, different ways to sort them, etc. It's easy to do with open-source software such as Solr (lucene.apache.org/solr) or Hounder (hounder.org, shameless plug because it is our product), which powers the wordpress.com site. Edit: it looks like someone already did this: searchyc…

You must be new here. The day PG & Co adopt some piece of software that is made in Java... well, I can't even finish the sentence.

Part of the & Co is Paul Buchheit, who wrote some of the news.yc javascript. Paul Buchheit's company friendfeed is using lucene for search.

Re: Poll: Should this site be visible to Yahoo, MSN crawlers?

#58
post #46

Earlier quoted context omitted.

That is also hopelessly naïve.

You don't have to be insulting to make a point. I understand you may be using Google and like it, you must think about people using Yahoo as well. It is selfish of yours to base your judgment on your preference. If I'm missing something let me know.

I sincerely apologize. I deserved that. My grandfather passed away today.

Re: Poll: Should this site be visible to Yahoo, MSN crawlers?

#60
post #57

Earlier quoted context omitted.

You must be new here. The day PG & Co adopt some piece of software that is made in Java... well, I can't even finish the sentence.

Part of the & Co is Paul Buchheit, who wrote some of the news.yc javascript. Paul Buchheit's company friendfeed is using lucene for search.

i didn't know that.

Either way, I think that PG is the king of guy who would rather work on his very special design (staying in Arc-land as long as possible) than adopting systems where you no longer have control.

Letting Paul work on the JavaScript makes sense, in this case. PG has no control over client-side code, so he prefers to not bother with it.

Post reply on HN