Live data from Hacker News

My Hacker News firehose

scripting.com

41–50 of 59 posts

Re: My Hacker News firehose

#41
What all of these posts fail to consider is that philosophically pg may want you writing code instead of consuming his community 101 different ways.

Just my 02. I visit hn daily, but I'm busy enough on my own work that the website suits my consumption needs.

Anyone else like me out there?

Re: My Hacker News firehose

#42
What incentive does Hacker News have to allow access via an API? At the moment, introducing an API would cost YC money because it would take time to develop and it would potentially increase server costs.

However, allowing others to do the job seems less troublesome.

Creating artificial restrictions to _prevent_ other people from doing so, seems like effort.

I would imagine that the owners of a site would only seek to stem the wholesale flow of information to another property, when inaction is likely to lead to a loss in value.

Where is the value in HN? It could be argued that the value lies in the posts and the related combined wisdom, but I think the true value is related to attention and focus. We come to HN to participate. If the content is allowed to spread to third-party applications (via an API), this primary source of value is lost.

Re: My Hacker News firehose

#44
post #29

Earlier quoted context omitted.

Yes. Caused both firefox 3.6.12 and safari 5.0.2 on osx to have fits. firefox on ubuntu and chrome seem to work without trouble.

Sorry about that. What do the fits look like? How much can they penalize you for opening a web page that has (what amounts to) a broken link? BTW, I use Firefox on the Mac, on machines that don't have my CMS running on it (that's what the link connects to) without problems.

On my machine they look like a macro-lens closeup of a sunflower in full bloom, or alternately, like an Archimedean Spiral or whatever.

Re: My Hacker News firehose

#45
The best way to get around the ban I think is to have low-latency distributed scraping.

Basically, a plugin that submits to RR's site whenever a user is surfing on HN. RR's site then parses it as usual.

The plugin could have some setting like max KB submitted per minute, and RR's site would only request the full page if it was needed at the time.

Re: My Hacker News firehose

#46
I think the idea behind HN is to have a place where you can go to chat when you are bored or feeling distractable. Having every story posted as its submitted is counterproductive -- it makes HN become a job (like reading Email) instead of something to do once in a while when you feel like it.

I miss probably about 90% of the stories on HN. I enjoy it anyway.

HN is a place to go, not a list of articles.

Re: My Hacker News firehose

#48
post #10
post #8

Earlier quoted context omitted.

I took down the site after YC blocked my IP address. I believe it was blocked as a result of increased usage from the explosion in traffic, resulting in some really heavy usage of the API. My guess is that YC's software did this automatically to prevent abuse. In addition, many folks weren't happy with me distributing the HN database. So there really wasn't a reason to keep it up. I'm going to rework the API such tha…

That's a real shame, I was thinking of building something on it too. I wish there was a way to get HN pages in simple JSON/XML.

Yeah, I was in the midst of playing with Gosu and thought about playing with it to get HN posts from the API. Sadly it went down.

Re: My Hacker News firehose

#49
post #40
post #39

Earlier quoted context omitted.

Have you tried this? This is something else I'm working on... http://viewtext.org/article?url=http%3A%2F%2Fnews.ycombinato... It will populate the RSS feed with the full content.

I'm generally disinclined to replace HN's existing RSS with someone else's RSS feed that might at any moment stop working. HN RSS sucks, but I never have to think about it. As someone else pointed out, I also depend on SearchYC, which is an external application. The difference is the SearchYC is extraordinarily well known. HN can't cut off SearchYC without alienating a sizeable group of site veterans. That's more tha…

I think that's an unfair and inconsistent application of logic.

I like reading HN and recently contributing tiny bits to HN because I think the community here is top-notch, friendly, and knows its stuff. HN never struck me as elitist; rather, it's more like a really friendly meritocracy. About the most elitist it gets is requiring a karma threshold to be able to downvote, but that's really just part of being a good meritocracy.

But to be accepting of one add-on application simply because of heavy site veteran patronage, while rejecting all others... THAT would strike me as heavy elitism and not in line with what seems to make HN so great. If add-on apps MUST be rejected, the criteria should be for other more respectable reasons, no? And mind you, it's all pg's call anyway.

Re: My Hacker News firehose

#50
post #3

I think it's interesting that Dave Winer decided to do this as a blog post instead of a HN discussion. Instead of having a conversation with the HN community he decided to have a conversation with his readers.

It would be stranger if he didn't post it on his blog. After all his blog has been around for almost 10 years longer than hacker news, was around before they were called blogs. Dave was also the guy that invented RSS.

Dave Winer did not invent RSS.
Post reply on HN