Live data from Hacker News

My Hacker News firehose

scripting.com

1–10 of 59 posts

Re: My Hacker News firehose

#2
Hacker News isn't a potentially valuable Internet resource waiting to be mined for interesting new applications. That's Twitter. Hacker News is an actual community.

I don't know or care why the API got blocked, but I've been as happy with as many HN add-on apps as I have been incredibly irritated by them (paging: guy who scraped all HN job postings and made his own job site with them). From what I can tell, it's not actually part of this site's philosophy to be a building block for other people's software ideas.

Re: My Hacker News firehose

#3
I think it's interesting that Dave Winer decided to do this as a blog post instead of a HN discussion.

Instead of having a conversation with the HN community he decided to have a conversation with his readers.

Re: My Hacker News firehose

#5
post #2

Hacker News isn't a potentially valuable Internet resource waiting to be mined for interesting new applications. That's Twitter. Hacker News is an actual community. I don't know or care why the API got blocked, but I've been as happy with as many HN add-on apps as I have been incredibly irritated by them (paging: guy who scraped all HN job postings and made his own job site with them). From what I can tell, it's not…

Are you against http://searchyc.com?

Are you against Gabriel Weinberg's Ask YC archive (http://www.gabrielweinberg.com/startupswiki/Ask_YC_Archive)? Would you like it less if he built it automatically instead of manually (cf. http://metaoptimize.com/projects/autotag/hackernews/)?

I agree that the job posting site was really tacky, but that guy entered all the data manually anyhow.

I think in sum total that most add-ons are pointless. A few are useless. And only a very small fraction are bad, and should be dealt with on a case-by-case basis.

Re: My Hacker News firehose

#6
post #2

Hacker News isn't a potentially valuable Internet resource waiting to be mined for interesting new applications. That's Twitter. Hacker News is an actual community. I don't know or care why the API got blocked, but I've been as happy with as many HN add-on apps as I have been incredibly irritated by them (paging: guy who scraped all HN job postings and made his own job site with them). From what I can tell, it's not…

You misunderstood what I was saying. Start with the firehose. I don't want it to make money, I want it so I can link this flow in with other flows that I'm following without having to visit all the sites. Not trying to make a business, just scratching my own itch having no idea where it leads.

Re: My Hacker News firehose

#7
post #3

I think it's interesting that Dave Winer decided to do this as a blog post instead of a HN discussion. Instead of having a conversation with the HN community he decided to have a conversation with his readers.

That's not what I "decided" at all.

I do my writing on my blog. That's the way I work.

Happy to participate in a discussion here.

Re: My Hacker News firehose

#8
post #4

>Apparently that's because Hacker News has blocked his API. Does anyone know if this is actually the case? http://api.ihackernews.com gives me a 404, but I'm posting this from ihackernews's browser interface, which obviously is getting updates.

I took down the site after YC blocked my IP address. I believe it was blocked as a result of increased usage from the explosion in traffic, resulting in some really heavy usage of the API. My guess is that YC's software did this automatically to prevent abuse.

In addition, many folks weren't happy with me distributing the HN database. So there really wasn't a reason to keep it up.

I'm going to rework the API such that it will work within the boundary of an acceptable scrapping rate. I'm not putting the database back up.

Re: My Hacker News firehose

#9
post #4

>Apparently that's because Hacker News has blocked his API. Does anyone know if this is actually the case? http://api.ihackernews.com gives me a 404, but I'm posting this from ihackernews's browser interface, which obviously is getting updates.

[deleted]

Re: My Hacker News firehose

#10
post #8
post #4

>Apparently that's because Hacker News has blocked his API. Does anyone know if this is actually the case? http://api.ihackernews.com gives me a 404, but I'm posting this from ihackernews's browser interface, which obviously is getting updates.

I took down the site after YC blocked my IP address. I believe it was blocked as a result of increased usage from the explosion in traffic, resulting in some really heavy usage of the API. My guess is that YC's software did this automatically to prevent abuse. In addition, many folks weren't happy with me distributing the HN database. So there really wasn't a reason to keep it up. I'm going to rework the API such tha…

That's a real shame, I was thinking of building something on it too. I wish there was a way to get HN pages in simple JSON/XML.
Post reply on HN