Live data from Hacker News

Hacking Hacker News

joelgrus.com

51–54 of 54 posts

Re: Hacking Hacker News

#52

FYI, the new Hacker News API allows easy programmatic access of story/comments and infinite chronological paging. You could download every Hacker News story in less than 2 hours without breaking the API request limit. https://hn.algolia.com/api

There's a list of all the apps that have been built based on this API: http://hn.algolia.com/cool_apps

Yup, I've switched over my Chrome extension [1] to use Algolia's API instead of HNSearch (which is shutting down), and so far, it seems to be working peachy.

[1]: https://chrome.google.com/webstore/detail/hacker-news-sideba...

Re: Hacking Hacker News

#53
post #27

Earlier quoted context omitted.

Was this there when you posted?: RATE LIMITS We are limiting the number of API requests from a single IP to 1000 per hour. If you or your application has been blacklisted and you think there has been an error, please contact us.

Yes, that was there, and the math is still correct. You can query 1,000 stories per request, and do 1,000 requests per hour. That's 1M requests per hour. There are 1.26M Hacker News stories indexed by the API. :) EDIT: Finished downloading all the entries (and can confirm that 1.26M is indeed all of them). Took 3 hours due to a conservative wait period between each request to make sure I stayed within the limits.

How big is that dataset? Can you share it somehow?

Re: Hacking Hacker News

#54
I just use the 50 or 100 point minimum feed in my reader, and skip articles that don't look interesting based on how much time I want to spend. Sometimes I only read articles if they're a day old and the first comment makes them look interesting.
Post reply on HN