11–20 of 82 posts
I'm not sure of the exact criteria for it, but its basically very highly-voted articles that are fairly recent.
I've been thinking of limiting myself to /best to keep my HN time in check, so you're definitely onto something.
I really like this idea and will give it a try, but FYI http://news.ycombinator.com/best serves a similar purpose. I'm not sure of the exact criteria for it, but its basically very highly-voted articles that are fairly recent. I've been thinking of limiting myself to /best to keep my HN time in check, so you're definitely onto something.
How do you decide the top 10 links of the day if you scrape every 5 minutes? (the top links keep changing). Couldn't you just scrape once a day?
I could scrape the entire site at midnight each day, but I think PG would be very unhappy with me if I did that. Scaping /news every 5 minutes imposes much less load, and since highly ranked links get almost all of their votes prior to falling off the front page, this gives me almost as much information.
How do you decide the top 10 links of the day if you scrape every 5 minutes? (the top links keep changing). Couldn't you just scrape once a day?
The /news page ranks links based on score and time since submission. I'm only ranking links based on score (and whether it has been on a previous daily). I could scrape the entire site at midnight each day, but I think PG would be very unhappy with me if I did that. Scaping /news every 5 minutes imposes much less load, and since highly ranked links get almost all of their votes prior to falling off the front page, th…
Do you mind sharing the scraping code?
Earlier quoted context omitted.
The /news page ranks links based on score and time since submission. I'm only ranking links based on score (and whether it has been on a previous daily). I could scrape the entire site at midnight each day, but I think PG would be very unhappy with me if I did that. Scaping /news every 5 minutes imposes much less load, and since highly ranked links get almost all of their votes prior to falling off the front page, th…
I'm guessing that for your purpose, you might catch more interesting stories from the /classic page than /news. Do you mind sharing the scraping code?
Earlier quoted context omitted.
Yeah, I tend to find the really interesting stories are not the top of the page ones. Love in the age of the pickup artist? Sorry, couldn't care less.
Remember that being at the top of the front page at some point during the day does not necessarily mean that an article is in the top 10 links for the day. I think looking at scores -- without looking at how long it took for those scores to be reached -- probably weights in favour of more "interesting" stories and against link-bait stories, simply because the link-bait tends to accumulate most of its votes very quick…
Earlier quoted context omitted.
Remember that being at the top of the front page at some point during the day does not necessarily mean that an article is in the top 10 links for the day. I think looking at scores -- without looking at how long it took for those scores to be reached -- probably weights in favour of more "interesting" stories and against link-bait stories, simply because the link-bait tends to accumulate most of its votes very quick…
So the derivative in respect to points over time of the link bait story would be much higher than non link bait story?