Live data from Hacker News

Hnweekly: weekly top stories from Hacker News

hnweekly.watdahel.com

11–20 of 30 posts

Re: Hnweekly: weekly top stories from Hacker News

#13

I've been looking for something like this but didn't find one. btw I only started scraping like 2 days ago :) so it's not yet a week's worth of data. fyi: there's also http://news.ycombinator.com/lists which shows the top stories in 2 weeks

Lists are almost cool.

Allow us to choose: Today, Yesterday, Week, Month, Year

Re: Hnweekly: weekly top stories from Hacker News

#14

Cool idea. Anyway, I created a Top Stories Directory 2 days ago too. It will record down every number one stories starting from 2 days ago. But, it lost tracking some stories due to some bugs. But, I already fixed them all. http://hn.siong1987.com

It would be good if you provided links to the corresponding HN/comments pages as well as to the stories themselves.

Re: Hnweekly: weekly top stories from Hacker News

#15
post #12

Doesn't seem to handle non-ASCII very well: "Does Gdel matter?"

I might have problems with unicode in PHP (I really don't know much here yet) so I opted to remove them (for now) using regex.

btw I'm using http://simplehtmldom.sourceforge.net/ to scrape/parse which is great, it let's you use jquery style selectors on html.

Re: Hnweekly: weekly top stories from Hacker News

#16
post #12

Doesn't seem to handle non-ASCII very well: "Does Gdel matter?"

I might have problems with unicode in PHP (I really don't know much here yet) so I opted to remove them (for now) using regex. btw I'm using http://simplehtmldom.sourceforge.net/ to scrape/parse which is great, it let's you use jquery style selectors on html.

In that case, it should replace ö with o, etc.

Re: Hnweekly: weekly top stories from Hacker News

#19
post #16

Earlier quoted context omitted.

I might have problems with unicode in PHP (I really don't know much here yet) so I opted to remove them (for now) using regex. btw I'm using http://simplehtmldom.sourceforge.net/ to scrape/parse which is great, it let's you use jquery style selectors on html.

In that case, it should replace ö with o, etc.

I have a screenscraping thing in place that targets an ASCII only environment (LambdaMOO mud). Manually replacing unicode stuff like this has been a pain in the butt. Luckily that was all just for fun and didn't need to be perfect.

Is there a good library out there (in any language) that does good unicode --> ASCII substitutions for major languages?

Re: Hnweekly: weekly top stories from Hacker News

#20
post #19
post #16

Earlier quoted context omitted.

In that case, it should replace ö with o, etc.

I have a screenscraping thing in place that targets an ASCII only environment (LambdaMOO mud). Manually replacing unicode stuff like this has been a pain in the butt. Luckily that was all just for fun and didn't need to be perfect. Is there a good library out there (in any language) that does good unicode --> ASCII substitutions for major languages?

I once used latin1_to_ascii (The Unicode Hammer) in python: (works great) http://code.activestate.com/recipes/251871/
Post reply on HN