Live data from Hacker News

Hacker Hacker News - see just the programming/math/science links from HN

hackerhackernews.com

41–50 of 58 posts

Re: Hacker Hacker News - see just the programming/math/science links from HN

#41
Here's the source: http://hackerhackernews.com/hhn-20090706.tgz

The classifier is already struggling. It doesn't seem that this is a sustainable way of classifying links, especially since the classification of technical/non-technical is arbitrary itself. I'll be trying out some other things to improve it today; email me if you want to chat about it.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#42
post #22
post #20

Earlier quoted context omitted.

What about a generic My Hacker News with a classifier trained on each person's personal "I want to see / I do not want to see" preferences? :>

HN doesn't need subreddits.

I don't want to see the community fragmented into walled gardens like subreddits (I'd rather see everyone focus on submitting the best possible links to the front page), but it would be interesting to have a front-page algorithm (or an additional page on "lists") that tries to predict not the best links, but my best links.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#43
post #8

Earlier quoted context omitted.

This sounds pretty awesome. Would you mind posting some of the code? I'd be curious to know how you're formatting the input data. If you're just using the title, all of the text parsed through BeautifulSoup, some parsing algorithm to obtain the body of the article, etc. Not too long ago, I wrote a python script to automatically extract the bodies of articles, which you may find useful: http://blog.davidziegler.net/po…

Thanks. I'll definitely post the code soon. I'm using the title, the submitter's name, the URL, and the page content without tags (only looking at and similar tags would probably help). Including the content of the HN comments pages might help, too. Thanks for the link; I'll check it out.

OK, the source is here: http://hackerhackernews.com/hhn-20090706.tgz

Re: Hacker Hacker News - see just the programming/math/science links from HN

#44
post #34
post #22

Earlier quoted context omitted.

HN doesn't need subreddits.

why? I notice you've received (18) upvotes, which in this case probable means agreement, so there's obviously some support for not having this feature. Is it specifically subreddits to avoid? I completely agree that subreddits are a terrible implementation of user-content customization because they force items into a single-parent hierarchy. However, categories that filter content according to different weights would…

The fear I have is it would splinter the community.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#45
post #12

Earlier quoted context omitted.

That doesn't sound very social. Aren't most programming/math/science also "time-wasting", so to speak?

People want to read about programming. Right now, there are three options: * News.YC, which rarely has articles about programming anymore (perhaps one or two a day). * Programming Reddit, whose commentators think every article is a jab at The One True Idea, which they seem to think is PHP. * Lambda the Ultimate, which only covers a small area of programming; language design and implementation I want a site like LtU b…

On the front page right now, there are eight programming submissions, and nine web development submissions.

(There is overlap with the programming and web development, but something like usability guidelines fits in web development but not programming. By my definition, anyway.)

Re: Hacker Hacker News - see just the programming/math/science links from HN

#46
post #41

Here's the source: http://hackerhackernews.com/hhn-20090706.tgz The classifier is already struggling. It doesn't seem that this is a sustainable way of classifying links, especially since the classification of technical/non-technical is arbitrary itself. I'll be trying out some other things to improve it today; email me if you want to chat about it.

FYI I'm having problems decompressing this file. Could you re-post it? or alternatively throw the code up on something like github?

Re: Hacker Hacker News - see just the programming/math/science links from HN

#47
post #44
post #34

Earlier quoted context omitted.

why? I notice you've received (18) upvotes, which in this case probable means agreement, so there's obviously some support for not having this feature. Is it specifically subreddits to avoid? I completely agree that subreddits are a terrible implementation of user-content customization because they force items into a single-parent hierarchy. However, categories that filter content according to different weights would…

The fear I have is it would splinter the community.

But HN has become so big. It not logical to think that everyone will be interested by everything now.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#48
post #2

I made this in a few hours for my own personal use and thought that other people might want to use it, too. It uses a Python Bayesian classifier trained on about 200 hand-labeled links and outputs a static HTML file. It's not perfect (and the technical/non-technical distinction is arbitrary), but I'll give it some more training data and see if it improves. Also, I don't mean to disparage non-technical topics with thi…

Could you make a page that is the exact opposite? Non Hacker Hacker News?

Re: Hacker Hacker News - see just the programming/math/science links from HN

#49
post #2

I made this in a few hours for my own personal use and thought that other people might want to use it, too. It uses a Python Bayesian classifier trained on about 200 hand-labeled links and outputs a static HTML file. It's not perfect (and the technical/non-technical distinction is arbitrary), but I'll give it some more training data and see if it improves. Also, I don't mean to disparage non-technical topics with thi…

I think you've stumbled on something that Hacker News needs: Categories.

I think that we'd be better with tagging than categories per se. Give people a finate list of tags to choose from and people could customize their views pretty easily.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#50
post #46
post #41

Here's the source: http://hackerhackernews.com/hhn-20090706.tgz The classifier is already struggling. It doesn't seem that this is a sustainable way of classifying links, especially since the classification of technical/non-technical is arbitrary itself. I'll be trying out some other things to improve it today; email me if you want to chat about it.

FYI I'm having problems decompressing this file. Could you re-post it? or alternatively throw the code up on something like github?

Hmm...tar xzfv hhn-20090706.tgz doesn't work for you?
Post reply on HN