Hacker Hacker News - see just the programming/math/science links from HN • Hacker News Board

Re: Hacker Hacker News - see just the programming/math/science links from HN

#21

Post by jlees » Mon, Jul 06, 2009, 9:49 AM UTC

10ren wrote: post #16

sqs wrote: post #7

Earlier quoted context omitted.

Yeah, it's amazingly accurate for now only because the training data consists of a high percentage of the actual data set, and so it's probably classifying based on those insignificant differences. We'll see how it holds up...

I think you're training it on the submission titles - I wonder if the text of the websites themselves might be more accurate. Certainly richer. But it's quite possible that the submission titles are more accurate.

Says above he's using body text.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#22

Post by mahmud » Mon, Jul 06, 2009, 9:52 AM UTC

jlees wrote: post #20

markbao wrote: post #14

Earlier quoted context omitted.

Now we need Startup Hacker News.

What about a generic My Hacker News with a classifier trained on each person's personal "I want to see / I do not want to see" preferences? :>

HN doesn't need subreddits.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#23

Post by jrockway » Mon, Jul 06, 2009, 10:12 AM UTC

ersi wrote: post #12

jrockway wrote: post #3

Earlier quoted context omitted.

Excellent work; I am worried that I am going to have to start my own social news site to get away from all the time-wasting general interest stuff here. This will save me from having to do that for a while.

That doesn't sound very social. Aren't most programming/math/science also "time-wasting", so to speak?

People want to read about programming. Right now, there are three options:

* News.YC, which rarely has articles about programming anymore (perhaps one or two a day).

* Programming Reddit, whose commentators think every article is a jab at The One True Idea, which they seem to think is PHP.

* Lambda the Ultimate, which only covers a small area of programming; language design and implementation

I want a site like LtU but with a broader appeal.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#24

Post by mkyc » Mon, Jul 06, 2009, 10:13 AM UTC

A big problem with these tools is that very few will abandon this place for a slightly ugly replacement, even if it does offer something somewhat useful. If you provide an API, someone might write a script/bookmark that added the percentages to the posts here, or color coded them.

Are you training on comments as well? My bet is that the comments section will be more useful for this than the actual article.

Incidentally, I really wish that upvotes and the like were publicly visible. This would surely result in a similar tool, but for a recommendation system.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#25

Post by swombat » Mon, Jul 06, 2009, 10:51 AM UTC

I_got_fifty wrote: post #18

I love that the announcement of Hacker Hacker News on Hacker News is on Hacker Hacker News! ...so meta!

Surely an announcement about Hacker Hacker News is not Hacker Hacker News itself, so it should not be on there.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#26

Post by jules » Mon, Jul 06, 2009, 10:55 AM UTC

jrockway wrote: post #23

ersi wrote: post #12

Earlier quoted context omitted.

That doesn't sound very social. Aren't most programming/math/science also "time-wasting", so to speak?

People want to read about programming. Right now, there are three options: * News.YC, which rarely has articles about programming anymore (perhaps one or two a day). * Programming Reddit, whose commentators think every article is a jab at The One True Idea, which they seem to think is PHP. * Lambda the Ultimate, which only covers a small area of programming; language design and implementation I want a site like LtU b…

> * Lambda the Ultimate, which only covers a small area of programming; language design and implementation

Implementation (!= Programming Language Theory) is off topic for LTU, unfortunately.

Re: Hacker Hacker News - see just the programming/math/science links from HN

#27

Post by rms » Mon, Jul 06, 2009, 11:06 AM UTC

kristiandupont wrote: post #19

I_got_fifty wrote: post #18

I love that the announcement of Hacker Hacker News on Hacker News is on Hacker Hacker News! ...so meta!

Really, it should be posted on Hacker News News.. (Sorry, I'll go out of Reddit mode now.)

http://ycombinator.com/newsnews.html

Re: Hacker Hacker News - see just the programming/math/science links from HN

#28

Post by prakash » Mon, Jul 06, 2009, 11:32 AM UTC

sqs wrote: post #2

I made this in a few hours for my own personal use and thought that other people might want to use it, too. It uses a Python Bayesian classifier trained on about 200 hand-labeled links and outputs a static HTML file. It's not perfect (and the technical/non-technical distinction is arbitrary), but I'll give it some more training data and see if it improves. Also, I don't mean to disparage non-technical topics with thi…

This is really cool. Maybe you can use these links to train: (http://www.gabrielweinberg.com/startupswiki/Ask_YC_Archive)

Re: Hacker Hacker News - see just the programming/math/science links from HN

#29

Post by prakash » Mon, Jul 06, 2009, 12:27 PM UTC

sqs wrote: post #2

I made this in a few hours for my own personal use and thought that other people might want to use it, too. It uses a Python Bayesian classifier trained on about 200 hand-labeled links and outputs a static HTML file. It's not perfect (and the technical/non-technical distinction is arbitrary), but I'll give it some more training data and see if it improves. Also, I don't mean to disparage non-technical topics with thi…

Have you considered applying to the YC program with this/variant of this idea?

Re: Hacker Hacker News - see just the programming/math/science links from HN

#30

Post by dgallagher » Mon, Jul 06, 2009, 12:57 PM UTC

sqs wrote: post #2

I made this in a few hours for my own personal use and thought that other people might want to use it, too. It uses a Python Bayesian classifier trained on about 200 hand-labeled links and outputs a static HTML file. It's not perfect (and the technical/non-technical distinction is arbitrary), but I'll give it some more training data and see if it improves. Also, I don't mean to disparage non-technical topics with thi…

I think you've stumbled on something that Hacker News needs: Categories.