Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#1

Post by StavrosK » Sun, Jan 09, 2011, 11:52 PM UTC

Over a weekend at a friend's house we wrote a text classifier that classifies comments as stupid/clever. We used various techniques to train it, but here it is:

http://www.pythiafilter.com/

It doesn't understand content, only style (mostly), so if you post something incoherent but grammatical it will probably think it's clever. It's not perfect, but it got 94% accuracy or so on the test set (which, admittedly, wasn't of very high quality). YMMV, and this is just something we did for fun one day, so don't take anything it says seriously.

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#2

Post by StavrosK » Sun, Jan 09, 2011, 11:52 PM UTC

Clickable: http://www.pythiafilter.com/

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#3

Post by mishmash » Mon, Jan 10, 2011, 12:06 AM UTC

StavrosK wrote: post #2

Clickable: http://www.pythiafilter.com/

Is it possible to link to the results page to pass it around?

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#4

Post by fluin » Mon, Jan 10, 2011, 12:19 AM UTC

"pythia" and "Pythai" and even "yhtapi" gets high quality but "hytapi" doesn't. Interesting...

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#5

Post by StavrosK » Mon, Jan 10, 2011, 12:26 AM UTC

mishmash wrote: post #3

StavrosK wrote: post #2

Clickable: http://www.pythiafilter.com/

Is it possible to link to the results page to pass it around?

Unfortunately not, it doesn't store anything for now, it's an API that just gives you a 0/1 for stupid/clever. That's a good suggestion, though. I'll add a feature to save the results and give you a link in exchange for manually marking your text as stupid/clever, so the filter gets trained.

A sort of a "tit for tat" scenario, it might actually work well, thank you for the suggestion!

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#6

Post by mishmash » Mon, Jan 10, 2011, 12:34 AM UTC

StavrosK wrote: post #5

mishmash wrote: post #3

Earlier quoted context omitted.

Is it possible to link to the results page to pass it around?

Unfortunately not, it doesn't store anything for now, it's an API that just gives you a 0/1 for stupid/clever. That's a good suggestion, though. I'll add a feature to save the results and give you a link in exchange for manually marking your text as stupid/clever, so the filter gets trained. A sort of a "tit for tat" scenario, it might actually work well, thank you for the suggestion!

Cool good luck with it. :)

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#7

Post by requinot59 » Mon, Jan 10, 2011, 12:46 AM UTC

"I think a grain of salt have more value than a possible bird might shake nowadays then caliber it for turtles and China."

Mark V. Shaney -- High quality troller since 1983 ;-)

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#8

Post by candre717 » Mon, Jan 10, 2011, 12:57 AM UTC

Will you be releasing the source code?

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#9

Post by StavrosK » Mon, Jan 10, 2011, 1:27 AM UTC

candre717 wrote: post #8

Will you be releasing the source code?

Unfortunately no, I'm thinking of developing it further into a full-blown comment classifier for forums/etc.

Re: Show HN: My weekend project: A classifier that classifies text as stupid/clever.

#10

Post by StavrosK » Mon, Jan 10, 2011, 1:35 AM UTC

mishmash wrote: post #6

StavrosK wrote: post #5

Earlier quoted context omitted.

Unfortunately not, it doesn't store anything for now, it's an API that just gives you a 0/1 for stupid/clever. That's a good suggestion, though. I'll add a feature to save the results and give you a link in exchange for manually marking your text as stupid/clever, so the filter gets trained. A sort of a "tit for tat" scenario, it might actually work well, thank you for the suggestion!

Cool good luck with it. :)

Thanks :)