StupidFilter - Detect stupid text • Hacker News Board

Re: StupidFilter - Detect stupid text

#21

Post by RyanMcGreal » Fri, Nov 13, 2009, 6:27 PM UTC

tedunangst wrote: post #12

"How is babby formed?" -> Text is not likely to be stupid. Incorrect.

They need to do way instain filter>

Re: StupidFilter - Detect stupid text

#22

Post by sgk284 » Fri, Nov 13, 2009, 6:28 PM UTC

erikwiffin wrote: post #5

hassy wrote: post #3

Anyone up for StupidGolf? :-) My entry: "haha... lol" (11 chars)

I win. "!" (1 char) is likely to be stupid.

I feel like the bigger challenge is finding the smallest piece of text that isn't considered stupid. I hypothesized that this would be difficult, but it turns out 'a' isn't likely to be stupid.

Re: StupidFilter - Detect stupid text

#23

Post by jey » Fri, Nov 13, 2009, 6:29 PM UTC

yan wrote: post #14

emmett wrote: post #2

Try submitting YouTube comments to the demo. This is shockingly accurate.

I think you just discovered its training dataset

Exactly right: http://stupidfilter.org/random.php

Re: StupidFilter - Detect stupid text

#24

Post by eggoa » Fri, Nov 13, 2009, 6:29 PM UTC

I hope this doesn't end up equating having English as a second language with supidity.

Re: StupidFilter - Detect stupid text

#25

Post by jpeterson » Fri, Nov 13, 2009, 6:30 PM UTC

tedunangst wrote: post #12

"How is babby formed?" -> Text is not likely to be stupid. Incorrect.

This looks stupid to you because you see it in the context of a stupid meme. When seen this way:

    How is  formed?

It doesn't look stupid at all.

Re: StupidFilter - Detect stupid text

#26

Post by Emore » Fri, Nov 13, 2009, 6:43 PM UTC

This is, apparently, not likely to be stupid:

Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

Re: StupidFilter - Detect stupid text

#27

Post by tcskeptic » Fri, Nov 13, 2009, 7:02 PM UTC

smallblacksun wrote: post #17

first! is classified as "not likely to be stupid", which shows how much work it needs.

It probably just indicates that they have not pointed it at Slashdot comments as a training set yet.

Re: StupidFilter - Detect stupid text

#28

Post by [deleted] » Fri, Nov 13, 2009, 8:27 PM UTC

lsb wrote: post #13

onewland wrote: post #11

I think this is barfing on a lack of punctuation. "this is the most shittest game online ever full of little nooby kids" (taken from a youtube comment) is "not likely stupid". Add a period at the end, though, and it works. Maybe the parsing system isn't designed to handle incomplete sentences or sentence fragments? That could be difficult but key; many of the bottom of the barrel posts on the internet have no punctua…

Unrelatedly, one of the challenges in analyzing modern text with traditional NLP tools is that the tools usually expect standard English, whereas the text is rather colloquial, and the punctuation is for timing purposes, when present at all.

[deleted]

Re: StupidFilter - Detect stupid text

#29

Post by [deleted] » Fri, Nov 13, 2009, 8:30 PM UTC

[deleted]

Re: StupidFilter - Detect stupid text

#30

Post by NickM » Fri, Nov 13, 2009, 10:03 PM UTC

If something like this was actually used, I predict we would just see a shift from "I'm in ur base, killin ur doods" to "I am in your base, and I am in the process of killing your dudes."