Live data from Hacker News

Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

litfuel.net

11–20 of 26 posts

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#11
post #6
post #3

A blinking favicon? Seriously? I couldn't finish the article because my eyes jumped to the tab bar every 5 seconds. Has anyone else seen this elsewhere? It's new to me and I was surprised by how obnoxious it was given that the web isn't exactly a stranger to obnoxious flashing content.

It doesn't blink for me. (In case you're wondering why you're getting downvoted -- though I didn't downvote you myself.)

[EDIT: Can't edit the top message anymore, but the problem was broken browser and amusing 'blink' vs ' blink' confusion as detailed deeper in the thread. Also in chrome it doesn't appear to animate, removing the annoyance entirely.]

Interesting. I asked a few coworkers if it was just me and they confirmed it. The actual favicon doesn't blink for you? http://www.litfuel.net/favicon.ico

It reports itself as a 6 frame gif for me. Maybe your browser is just more sane than mine (Firefox 3.x) and refuses to honor animated favicons?

I figured I was getting rightly downvoted because I wasn't saying anything about NLTK.

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#12
post #11
post #6

Earlier quoted context omitted.

It doesn't blink for me. (In case you're wondering why you're getting downvoted -- though I didn't downvote you myself.)

[EDIT: Can't edit the top message anymore, but the problem was broken browser and amusing 'blink' vs ' blink' confusion as detailed deeper in the thread. Also in chrome it doesn't appear to animate, removing the annoyance entirely.] Interesting. I asked a few coworkers if it was just me and they confirmed it. The actual favicon doesn't blink for you? http://www.litfuel.net/favicon.ico It reports itself as a 6 frame g…

I tried Firefox 3.6 out of curiosity, and it doesn't blink, even when I open the favicon itself in a browser tab. I think you must have changed your browser config at some point and forgotten about it.

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#13
post #12
post #11

Earlier quoted context omitted.

[EDIT: Can't edit the top message anymore, but the problem was broken browser and amusing 'blink' vs ' blink' confusion as detailed deeper in the thread. Also in chrome it doesn't appear to animate, removing the annoyance entirely.] Interesting. I asked a few coworkers if it was just me and they confirmed it. The actual favicon doesn't blink for you? http://www.litfuel.net/favicon.ico It reports itself as a 6 frame g…

I tried Firefox 3.6 out of curiosity, and it doesn't blink, even when I open the favicon itself in a browser tab. I think you must have changed your browser config at some point and forgotten about it.

So this is actually pretty funny.

In my local version of firefox, the entire icon vanishes for about 5 seconds, every 5 seconds. Causing a notable visual disturbance. In Chrome on another system the eyes blink every 5 seconds or so. So yeah, my browser is being broken.

But when I asked people if it blinked ... they, of course, said yes.

EDIT: Also, as noted in an edit above, when viewed in Chrome it didn't animate unless the image was accessed directly. So for you it may blink, not blink, or really blink, depending on your browser and configuration...

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#15
post #5

92% accuracy, unfortunately, isn't good enough. Bag-of-words models perform pretty well at classification and search, and the main thing you need to improve search is to boost scores when words are close together. You might think you could improve performance by using semantically better defined features, but even 92% accuracy adds enough noise to foil your plans. It's a big problem in A.I. systems that have multiple…

Perhaps 92% is poor in a lot of scenarios, but for this type of approach it's a good accuracy (within some 1-delta confidence). The unfortunate part is that it really was just a simple naive bayes bag-of-words, and it's not surprising that it did so well on one test case (apple). Extending that to help general NLP in any way would be much more difficult.

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#16

He did it for one word. Bad article title.

It was actually a method of using wikipedia to build your corpus for any ambiguous word to automatically build some word sense disambiguation in your application. One word was just a simple example of using that data.

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#17
post #7

I always prefer to see these things in context (how well does a naive rule-based classifier do? what's the P/R/F-score i.e. how many Apples are apples and apples are Apples? What about Apple Records?) It's still fun to remember how quick and easy something like this is though. Any interest in similar articles on named entity recognition, sentiment/topic classification and spam filtering? I've been meaning to do a few…

I'd love to see some more articles on the subject out there, definitely take the time to post something. Entity or sentiment would be my first choices :)

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#19
post #5

92% accuracy, unfortunately, isn't good enough. Bag-of-words models perform pretty well at classification and search, and the main thing you need to improve search is to boost scores when words are close together. You might think you could improve performance by using semantically better defined features, but even 92% accuracy adds enough noise to foil your plans. It's a big problem in A.I. systems that have multiple…

92% in general would actually be really good for word sense disambiguation, but..."Apple" is a really easy choice. I'd like to see how he does with a trickier word like "right" (as in civil, vs. not wrong, vs. not left).

Re: Python NLTK Bayesian Classifier for word sense disambiguation - 92% accuracy

#20
I'm surprised that no one mentioned this paper that first evaluated this approach to using Wikipedia data: http://www.aaai.org/Papers/IJCAI/2007/IJCAI07-259.pdf That said, the major drawback of using Wikipedia is the size. If this approach is to be used for all words (not just Apple) then the total training corpus will be several GBs. Definitely not practical...
Post reply on HN