I want to write a program that can classify the input. For example, if the input is Japan, it should output country. For reddit --> website. Ferrari --> car. For certain things it is as easy as looking at the first sentence of Wikipedia for that word. But I want to get more specific such as Ferrari --> car --> sports car, or reddit --> website --> website with user generated content. I am sure people have done this in NLP, a pointer to where I should start would be very much appreciated.
What is an easy way to classify a word?
1–7 of 7 posts
Re: What is an easy way to classify a word?
#2I'm not sure if this is what you're looking for, but most often classification/entity extraction is done by using statistical models/machine learning.
You would take a corpus of documents and manually "tag" them with the entities you're looking for and designate that as your training corpus. You would then run that through a machine learning algorithm (such as https://opennlp.apache.org/), and then use the resulting model to process text and identify the entities it was trained on.
Re: What is an easy way to classify a word?
#3Not sure if it's exactly what you're looking for, but you might want to check out WordNet, a lexical database. You can first try it online to see if it fits your needs: http://wordnetweb.princeton.edu/perl/webwn
Re: What is an easy way to classify a word?
#4I think the technical term is "tagging". Check out the Natural Language Toolkit. http://www.nltk.org/
Re: What is an easy way to classify a word?
#5I think the technical term is "tagging". Check out the Natural Language Toolkit. http://www.nltk.org/
Thank you! This is exactly what I am looking for.
Re: What is an easy way to classify a word?
#6I'm not sure if this is what you're looking for, but most often classification/entity extraction is done by using statistical models/machine learning. You would take a corpus of documents and manually "tag" them with the entities you're looking for and designate that as your training corpus. You would then run that through a machine learning algorithm (such as https://opennlp.apache.org/ ), and then use the resulting…
Yes, I expect to use statistical models/ML. I am more comfortable with Python rather than Java so I will look into the NLTK first. Thank you for your response!
Re: What is an easy way to classify a word?
#7If you're looking for a fairly extensive pre-compiled database, more so than getting into NLP, check out DBpedia and Freebase.