Live data from Hacker News

Wink-lemmatizer

winkjs.org

1–10 of 23 posts

Re: Wink-lemmatizer

#7
post #5

any plans for multi-language support?

This is really needed in the NLP world. Most things are english only.

Good luck with Turkish. A very large lookup table may work for %90 cases but it will still fail. A basic `true` lemmatizer requires either a complex graph with rules, or an FST generated from it. input is searched through the graph and morphological disambiguator must be applied to result to pick the correct lemma.

Re: Wink-lemmatizer

#8
Nice. Any plans for the following features?

- instead of calling the API using "noun", "verb", etc, let the library figure out the type of word.

- let the library return information about the word, e.g. "coolest" -> "cool"+superlative.

Re: Wink-lemmatizer

#9
post #7

Earlier quoted context omitted.

This is really needed in the NLP world. Most things are english only.

Good luck with Turkish. A very large lookup table may work for %90 cases but it will still fail. A basic `true` lemmatizer requires either a complex graph with rules, or an FST generated from it. input is searched through the graph and morphological disambiguator must be applied to result to pick the correct lemma.

Or Welsh. You want a canonical form for "wnaethpwyd"? Try "gwneud"! Some regexes and an exceptions list isn't going to cut it.

The more a language needs a lemmatizer for NLP the harder it is to write it.

Post reply on HN