I'm attempting to create a frequency list of words for language learners. (In Japanese.) Commonly, these lists are based in just what word appears in the text at "surface" level. However, words commonly have multiple "senses" or nuances of meaning in which they are used. Dictionaries list these senses, but it has been traditionally hard to disambiguate which sense the word is used in, given an usage in text. LLM's ma…
Are you asking the LLM to annotate text and then count number of annotations?
How do you make sure that each disambiguation has a stable label throughout?