Live data from Hacker News

A PhD student's perspective on research in NLP in the era of LLMs

arxiv.org

51–55 of 55 posts

Re: A PhD student's perspective on research in NLP in the era of LLMs

#51
post #40
post #11

Earlier quoted context omitted.

Have you tried Spacy? I find it substantially better than other tools as PoS tagger. Also worth noting the that your assertion that you need these features to classify genres isn't obviously true to me at all.

No I haven't. Thanks for the pointer. For detecting uses of nouns like werewolf/werewolves, or vampire/vampires, I at least need the lemma to avoid writing different cases or a regex for each noun. Likewise, lemmatization can be used to handle different spellings (e.g. vampyre, or were-wolf). Similarly for verbs. Lemmatization works best when it is coupled with part of speech tagging, so you avoid removing the -ing i…

I'd encourage you to try plain old text classification on ngrams. An ngram approach will pick up lemmas fine, although Spacy will do lemmatization if you prefer.

But I did a lot of work on this type of thing and the only time I found this sentence analysis approach was useful as classifier features was in a legal context where there were variants of very specific language we wanted to find.

There it worked because we could write rules on the features without relying on training data.

Tf-idf on ngrams using a rolling window would certainly work to detect the beheading variants you gave as examples.

Again: try without the parsing features. There's a good reason they are rarely used in classifiers: they are too unreliable to improve performance over simple approaches.

Re: A PhD student's perspective on research in NLP in the era of LLMs

#52

Earlier quoted context omitted.

Only the one on arxiv. People shouldn’t take anything coming from that site seriously

So the math, physics, and computer science departments of every major university should be ignored? What a brain dead comment.

Serious and trustworthy research is done on peer reviewed journals, not websites where everyone can post whatever he/she wants

Re: A PhD student's perspective on research in NLP in the era of LLMs

#53

Earlier quoted context omitted.

So the math, physics, and computer science departments of every major university should be ignored? What a brain dead comment.

Serious and trustworthy research is done on peer reviewed journals, not websites where everyone can post whatever he/she wants

Serious and trustworthy according to whom, exactly?

The term peer review was virtually non-existent prior to the 1960s. And despite that, nearly everything in modern society can ultimately be attributed to breakthroughs that happened prior to the advent of peer-review.

https://books.google.com/ngrams/graph?content=peer+review&ye...

Re: A PhD student's perspective on research in NLP in the era of LLMs

#54

Earlier quoted context omitted.

Serious and trustworthy research is done on peer reviewed journals, not websites where everyone can post whatever he/she wants

Serious and trustworthy according to whom, exactly? The term peer review was virtually non-existent prior to the 1960s. And despite that, nearly everything in modern society can ultimately be attributed to breakthroughs that happened prior to the advent of peer-review. https://books.google.com/ngrams/graph?content=peer+review&ye...

Prior to the 1960s there was no internet.

Re: A PhD student's perspective on research in NLP in the era of LLMs

#55

Earlier quoted context omitted.

Serious and trustworthy according to whom, exactly? The term peer review was virtually non-existent prior to the 1960s. And despite that, nearly everything in modern society can ultimately be attributed to breakthroughs that happened prior to the advent of peer-review. https://books.google.com/ngrams/graph?content=peer+review&ye...

Prior to the 1960s there was no internet.

I think you misunderstand how accessible the Internet was, and the history of open-access journals dating back to the late 40s. arXiv started in 1991. None of it explains why the peer review started surfacing in published books.

It does correlate perfectly with when modern scholars point to when the institutions were captured.

Post reply on HN