Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A PhD student's perspective on research in NLP in the era of LLMs

arxiv.org

Post reply on HN
Print view View original

11–20 of 55 posts

Re: A PhD student's perspective on research in NLP in the era of LLMs

#11

Post by nl »

rhdunn wrote: post #2

I've been interested in NLP for tagging stories based on topics and themes (detectives, werewolves, murder mystery, etc.), so need accurate disambiguation of parts of speech and ways of detecting uses of metaphore, similies, etc. to describe those. I also want to be able to assess how much of the text is about a given topic, so that if I'm interested in reading a detective story from e.g. the Project Gutenberg collec…

Have you tried Spacy?

I find it substantially better than other tools as PoS tagger.

Also worth noting the that your assertion that you need these features to classify genres isn't obviously true to me at all.

Re: A PhD student's perspective on research in NLP in the era of LLMs

#12

Post by nl »

etamponi wrote: post #9

Isn't the main problem with NLP research now that you'll need a ton of money to run your experiments? How can an "average" PhD researcher hope to validate their hypothesis if they need several thousand dollars per test?

No.

There are plenty of research directions that are outlined in this document that don't require huge compute budget.

Re: A PhD student's perspective on research in NLP in the era of LLMs

#17

Post by Randomizer42 »

etamponi wrote: post #9

Isn't the main problem with NLP research now that you'll need a ton of money to run your experiments? How can an "average" PhD researcher hope to validate their hypothesis if they need several thousand dollars per test?

That is not a problem. There are literally thousands of ways to conduct any experiment at the fraction of the cost.

Re: A PhD student's perspective on research in NLP in the era of LLMs

#18

Post by low_tech_love »

teruakohatu wrote: post #15
dontupvoteme wrote: post #13

Are papers becoming blogs?

It has 10+ pages of references. More like a well researched lit review than a blog post with a few links.

Yes, but putting a link to a Google Form on the abstract is a bit too much.

Re: A PhD student's perspective on research in NLP in the era of LLMs

#19

Post by whatyesaid »

low_tech_love wrote: post #18
teruakohatu wrote: post #15

Earlier quoted context omitted.

It has 10+ pages of references. More like a well researched lit review than a blog post with a few links.

Yes, but putting a link to a Google Form on the abstract is a bit too much.

It's arxiv, it's not a final version

Re: A PhD student's perspective on research in NLP in the era of LLMs

#20

Post by whatyesaid »

totorovirus wrote: post #6

well I see topics like NLP in ethics, healthcare, etc, which I think is a sign they don't have much to do here.

Yeah those aren't good especially stuff like healthcare a PhD student can't get the needed data.

The other issue is, if you do focus on LLMs, it's too hyped your research would be too overlapping/competing especially as you've got a dissertation to write. It's a hard problem.

Post reply on HN