A PhD Student's Perspective... ~20 authors.
A PhD student's perspective on research in NLP in the era of LLMs
21–30 of 55 posts
Re: A PhD student's perspective on research in NLP in the era of LLMs
#22Isn't the main problem with NLP research now that you'll need a ton of money to run your experiments? How can an "average" PhD researcher hope to validate their hypothesis if they need several thousand dollars per test?
That is not a problem. There are literally thousands of ways to conduct any experiment at the fraction of the cost.
Thanks. Whenever I think I want to run something on a cluster of A100s, I'll just remember the thousands of ways instead, and train my LLMs that way. There's a reason why humans didn't need computers until just recently, after all. I must be so blind to not have seen this earlier.
Re: A PhD student's perspective on research in NLP in the era of LLMs
#23Are papers becoming blogs?
Only the one on arxiv. People shouldn’t take anything coming from that site seriously
Re: A PhD student's perspective on research in NLP in the era of LLMs
#24A PhD Student's Perspective... ~20 authors.
It takes a whole village (of uncredited MASc students) to get a PhD!
Re: A PhD student's perspective on research in NLP in the era of LLMs
#25Are papers becoming blogs?
Always have been.
Re: A PhD student's perspective on research in NLP in the era of LLMs
#26Are papers becoming blogs?
Only the one on arxiv. People shouldn’t take anything coming from that site seriously
Eh, there are plenty of actual pre-prints you can find on arXiv. Typical flow is you find a paper of interest published elsewhere then search arXiv for the same title, authors, etc. and can even find related work. A lot of publication isn't doing much in terms of genuine peer review but formatting, catching minor errors like grammar, typo, missing references etc. arXiv is great as a legitimate source for valid information tucked behind a paywall. It's not the only option but it's one of them (checking the primary author's personal site, researchgate, or associated research institutions repositories are also there, as well as contacting the author directly).
Re: A PhD student's perspective on research in NLP in the era of LLMs
#27Re: A PhD student's perspective on research in NLP in the era of LLMs
#28Are papers becoming blogs?
Only the one on arxiv. People shouldn’t take anything coming from that site seriously
What a strange recommendation. I do research in CS theory and machine learning and I try to find arXiv preprints when I can, they are usually more complete than conference versions of papers. If you stick to papers from authors you know or to those from well-known conferences, arXiv is often times the best source.
Re: A PhD student's perspective on research in NLP in the era of LLMs
#29Are papers becoming blogs?
Consider the letters section of Phyicical Review, that turned into a weekly journal Physical Review Letters back in the 50s. It was a blog or forum back when papers were distributed on paper.
Basically because of the slow pace of review and publication the letters column became a way to talk about recent results or problems, and then follow up letters (i.e. comments on the blog posts) became common. So the editors decided to hive it off and speed up its publication schedule.
Re: A PhD student's perspective on research in NLP in the era of LLMs
#30Are papers becoming blogs?
Only the one on arxiv. People shouldn’t take anything coming from that site seriously
That sounds highly misleading. It is the standard preprint site in many disciplines. So you should take it as seriously as any preprint and conversely if a published article is not on the arxiv, that would be suspicious.