Live data from Hacker News

Delving into ChatGPT usage in academic writing through excess vocabulary

arxiv.org

101–110 of 112 posts

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#101
post #18
post #3

> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. "Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

I'm surprised people make such a big deal out of "delving", it doesn't seem rare. Maybe it was less common in the US than elsewhere? (and do I have to deliberately avoid it now, to avoid sounding like AI?)

We in the US we like to DiG

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#102
Even pre-LLMs, I’d basically rewrite papers using simpler language when I was a co-author. The baseline was never very good, I’m afraid. For some reason researchers love using ten-dollar words even though their overuse makes the paper read pretentious and obfuscates the meaning. Folks, please read the following essay by Orwell, and then read it again and again until it sinks: https://www.orwellfoundation.com/the-orwell-foundation/orwel...

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#103
post #77

> We show that the appearance of LLM-based writing assistants has had an unprecedented impact in the scientific literature, surpassing the effect of major world events such as the Covid pandemic. I'm not quite sure this follows. At the very least, I think they should also consider the possibility of social contagion: if some of your colleagues start using a new word in work-related writing, you usually pick that up.…

I have friends in academia (all around Europe and in different fields, from Spain to Danemark, Slovakia, Sweden, Germany, in economics, solid state physics, &c.), I can 100% guarantee you're wrong and chatgpt is now the default tool for the vast majority of people writing these papers. It's not people picking up new words, you have to understand academia is mostly about shitting out as many papers as you can and make…

> academia is mostly about shitting out as many papers as you can

This is the classic case of publish-or-perish, since publication metrics are ubiquitous in all aspects of academic life unfortunately. Measuring true impact is the goal, but it is hard problem to solve for.

> and make them as verbose as possible

This is just laughably wrong. The page-limits are always too low to fit all the information one wants to include, so padding a text is just not of interest at all.

With that said, I wouldn't be surprised if people use ChatGPT a lot. If for no other reason most academics are writing in a language (English) that is not their native language and that is hard to do. Anything that makes the process of communicating ones results easier and more efficient is a good thing. Of course, it can also be used to create incomprehensible word salads, but I've seen a lot of those in the pre-LLM times as well.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#104
post #77

> We show that the appearance of LLM-based writing assistants has had an unprecedented impact in the scientific literature, surpassing the effect of major world events such as the Covid pandemic. I'm not quite sure this follows. At the very least, I think they should also consider the possibility of social contagion: if some of your colleagues start using a new word in work-related writing, you usually pick that up.…

I have friends in academia (all around Europe and in different fields, from Spain to Danemark, Slovakia, Sweden, Germany, in economics, solid state physics, &c.), I can 100% guarantee you're wrong and chatgpt is now the default tool for the vast majority of people writing these papers. It's not people picking up new words, you have to understand academia is mostly about shitting out as many papers as you can and make…

Shitting out as many papers as you can, yes.

Making them as verbose as possible? My experience from grad school and with friends who are now faculty is that literally everybody's first draft is above the page limit and content needs to be cut.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#105
post #25

It's also possible that humans are starting to sound more like LLMs too, due to reading (wittingly or otherwise) more LLM output.

Whenever I see a comment that talks about programming with the uppercased "S" in "Typescript", "Javascript", "Clojurescript", my immediate guess is that the person used LLM , at least for spellchecking and improving the original text. I predict that soon, LLMs would learn to make tiny, insignificant mistakes, to sound "more human" in writing.

Guess I'll have to stop writing JavaScript and the like then. :/

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#106
post #99
post #52

Earlier quoted context omitted.

> So you plagiarized for your paper? I don't think I did. And no, it wasn't for a class. Please be more considered before throwing out accusations of academic misconduct. That is a very heavy term. Anyway, I don't think what I did is any more "academic misconduct" than using Grammerly is academic misconduct. They're both uses of LLMs, sure. But the uses are different and we need to start differentiating them. If you…

>I don't think I did. And no, it wasn't for a class. Please be more considered before throwing out accusations of academic misconduct. Please throw all of my comment into whatever LLM you used to respond, as I pointed out and explained the academic contextual assumption I made. If you are focusing on my phrase "for a class" here, and this paper was actually for an academic conference or journal, then yes! you have co…

>>I don't think I did. And no, it wasn't for a class. Please be more considered before throwing out accusations of academic misconduct.

>Please throw all of my comment into whatever LLM you used to respond [...]

And there goes your credibility. At least give strangers the benefit of politeness, rather than making a fool out of yourself.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#107
post #14

Their list: delves crucial potential these significant important They're not the first to make this observation. Others have picked up that LLM's like the word "delves". LLMs are trained on texts which contain much marketing material. So they tend to use some marketing words when generating pseudo-academic content. No surprise there. I'm surprised it's not worse. What happens if you use a prompt containing "Write in…

The article title is a cheeky stab at the current trend.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#108
We live in an era where academics use gpt to spew out papers, and have an audience (not all) who use gpt to summarize and extract the meaningful content from it.

We truly live in the informations age.

On a side note, do people still use ChatGPT to fill out their papers? I found Claude to be way better at spitting out more content. In my experience, ChatGPT has been in the middle while Gemini is the worst, it even cuts-off in the middle of the sentence.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#109
post #99

Earlier quoted context omitted.

>I don't think I did. And no, it wasn't for a class. Please be more considered before throwing out accusations of academic misconduct. Please throw all of my comment into whatever LLM you used to respond, as I pointed out and explained the academic contextual assumption I made. If you are focusing on my phrase "for a class" here, and this paper was actually for an academic conference or journal, then yes! you have co…

>>I don't think I did. And no, it wasn't for a class. Please be more considered before throwing out accusations of academic misconduct. >Please throw all of my comment into whatever LLM you used to respond [...] And there goes your credibility. At least give strangers the benefit of politeness, rather than making a fool out of yourself.

Leave that tone policing ad hominem shit on reddit please and discuss the issues at hand like a grown up.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#110
post #99

Earlier quoted context omitted.

>I don't think I did. And no, it wasn't for a class. Please be more considered before throwing out accusations of academic misconduct. Please throw all of my comment into whatever LLM you used to respond, as I pointed out and explained the academic contextual assumption I made. If you are focusing on my phrase "for a class" here, and this paper was actually for an academic conference or journal, then yes! you have co…

> Please throw all of my comment into whatever LLM you used to respond, Rude. Rude and wrong. > If [...] this paper was actually for an academic conference or journal, then yes! you have committed academic misconduct. This is a surprising perspective given that in many ways I had the same conversation with chatgpt about my work that I might have had with a colleague or a spouse. The biggest difference is that chatgpt…

>This is a surprising perspective given that in many ways I had the same conversation with chatgpt about my work that I might have had with a colleague or a spouse.

Yes, it's possible to scoop academic colleagues and steal ideas from spouses. Plagiarism applies there too.

>But I don't think we have any consensus as to where the line should be between "acceptable use" and plagerism.

Perhaps, but using it to generate ideas you claim are yours, let alone quoting it directly, are all well past that line. Unless you put ChatGPT in the author list of the paper, in which case, sure, fair play.

>For reference, of course the calculator policy at my Australian school in the 90s was different from yours. We generally weren't allowed calculators on the school grounds at all. That started to change right at the end of high school, when they started allowing calculators in class and non-graphing calculators in examinations. (They checked as we walked in the door). But for most of my grade school experience, calculators were banned.

Unsurprisingly, this doesn't change or contradict my point at all. Any math you're doing in high school should not require a calculator, or at the very least can be taught without any calculators used.

>Rude. Rude and wrong.

I'm speaking with a tone appropriate for the nature of my company here (an academic fraud and one or two people who support him)

Post reply on HN