Live data from Hacker News

Delving into ChatGPT usage in academic writing through excess vocabulary

arxiv.org

11–20 of 112 posts

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#11
Great article. One of the papers it cites is https://arxiv.org/abs/2403.07183, which is also great and looks at the issue of LLM usage to write peer reviews.

It’s an issue I’ve noticed personally, as I’m seeing an increasing number of reviews that lack substance and are almost entirely made of filler content. Here’s an excerpt from a particularly egregious recent example I ran into, which had this to say on the subject of meaningful comparison to recent work:

> Additionally, while the bibliography appears to be comprehensive, there could be some minor improvements, such as including more recent or relevant references if applicable.

The whole review was written like this, with no specific suggestions for improvement, just vague “if applicable” filler. Infuriating.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#12
post #3

> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. "Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

That’s the joke.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#13
It won't take long before it's possible to mask LLM use by making the text sound more human like, without the excess vocab.

The leap from how the LLMs write now to how a professional sounding scientist might write their paper is probably not that big.

Its possible now to train them on your own writing style.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#14
Their list:

    delves
    crucial
    potential
    these
    significant
    important
They're not the first to make this observation. Others have picked up that LLM's like the word "delves".

LLMs are trained on texts which contain much marketing material. So they tend to use some marketing words when generating pseudo-academic content. No surprise there. I'm surprised it's not worse.

What happens if you use a prompt containing "Write in a style that maximizes marketing impact"?"

('You can't always use "Free", but you can always use "New"' - from a book on copywriting.)

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#17
It’s possible this is caused by the editors rather than the authors.

An old partner edited papers for a large publisher - largely written by non-native speakers and already heavily machine translated - and would almost always use ChatGPT for the first pass when extensive changes were needed.

She was paid by the word and also had a pretty intense daily minimum quota so it was practically required to get enough done to earn a liveable wage and avoid being replaced by another remote “contractor”.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#18
post #3

> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. "Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

I'm surprised people make such a big deal out of "delving", it doesn't seem rare. Maybe it was less common in the US than elsewhere?

(and do I have to deliberately avoid it now, to avoid sounding like AI?)

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#19
post #8

LLMs used in writing of 1/3 of scientific papers. On the one hand scary, on the other it seems people find them useful. Maybe this AI thing is not like crypto after all...

In parts of the world, publishing research papers is required for advancement. The scientific value of the papers is irrelevant.

So yes - AI is seen as useful for people gaming a system for personal advancement at the expense of global scientific progress and the betterment of humanity.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#20
post #11

Great article. One of the papers it cites is https://arxiv.org/abs/2403.07183 , which is also great and looks at the issue of LLM usage to write peer reviews. It’s an issue I’ve noticed personally, as I’m seeing an increasing number of reviews that lack substance and are almost entirely made of filler content. Here’s an excerpt from a particularly egregious recent example I ran into, which had this to say on the subj…

Funny. It used to be if you received that sort of response, you might imagine the author being pressed for time and giving a sort of prewritten/canned copy response.

I guess LLMs have removed some of the tedium from the process while making it more tedious for the recipient. That's annoying.

Post reply on HN