Live data from Hacker News

Delving into ChatGPT usage in academic writing through excess vocabulary

arxiv.org

1–10 of 112 posts

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#3
> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words.

"Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#4
post #3

> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. "Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

It’s a joke. Delve is the first example they show.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#5
post #3

> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. "Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

It's the Voight-Kampff test for LLMs :)

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#6
post #3

> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. "Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

This is clearly a joke in the paper, they mention Delving is on of the words with the biggest frequency increase.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#7
One confounding factor here is the proliferation of autocorrect and grammar “advisors” in popular apps like gmail etc. One algorithm tweak could change a lot of writing at that scale.

While the word frequency stats are damning, there doesn’t seem to be any evidence presented that directly ties the changes to LLMs specifically.

Post reply on HN