Live data from Hacker News

Delving into ChatGPT usage in academic writing through excess vocabulary

arxiv.org

31–40 of 112 posts

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#32
post #14

Their list: delves crucial potential these significant important They're not the first to make this observation. Others have picked up that LLM's like the word "delves". LLMs are trained on texts which contain much marketing material. So they tend to use some marketing words when generating pseudo-academic content. No surprise there. I'm surprised it's not worse. What happens if you use a prompt containing "Write in…

I use at least four of those pretty heavily, and I suspect that I'm in the top quartile in terms of using at least three of them. I guess I'm going to be queued for deactivation now.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#33
This just makes me think how now, more than ever, it really pays to develop your own distinctive writing voice. It’s not just a way to make yourself stand out, but given how much the way you write can influence your thought process, I worry that all the students ChatGPTing their way through language arts classes will be ultimately more susceptible to groupthink and online influence campaigns.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#34

I can’t trust any paper with y-axis labels that are all over the place paired next to each other. Figure 1 is a hot mess.

The figures are about the change rather than the absolute value, so it's not too terrible, but even given that, they could have been normalised by being relative to year 1. A quite warm mess, perhaps?

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#35

Earlier quoted context omitted.

This seems strange… this is an old partner, who had a job long enough to know that the only way to hit a quota to was to use ChatGPT, which came out less than two years ago? It seems strange that something that experimental became essential that quickly.

> this is an old partner “Old” might be intended to mean “former” or “ex”, which could be as recent as merely weeks ago. (i.e. ESL / lost in translation issue).

I took it to mean ex, but even if it was only a week ago, for a tool to become essential within a year of existing is pretty crazy.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#36

It won't take long before it's possible to mask LLM use by making the text sound more human like, without the excess vocab. The leap from how the LLMs write now to how a professional sounding scientist might write their paper is probably not that big. Its possible now to train them on your own writing style.

It’s already a thing now

https://quillbot.com/paraphrasing-tool

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#37
post #33

This just makes me think how now, more than ever, it really pays to develop your own distinctive writing voice. It’s not just a way to make yourself stand out, but given how much the way you write can influence your thought process, I worry that all the students ChatGPTing their way through language arts classes will be ultimately more susceptible to groupthink and online influence campaigns.

I don’t agree with this. Quick assessment: what makes someone more susceptible to groupthink? To propaganda? Is it the way they write? That doesn’t sound right. It is not an LLM/ChatGPT-borne ailment. So I would not paint these tools as such a boogeyman.

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#38
post #3

> We study vocabulary changes in 14 million PubMed abstracts from 2010-2024, and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. "Delving".. Sounds like the authors might have used an LLM while writing this paper as well.

It’s a joke. Delve is the first example they show.

I associate the word strongly with Lord of the Rings.

"The AI researchers delved too greedily and too deep, and awoke the BaLLMrog."

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#39

It won't take long before it's possible to mask LLM use by making the text sound more human like, without the excess vocab. The leap from how the LLMs write now to how a professional sounding scientist might write their paper is probably not that big. Its possible now to train them on your own writing style.

You can do this with shortwave: https://www.shortwave.com/blog/introducing-ghostwriter-ai-wr...

On thing that is interesting is that they allow you to add additional prompt, because sometimes you don’t want an email to actually sound like you but it to sound like the writer you want to be (leveling up so to speak)

Re: Delving into ChatGPT usage in academic writing through excess vocabulary

#40
post #14

Their list: delves crucial potential these significant important They're not the first to make this observation. Others have picked up that LLM's like the word "delves". LLMs are trained on texts which contain much marketing material. So they tend to use some marketing words when generating pseudo-academic content. No surprise there. I'm surprised it's not worse. What happens if you use a prompt containing "Write in…

>>> "Write in a style that maximizes marketing impact"

Probably exactly what academics are being told by their university PR departments.

Post reply on HN