> All participants were then reassured that though 20 minutes might be a rather short time to write an essay, they were encouraged to do their best. Given that the task has been under time pressure, I am not sure this study helps gauging the impact of LLMs in other contexts. When my goal is to produce the result for a specific short term task - I maximize tool usage. When my goal is to improve my personal skills - I…
Accumulation of cognitive debt when using an AI assistant for essay writing task
261–270 of 442 posts
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#262It feels, more and more, that LLMs will be another technology that society will inoculate itself against. It's already starting to happen in education: teachers conversing with students, observing them learn, observing them demonstrate their skills. In business, quickly I'd say, we will realise that the vast majority of worthwhile communication necessarily must be produced by people -- as authors of what they want to…
I haven’t personally felt this to be the case. It feels more like going from thinking about nitty gritty details to thinking more like the manager of unreasoning savants. I still do a lot of thinking— about organization, phrasing (of the code), and architecture. Conversations with AI agents help me tease out my thinking, but they aren’t a substitute for actual thought.
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#263Earlier quoted context omitted.
> I mean, they found brain atrophy. Where did you get that from? While the article mentions the word "atrophy" twice, it's not something that they found. They just saw less neural activation in regards to essay writing in those people who didn't write the essay themselves. I don't anything there in regards to the brain as a whole.
If physical exercise builds muscle mass, mental work and exercise builds more connections in your brain. Like everything, not using something causes that thing to atrophy. IOW, if you depend on something too much, you'll grow dependency on it, because that part of your body doesn't do the work that much anymore. Brain is an interconnected jungle. Improvement in any ability will improve other, adjacent abilities. You…
"Essay Writing" in particular, at least in an academic context, is almost by definition an entirely useless activity, as both the writer and the reader don't care much about the essay as an artifact. It's a proxy for communication skills, that we've had to use for lack of a better alternative, but my hope is that now that it's become useless as a proxy, our education system can somehow switch to actually helping learners communicate better, rather than continuing to play pretend.
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#264It feels, more and more, that LLMs will be another technology that society will inoculate itself against. It's already starting to happen in education: teachers conversing with students, observing them learn, observing them demonstrate their skills. In business, quickly I'd say, we will realise that the vast majority of worthwhile communication necessarily must be produced by people -- as authors of what they want to…
> In business, quickly I'd say, we will realise that the vast majority of worthwhile communication necessarily must be produced by people I believe that one of the most underappreciated skills in business is the ability to string a coherent narrative together. I attend many meetings with extremely-talented engineers who are incapable of presenting their arguments in a manner that others (both technical and non-techni…
There absolutely is a great way to use LLMs when writing, but not to write! Have them critique what you wrote, but not write for you. Create a writing professor persona, create a writing critique, and make them offer Socratic advice where they draw you to make the connection, they don't think for you, but teach you.
There has been a massive disservice to the entire tech series of professions by ignoring the communications, interpersonal and group communication dynamics of technology development. It is not understood, and not respected. (Many developers will deny communication skills utility! They argue against being understood; "that is someone else's job") Fact of the matter: a quality communicator leads, simply because no one else conveys understanding; without the skills they leave a wake of confusion and disgruntled staff. Competent communicators know how to write to inform, know how to debate to shared understanding, and they know how to diffuse excited emotion, they know how to give bad news and be thanked for the insight.
Seriously, effective communications is a glaring hole in your tech stack.
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#265I worry about the adverse effects of LLM on already disfranchised populations - you know the poor etc - that usually would have to pull themselves up using hard work etc studying n reading hard. now if you don't have a mentor to tell you in the age of LLM you still have to do things the hard / old school way to develop critical thinking - you might end up taking shortcuts and have the LLMs "think" for you. hence agai…
LLMs are great for the poor! If you are rich, you can afford a good mentor. (That's true literally, in the sense of being rich in money and paying for a mentor. But also more metaphorically for people rich in connections and other resources.) If you are poor, you used to be out of luck. But now everyone can afford a nearly-free mentor in the form of an LLM. Of course, at the moment the LLM-mentor is still below the b…
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#266Earlier quoted context omitted.
If physical exercise builds muscle mass, mental work and exercise builds more connections in your brain. Like everything, not using something causes that thing to atrophy. IOW, if you depend on something too much, you'll grow dependency on it, because that part of your body doesn't do the work that much anymore. Brain is an interconnected jungle. Improvement in any ability will improve other, adjacent abilities. You…
Absolutely agreed, but where does it take us in regard to division of labor in general? Obviously by not growing my own food or making my own clothes, I'm degrading a lot of skills I could potentially have. To what extent should I strive to develop skills that I don't "care" to exercise? "Essay Writing" in particular, at least in an academic context, is almost by definition an entirely useless activity, as both the w…
Do you have plants at home? You're 50% there for growing your own food (veggies, at least). Do you mend your clothes (e.g.: sew your buttons back)? You're ~30% there for making your own clothes, given you have access to fabric.
On the essay writing, I can argue that at least half of my communication skills come from writing and reading. I don't write essays anymore, but I write a diary almost daily, and I build upon what I have read or written in the past for academic reasons. What I find more valuable in these exercises is not the ability to communicate with others, but communicate with myself.
Brain has this strange handicap. It thinks that it has a coherent thought, but the moment you try to write or tell about it, what comes out is a mushy, spaghetti which doesn't mean anything. Having the facilities to structure it, and to separate the ore from the dirt, and articulate it clearly so you and everyone can understand it is a very underrated skill.
Funnily, the biggest contributor to my written skills is this place, since good discussion needs a very particular set of skills here, namely clarity, calmness and having structure to your thought.
This is why I'm very skeptical of letting go of writing, and actual pens and paper for progress. We're old creatures evolved slowly, and our evolution has a maximum speed. Acting like this is not true will end in disaster.
Humans, the civilization and the culture we built has so many implicit knowledge coded everywhere, and assuming that we know it all, and can encode in a 80GB weighted graph is a mistake to put it kindly.
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#267Well duh. Writing is thinking ordered, and thinking in your mind is not ordered unless one has specific training that organizes and orders their thinking - and even then it requires effort to maintain an organized perception. That is why we write: writing is our thoughts organized and frozen in an order that will be remain in order when related, without writing as the communications foundation the ideas/concepts woul…
Validating what is written is just confirming facts, and figures and making sure it is logical. It is not the same as synthesizing the original data, in terms of your level of understanding. If you need something to submit, an AI essay will do. But if you want to understand something, you really need to write it yourself.
You wrote it, not the AI. My entire point here is not to have the AI write, ever. Have it critique, have it Socratically draw you to make the decisions to axe sections, rewrite them, and so on - and then you do that, personally, using your own mind.
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#268Earlier quoted context omitted.
> One of my favorite developments on the internet in the past few years is the rise of the “I don’t think/won’t think/didn’t think” brag posts Sorry, I can't immediately think of what you're talking about. Could you link to an example so I can get a feel for it?
Every time you have ever seen somebody weigh into an evenly slightly complex topic with a post that starts with “I asked chatgpt and”
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#269Earlier quoted context omitted.
Shallow take. Your analogies only work if you don't take in to account there are different degrees of utility/quality/usefulness of the product. People absolutely crusade against dangerous food, or even just food that has no nutritious benefit. The parent analogy also only holds up on your happy path.
You've just framed your own argument. In order to be intellectually consistent, you can't crusade against AI in general, but rather bad uses of AI, which (even as an AI supporter) is all I've asked anti-AI folks to do all along.
I was just pointing out that arguing against crusading by using an argument (or analogies) that leaves out half of the salient context could be considered disingenuous.
The difference between:
You're using it incorrectly
vs
Of the ones that are fit for a particular purpose, they can work well if used correctly.
Perhaps i'm just nitpicking.
Re: Accumulation of cognitive debt when using an AI assistant for essay writing task
#270This paper elegantly summarized the teething problems of those still clinging to the cognitive habits of a bygone era. These are not crises to be managed, but sentimental frictions to be engineered out of the system. Let us be entirely clear about this: The romanticism surrounding mass "critical thought" is a charming but profoundly inefficient legacy. For decades, we treated the chaotic, unpredictable processing of…