Live data from Hacker News

Accumulation of cognitive debt when using an AI assistant for essay writing task

arxiv.org

351–360 of 442 posts

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#352

This is exactly why there is no point in using AI for coding unless in rare fee cases. Code without AI - sharp skills, your brain works and you come up with better solutions etc. Code with AI - skills decline after merely a week or two, you forget how to think and because of relying on AI for simpler and simpler tasks - your total output is less and worse that in you were to diy it.

Does this logic apply to IDEs, search engines, or any of the various other tools programmers use?

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#353

Earlier quoted context omitted.

My total output is definitely higher.

5 years from now, will you ability to explain or build from first principles on your own be increased, though?

You are exhibiting traces of long term thinking.

This is not what founder culture is about.

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#354
While the results are not unexpected i think the conclusion is questionable. Of course the recall for something you did not write will be lower, but to conclude from it, that this will impeded overall learning is in my opinion far fetched.

I think what we are seeing is that learning and education has not adapted to these new tools yet. Producing a string of words that counts as an essay has become easier. If this frees up a students time to do more sports or work on their science project that's a huge net positive even if for the essay it is net negative. The essay does not exist in a school vacuum.

The thing students might not understand is: their reduced recall will make them worse at the exam ... Well they will hopefully draw their own conclusion after first their failed exam.

I think the quantitative study is important but I think this qualitative interpretation is missing the point. Recall->Learning is a pretty terrible way to define learning. Reproducing is the lowest step on the ladder to mastery

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#355
Back when GANs were popular, I'd train generator-discriminator models for image generation.

I thought a lot about it and realised discriminating is much easier than generating.

I can discriminate good vs bad UI for example, but I can't generate a good UI to save my life. I immediately know when a movie is good, but writing a decent short story is an arduous task.

I can determine the degree of realism in a painting, but I can't paint a simple bicycle to convince a single soul.

We can determine if an LLM generation is good or bad in a lot of cases. As a crude strategy then we can discard bad cases and keep generating till we achieve our task. LLMs are useful only because of this disparity between discrimination vs generation.

These two skills are separate. Generation skills are hard to acquire and very valuable. They will atrophy if you don't keep exercising those.

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#356

One slightly unexpected side effect of using AI to do most of my coding now is that I find myself a lot less tired and can focus for longer periods. It's enabled me to get work done while faced with other distractions. Essentially, offload some mental capacity towards AI frees up capacity elsewhere.

I find the opposite to be true. I am a lot more productive, so I work on more things in parallel, which makes me extremely tired by the end of the day, as if my brain worked at 100% capacity..

Yeah I do feel the pressure to run multiple instances of Claude Code now. Haven't really managed to find a good workflow, I find I just get too distracted swapping between tasks and then probably end up working slower than if I had just stayed in one IDE instance

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#357

Earlier quoted context omitted.

5 years from now, will you ability to explain or build from first principles on your own be increased, though?

Yes. Because none of this bullshit matters. I’ve heard this mantra for 20 years now. Smug face: “weeeell, how can you say you’re a real programmer if you use a compiler? You need write raw assembly”, “how can you call yourself reeeeal programmer if you don’t know your computer down to every register?”, “real programmurs do not use SO/Google” and all the rest of the crap. It is all nerds trying to make themselves feel…

Common bullshit. Expert not realizing that even if they are capable of using these tools because they can - subconsciously in your case - verify them, it doesn't mean it helps non experts.

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#358

I think it's likely we learn to develop healthier relationships with these technologies. The timeframe? I'm not sure. May take generations. May happen quicker than we think. It's clear to me that language models are a net accelerant. But if they make the average person more "loquacious" (first word that came to mind, but also lol) then the signal for raw intellect will change over time. Nobody wants to be in a relati…

>Nobody wants to be in a relationship with a language model.

I'm not sure about it. I don't have first or second hand experience with this, but I've been hearing about a lot of cases of people really getting into a sort of relationship with an AI, and I can understand a bit of the appeal. You can "have someone" who's entirely unjudgemental, who's always there for you when you want to chat about your stuff, and isn't ever making demands of you. It's definitely nothing close to a real relationship, big I do think it's objectively better than the worst of human relationships, and is probably better for your psyche than being lonely.

For better or for worse, I imagine that we'll see rapid growth in human-AI relationships over the coming decade, driven by improvements in memory and long-term planning (and possibly robotic bodies) on the one hand, and a growth of the loneliness epidemic on the other.

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#359

One slightly unexpected side effect of using AI to do most of my coding now is that I find myself a lot less tired and can focus for longer periods. It's enabled me to get work done while faced with other distractions. Essentially, offload some mental capacity towards AI frees up capacity elsewhere.

I like to think of AI as cars: You can go to the Walmart outside town on foot. And carry your stuff back. But it is much faster - and less exhaustive - to use the car. Which means you can spend more quality time on things you enjoy.

this analogy is flawed to its core. The car doesn't make you forget how to walk, because you are still forced to walk in certain circumstances. Delegating learning to an llm will increase your reliance on it, and will eventually affect the way you're learning. A better analogy is the usage of GPS. If you use it continuously, you will be dependent on it to get to a place, and lose the capacity to find places on your own.

Re: Accumulation of cognitive debt when using an AI assistant for essay writing task

#360

One slightly unexpected side effect of using AI to do most of my coding now is that I find myself a lot less tired and can focus for longer periods. It's enabled me to get work done while faced with other distractions. Essentially, offload some mental capacity towards AI frees up capacity elsewhere.

I like to think of AI as cars: You can go to the Walmart outside town on foot. And carry your stuff back. But it is much faster - and less exhaustive - to use the car. Which means you can spend more quality time on things you enjoy.

The problem is that when it's for work, the company now knows you have access to a car, so sends you on 20x the trips. You have no more quality time, and your physical health suffers from lack of exercise.
Post reply on HN