Live data from Hacker News

Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

media.mit.edu

381–390 of 529 posts

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#381

Earlier quoted context omitted.

Brains are adaptive. We're not getting dumber, we're just adapting to a new environment. Just because they're less fit for other environments doesn't make it worse. As for the productivity paradox, this discounts the reality that we wouldn't even be able to scale the institutions we're scaling without the tech. Whether that scaling is a good thing is debatable.

Brains are adaptive and as we adapt we are turning more cognitive unbalanced. We're absorbing potentially bias information at a faster rate. GPT can give you information of X in seconds. Have you thought about it? Is that information correct? Information can easily be adapted to sound real while masking the real as false. Launching a search engine and searching may spew incorrectness but it made you make judgement, t…

>We are no longer critical thinking

Please provide evidence that masses of people ever were critically thinking across general fields they were not involved in.

Everyone seems to take for face value there was a golden age of critical thinking done by the masses is at some time in the indeterminate past, but regardless of when you ask this question, the answer is always "in the past".

I surmise your thesis is incorrect and supplant this one instead.

The average person can only apply critical thinking on a very limited amount of information, and typically on topics they deal with that have a quick feedback loop of consequences.

Deep critical thinkers across vast topics are rare, and have always been rare. There are likely far more of them than ever now, but this falls into the next point

Information and complexity are exploding, the amount of data required to navigate the world we now live in is far larger than just a few generations ago. Couple this with the amount of information being presented to individuals and you run into actual physics constraints on the amount of information the human brain can distil into a useful model.

By (monetary) necessity people have become deep specialists in limited topics, analogies and paradigms don't necessarily work across different topics. For example, understanding code very well has very little bearing on if I grok the reality of practiced political sociology, and my idea of what is critical thinking around it is very likely to have a very large prediction mismatch to what actually happens.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#382
post #167

Earlier quoted context omitted.

My "actual job" isn't to write code, but to solve problems. Writing code has just typically been how I've needed to solve those problems. That has increasingly shifted to "just" reviewing code and focusing on the architecture and domain models. I get to spend more time on my actual job.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

To be fair, if you manage to stay employed for 30 years before people determine your skills are sub-standard, that's a lot better than most.

But I generally agree with your point.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#383
post #160

This reminds me of the recurring pattern with every new medium: Socrates worried writing would destroy memory, Gutenberg's critics feared for contemplation, novels were "brain softening," TV was the "idiot box." That said, I'm not sure "they've always been wrong before" proves they're wrong now. Where I'm skeptical of this study: - 54 participants, only 18 in the critical 4th session - 4 months is barely enough time…

Soapbox time. They were arguably right. Pre literate peole could memorise vast texts (Homer's work, Australian Aboriginal songlines). Pre Gutenberg, memorising reasonably large texts was common. See, e.g. the book Memory Craft. We're becoming increasingly like the Wall E people, too lazy and stupid to do anything without our machines doing it for us, as we offload increasing amounts onto them. And it's not even that…

That’s a lot of assumptions.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#384
post #167

Earlier quoted context omitted.

My "actual job" isn't to write code, but to solve problems. Writing code has just typically been how I've needed to solve those problems. That has increasingly shifted to "just" reviewing code and focusing on the architecture and domain models. I get to spend more time on my actual job.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

Yet most organizations in existence pay the people “who hasn’t touched a computer in 30 years” quite a large amount of money to continue to solve problems, for some inscrutable reason… =)

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#385

Earlier quoted context omitted.

No, it's useful evidence in the same way that contemporaneous fiction is often useful evidence. The first season aired from 1989-1990. The living conditions from the show were plausible. I know because I was alive during that time. My best friend was the son of a vacuum cleaner salesman with a high school education, and they owned a three bedroom house in a nice area, two purebred dogs, and always had new cars. His m…

I'm not against the spirit of what you're saying, but are you aware the show itself made a meta episode about how comical it was that Homer could live in a house like that? That was never meant to be a reflection of current living conditions. That show is not the best example of what you're describing. https://youtu.be/axHoy0hnQy8?t=29

With that said, that episode is from the 8th season in a time where things were already becoming more unaffordable. The time between the episodes explains why this episode exists.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#386

This reminds me of the recurring pattern with every new medium: Socrates worried writing would destroy memory, Gutenberg's critics feared for contemplation, novels were "brain softening," TV was the "idiot box." That said, I'm not sure "they've always been wrong before" proves they're wrong now. Where I'm skeptical of this study: - 54 participants, only 18 in the critical 4th session - 4 months is barely enough time…

Well said

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#387

Studies like this remind me of early concerns about calculators making students "worse at math." The reality is that tools change what skills matter, not whether people think. We're heading toward AI-first systems whether we like it or not. The interesting question isn't "does AI reduce brain connectivity for essay writing" - it's how we redesign education, work, and products around the assumption that everyone has a…

The amount of delusion about "bigger problem" You won't be able to solve bigger problems if you don't understand the details and nuances of how things are made.

And yet people complain that management is out of touch, MBA driven businesses are out of touch, PE firms are out of touch, designers are out of touch with product, look at the touch screen cars (made by people who have never driven one) with reality. I can't even.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#389

Studies like this remind me of early concerns about calculators making students "worse at math." The reality is that tools change what skills matter, not whether people think. We're heading toward AI-first systems whether we like it or not. The interesting question isn't "does AI reduce brain connectivity for essay writing" - it's how we redesign education, work, and products around the assumption that everyone has a…

> Studies like this remind me of early concerns about calculators making students "worse at math." The reality is that tools change what skills matter, not whether people think. Over-reliance on calculators does make you worse at math. I (shamefully) skated through Calculus 3 by just typing everything into my TI-89. Now as an adult I have no recollection of anything I did in that class. I don't even remember how to u…

>But I still remember the more basic calculu

All this is saying that more basic things are easier to remember than more complex things and without further evidence is very very limited in predictive power.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#390

Earlier quoted context omitted.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

Yet most organizations in existence pay the people “who hasn’t touched a computer in 30 years” quite a large amount of money to continue to solve problems, for some inscrutable reason… =)

Managers being overpaid and overvalued is a well known phenomenon, yes.
Post reply on HN