Live data from Hacker News

Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

media.mit.edu

411–420 of 529 posts

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#411

Earlier quoted context omitted.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

I have very little knowledge of how transistors shuffle ones and zeros out of registers. That doesn't prevent me from using them to solve a problem. Computing is always abstractions. We moved from plugging to assembly, then to c, then we had languages that managed memory for you -- how on earth can you understand what the compiler should be doing or what it is doing if you don't deal with explicit pointers on a day b…

There's never been a case in my long programming career so far where knowing the low level details has not benefited me. The level of value varies but it is always positive.

When you use LLMs to write all your code you will lose (or never learn) the details. Your decision making will not be as good.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#412
post #196

Earlier quoted context omitted.

This statement feels like a farmer making a case for using their hands to tend the land instead of a tractor because it produces too many crops. Modern farming requires you to have an ecosystem of supporting tools to handle the scale and you need to learn new skills like being a diesel mechanic. How we work changes and the extra complexity buys us productivity. The vast majority of software will be AI generated, tool…

> This statement feels like a farmer making a case for using their hands to tend the land instead of a tractor because it produces too many crops. Modern farming requires you to have an ecosystem of supporting tools to handle the scale and you need to learn new skills like being a diesel mechanic. This to me looks like an analogy that would support what GP is saying. With modern farming practices you get problems lik…

And those trade-offs can only pay off if the extra food produced can be utilized. If the farm is producing more food than can be preserved and/or distributed, then the surplus is deadweight.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#413

Earlier quoted context omitted.

Then your job has turned into designing solutions, and asking a (sometimes unreliable) LLM to make them for you. If you keep at it, soon you'll accumulate enough cognitive debt to become a fossil, knowing what has to be done, but not quite how it is done.

So no different than management up to the CEO who simply “delegate” to the underlyings?

Except most those people have developed the separate skillset of playing work politics to make their job seem necessary.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#414

Earlier quoted context omitted.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

It is not that clear to me. Let us use an analogy. Many (most?) people can tell a well-written book or story from a mediocre or a terrible one, even though the vast majority of the readers hasn't written any in their lives. To distinguish good from bad doesn't necessarily require the ability to create.

I'm not actually sure that's true. Theres plenty of controversy now that books that are popular and beloved now are actually not very well written. I mean I've been hearing this complaint since Twilight was popular.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#415

Earlier quoted context omitted.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

I have very little knowledge of how transistors shuffle ones and zeros out of registers. That doesn't prevent me from using them to solve a problem. Computing is always abstractions. We moved from plugging to assembly, then to c, then we had languages that managed memory for you -- how on earth can you understand what the compiler should be doing or what it is doing if you don't deal with explicit pointers on a day b…

It is fundamentally different because with an API that other person understands it, but with an LLM neither you nor the LLM understand it

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#416
post #217
post #108

My friend works with people in their 20s. She recently brought up her struggles to do the math in her head for when to clock in/out for their lunches (30 minutes after an arbitrary time). The young coworker's response was "Oh I just put it into ChatGPT" The kids are using ChatGPT for simple maths...

Eh. I have a math degree. Aced all the advanced maths. Was the only one to get an A in Diff Eq. I love math. I've never been able to do simple math in my head. I can't even remember the times tables half the time. Simple math isn't really problem solving.

People who major in mathematics are really good at mathematical abstraction and are _notorious_ for their inability to do basic arithmetic. To the degree that it's a stereotype with a strong grounding it reality.

In college we had a rule for splitting the check at a restaurant: the youngest non-math major had to do it. Not being a math major, I'm not sure what happened when the table was all math majors. It wasn't a frequent occurence; there was a strong likelihood of a physicist or an engineer being around.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#417
post #341

Earlier quoted context omitted.

> Ever thought that there might be people under skyscraper that is your ego? I do, which is exactly why I found the presumption that not spending your time doing the coding is equivalent to a disability both gross and arrogant. > Where are they supposed to learn good design when slop takes over? You're not learning good architecture and systems design from code. You learn good architecture and systems design from doi…

> And, yes, I stand by the claim the coding is by far the simplest part, on the basis of having done both for longer than most developers have been doing either. Doubling down on your ignorance, bold strategy.

Speaking from experience.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#418
post #217
post #108

My friend works with people in their 20s. She recently brought up her struggles to do the math in her head for when to clock in/out for their lunches (30 minutes after an arbitrary time). The young coworker's response was "Oh I just put it into ChatGPT" The kids are using ChatGPT for simple maths...

Eh. I have a math degree. Aced all the advanced maths. Was the only one to get an A in Diff Eq. I love math. I've never been able to do simple math in my head. I can't even remember the times tables half the time. Simple math isn't really problem solving.

But you could if you wanted to, probably.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#419

Earlier quoted context omitted.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

I have very little knowledge of how transistors shuffle ones and zeros out of registers. That doesn't prevent me from using them to solve a problem. Computing is always abstractions. We moved from plugging to assembly, then to c, then we had languages that managed memory for you -- how on earth can you understand what the compiler should be doing or what it is doing if you don't deal with explicit pointers on a day b…

[deleted]

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#420
post #108

My friend works with people in their 20s. She recently brought up her struggles to do the math in her head for when to clock in/out for their lunches (30 minutes after an arbitrary time). The young coworker's response was "Oh I just put it into ChatGPT" The kids are using ChatGPT for simple maths...

I've been using a Python prompt or the browser URL bar for simple maths for over a decade. I don't see much added value in doing arithmetic manually, humans really suck at it.

It's easy to miss the value in something you don't do. I do fermi estimates in my head all the time and it would be exhausting to constantly pull out my phone to calculate things, to the point that I would stop attempting it as much as I do.
Post reply on HN