Live data from Hacker News

Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

media.mit.edu

461–470 of 529 posts

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#461
post #108

My friend works with people in their 20s. She recently brought up her struggles to do the math in her head for when to clock in/out for their lunches (30 minutes after an arbitrary time). The young coworker's response was "Oh I just put it into ChatGPT" The kids are using ChatGPT for simple maths...

I've been using a Python prompt or the browser URL bar for simple maths for over a decade. I don't see much added value in doing arithmetic manually, humans really suck at it.

Humans don't suck at arithmetic.

Anecdata: Most cashiers used to be able to give correct change at checkout very quickly; only a few would type it into the register to have it do the math. Nowadays, with so many people using cards etc., many of them freeze up and struggle with basic change-making.

It's just a matter of keeping in practice and not letting your skills atrophy.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#463
post #327

I'm still not a huge user of AI assisted stuff, although lately I have been using Google's AI summaries a lot. I've been writing cloudformation templates and trying to figure out how to bridge resources/policies together.

That's wild. Google's AI summaries are so frequently wrong. I hope you understand that you're getting bad info and not knowing which bits are bad.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#464
post #381

Earlier quoted context omitted.

Brains are adaptive and as we adapt we are turning more cognitive unbalanced. We're absorbing potentially bias information at a faster rate. GPT can give you information of X in seconds. Have you thought about it? Is that information correct? Information can easily be adapted to sound real while masking the real as false. Launching a search engine and searching may spew incorrectness but it made you make judgement, t…

>We are no longer critical thinking Please provide evidence that masses of people ever were critically thinking across general fields they were not involved in. Everyone seems to take for face value there was a golden age of critical thinking done by the masses is at some time in the indeterminate past, but regardless of when you ask this question, the answer is always "in the past". I surmise your thesis is incorrec…

Critical thining requires knowledge, which is why LLM appear OK at it, and I fear the next generation of humans will be worse.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#465

Earlier quoted context omitted.

It is not that clear to me. Let us use an analogy. Many (most?) people can tell a well-written book or story from a mediocre or a terrible one, even though the vast majority of the readers hasn't written any in their lives. To distinguish good from bad doesn't necessarily require the ability to create.

I'm not actually sure that's true. Theres plenty of controversy now that books that are popular and beloved now are actually not very well written. I mean I've been hearing this complaint since Twilight was popular.

I haven't read Twilight, but I've read a few beloved and popular books that are atrociously written from a literary standpoint. That does not mean they are not popular for a reason.

One I did read, out of morbid curiosity, is 50 Shades. It's utter dreck in terms of writing quality. It's trite, it's full of clichees, and formulaic to the extreme (and incidentally a repurposed Twilight fanfic; if you wonder about the weird references to hunger, there's the reason), but if you look at why it became popular, you might notice that it is extremely well crafted for its niche.

If you don't want a "billionaire romance" (yes, this is a well defined niche; there's a reason Grey is described as one) melded with the "danger" of vampire-transformed-into-traumatised-man-with-a-dark-side, it's easy to tear it apart (I couldn't get all the way through it - it was awful along the axes I care about), but as a study in flawlessly merging two niches popular with one of the biggest book-buying demographics that have extremely predictable and rigid expectations, it's really well executed.

I'd struggle to accept it as art, but as a particular kind of craft, it is a masterpiece even if I dislike the craft in question.

You will undoubtedly find poorly executed dreck that is popular just because it happened to strike a chord out of sheer luck as well, but a lot of the time I tend to realise that if I look at something I dislike and ask what made it resonate with its audience, it turns out that a lot of it resonated with its audience because it was crafted to hit all the notes that specific audience likes.

At the same time, it's never been the case that great pieces of literature was assured doing well on release. Moby Dick, for example, only sold 3,000 copies during Melville's lifetime (makes me feel a lot better about the sales of my own novels, though I don't hold out any hope of posthumous popularity) and was one of his least successful novels when it was first published. A lot of the most popular media of the time is long since forgotten for good reason. And so we end up with a survivorship bias towards the past, where we see centuries of great classics that have stood the test of time and none of the dreck, and measure them up against dreck and art alike of contemporary media.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#466
post #348

Earlier quoted context omitted.

self-driving cars are only 5 years away, just like 10 years ago

"Airplanes are only 5 years away, just like 10 years ago" --Some guy in 1891. Never use your phrase to say something is impossible. I mean there are driverless Waymo's on the street in my area so your statement is already partially incorrect.

Nobody is saying it isn't possible. Just saying nobody wants to pay as much money as it's going to take to get there. At some point investors will say, meh, good 'nuff.

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#467

Earlier quoted context omitted.

> My "actual job" isn't to write code, but to solve problems Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. One ends like the clueless manager type who hasn't touched a computer in 30 years. At which poi…

> Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. Using AI myself _and_ managing teams almost exclusively using AI has made this point clear: you shouldn't rely on it as a black box. You can rely on it to…

What I find the most "enlightening" and also frightening thing is that I see people that I've worked with for quite some time and who I respected for their knowledge and abilities have started spewing AI nonsense and are switching off their brains.

It's one thing to use AI like you might use a junior dev that does your bidding or rubber duck. It's a whole other ballgame, if you just copy and paste whatever it says as truth.

And regarding that it obviously doesn't apply to small fixes: Oh yes it does! So many times the AI has tried to "cheat" its way out of a situation it's not even funny any longer (compare with yesterday's post about Anthropic's original take home test in which they themselves warn you not to just use AI to solve this as it likes to try and cheat, like just enabling more than one core). It's done this enough times that sometimes I don't trust Claude with an answer I don't fully understand myself well enough yet and dismiss a correct assessment it made as "yet another piece of AI BS".

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#468

An obvious comparison is probably the habitual usage of GPS navigation. Some people blindly follow them and some seemingly don't even remember routes they routinely take.

I have ALWAYS had this problem. It's like my brain thinks places I frequent are unimportant details and ejects them to make room for other things. I have to visit a place several times and with regularity to remember it. Otherwise, out it goes. GPS has made this a non-issue; I use it frequently. For me, however, GPS didn't cause the problem. I was driving for 5 or 6 years before it became ubiquitous.

I ask AI how to solve programming problems (e.g. how to check hung database sessions), and I realize the next time I needed it, I never memorized the command and have to look back in the logs...

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#469

Earlier quoted context omitted.

> Solve enough problems relying on AI writing the code as a black box, and over time your grasp of coding will worsen, and you wont be undestanding what the AI should be doing or what it is doing wrong - not even at the architectural level, except in broad strokes. Using AI myself _and_ managing teams almost exclusively using AI has made this point clear: you shouldn't rely on it as a black box. You can rely on it to…

What I find the most "enlightening" and also frightening thing is that I see people that I've worked with for quite some time and who I respected for their knowledge and abilities have started spewing AI nonsense and are switching off their brains. It's one thing to use AI like you might use a junior dev that does your bidding or rubber duck. It's a whole other ballgame, if you just copy and paste whatever it says as…

> if you just copy and paste whatever it says as truth.

It's more difficult than ever, because Google is basically broken and knowledge is shared much less these days, just look at stack overflow

Re: Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant

#470

Earlier quoted context omitted.

You’re currently using the internet.

That doesn't contradict anything they wrote.

To be fair all they wrote was just a rant based on some very unsubstantiated claims, I think the burden of proof is on them a little bit
Post reply on HN