Live data from Hacker News

Cognitive Debt: When Velocity Exceeds Comprehension

rockoder.com

71–80 of 234 posts

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#71
post #9

The whole premise of the post, that coders remember what and why they wrote things from 6 months ago, is flawed. We've always had the problem that understanding while writing code is easier than understanding code you've written. This is why, in the pre-AI era, Joel Spolsky wrote: "It's harder to read code than to write it."

The individual details, probably not. But the high level/broad strokes I definitely remember 6+ months later.

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#72
post #9

The whole premise of the post, that coders remember what and why they wrote things from 6 months ago, is flawed. We've always had the problem that understanding while writing code is easier than understanding code you've written. This is why, in the pre-AI era, Joel Spolsky wrote: "It's harder to read code than to write it."

OP talks about the increased frequency of such events happening, and not that this is a new problem.

For example, handwritten code also tended to be reviewed manually by each other member of the team, so the probability of someone recalling was higher than say, LLM generated code that was also LLM reviewed.

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#73
This seems very similar to the situation of a new employee dropped into a large codebase of varying quality. It seems like similar techniques will get you out of the mess?

Also, you can ask the coding agent for help at understanding it, unlike the old days when whoever wrote it is long gone.

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#74

And now programmers experience what is like to be a user, trying to comprehend the system on their computer screen. I propose a new paradigm: programmer experience, PX. So, code generated by AI ideally would follow the rules of PX. Whatever those may turn out to be.

Is this different from DX?

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#75
post #48

Not to disagree with anything the article talks about but to add some perspective... The complaint about "code nobody understands" because of accumulating cognitive debt also happened with hand-written code. E.g. some stories: - from https://devblogs.microsoft.com/oldnewthing/20121218-00/?p=58... : >Two of us tried to debug the program to figure out what was going on, but given that this was code written several year…

Probably, we need to start saving prompts in Version Control. Prompts could be the context for both humans & machines.

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#77
post #33

Great article. I agree with the argument. But to offer a counter argument, would the same thing not have happened with the rise of high level languages? The machine code was abstracted away from engineers and they lost understanding of it, only knowing what the high level code is supposed to do. But that turned out fine. Would llms abstracting the code away so engineers only understand the functionality (specs, tests…

> But that turned out fine.

It did not turn out fine. Fortunately no one took it seriously, and at least seniors still have an intuitive model of how the hardware works in their head. You don't have to "see" the whole assembly language when writing high level code, just know enough about how it goes at lower levels that you don't shoot yourself in the foot.

When that's missing, due to lack of knowledge or perhaps time constraints, you end up on accidentally quadratic or they name a CVE after you.

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#78

I think we might as well just go all in at this point: "LGTM, LLM". The industry always overshoots and then self-corrects later. Therefore, maybe the right thing to do is help it get to a more sane equilibrium is to forget about the code altogether and focus on other ways to constrain it / ensure correctness and/or determine better ways to know when comprehension is needed vs optional. What I don't like is the imposs…

While I too am only seeing a boost on the order of 20% so far, I think there are more creative applications of LLM beyond writing code, that can unlock multiples of net productivity in delivering product end to end. People are discovering these today and blogging about them, but the noise about dark factories and agents supervising agents supervising agents, etc, is drowning out their voices.

Every one of us is a pioneer if we choose to be. We have only scratched the surface as an industry.

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#79

This happened to me yesterday. I give a junior engineer a project. He turns it around really quickly with Cursor. I review the code, get him to fix some things (again turned around really quickly with Cursor) and he merges it. I then try a couple test cases and the system does the wrong thing on the second one I try. I ask him to fix it. He puts into cursor a prompt like "fix this for xyz case" and submits a PR. But…

Senior engineers must become more comfortable giving quick, broad feedback that matches the minimal time put into the PR. "This doesn't fit how the system works; please research and write a more detailed prompt and redo this" is the advice they need. It feels taboo to do it to a significant diff, but diff size no longer has much correlation to thought or effort in these situations.

Re: Cognitive Debt: When Velocity Exceeds Comprehension

#80
post #76

This is like our whole technological society: many people only comprehend a small part of it at a time and only sketches of how other parts work

The difference is, perhaps with AI you need understand none of it at all. A thought with some interesting consequences.
Post reply on HN