Live data from Hacker News

The LLM Critics Are Right. I Use LLMs Anyway

theocharis.dev

141–150 of 330 posts

Re: The LLM Critics Are Right. I Use LLMs Anyway

#141
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

> Conversely, I also am a user of LLMs (true shocker these days, I know), and am noticing a speedup in areas I was already familiar with, and a quicker introduction to new ones. The obvious benefit cannot be denied, and doing so regardless makes you look uninformed. [Excluding people who don’t want anything to do with LLMs out of moral principle, which curiously just like the overarching topic I also both respect and…

> What about me ...

While I can see that you feel very passionately about this, the reality is that it's the majority experience that will dictate adoption.

There may never be published research on productivity -- blinding in this instance is impossible, so I don't know how you'd ever do fully-controlled behavioural studies that carried any weight. It doesn't matter. If enough of us decide that LLMs are useful to us, then this form of coding will become the norm.

If that ends up causing more harm than good, then eventually there will be a course correction. But for now, for enough people that matter, LLMs are at least giving the perception of productivity increases. And our decisions and choices come down to the perception of reality, not reality itself (for better or worse).

So I think it's far more useful to take a pragmatic approach, as per TFA. Accept that LLMs have issues, but also bring advantages, and that LLM use in coding is here to stay. What we can do is remain aware of the bad, and make better use of the good.

As for you, personally ... if you mentally cannot deal with LLM output, then I think you have two choices. You can either learn to author system prompts, so that LLM output better fits your needs and no longer triggers you; or you can sit more and more on the outer, raging against the machine while the world changes around you.

Eventually, you'll be like a master craftsman in an era of mass-production. But that's potentially highly valuable in niche markets (consider a watchmaker working in Glashutte, for example), so you may yet win from this. Remember that every day, LLMs are making your own coding skills and knowledge more elite and therefore lucrative, sit back, and smile.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#142
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

If cars did not exist, I would be healthier, able to walk and run many times further due to constant cardio exercise. I would still travel much less distance. And just like cars, LLMs will reshape the world to the point that our brains could not even get us to the supermarket because soon it will be 5 miles away and require a car ( or at least a local LLM bike )

[dead]

Re: The LLM Critics Are Right. I Use LLMs Anyway

#143
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.

Used to think so, but they actually can also be used to train and strengthen skills, and learn new ones.

I had a coding interview, where they kindly sent a brief beforehand to help prepare, presenting a list of topics and concepts that might be useful during the interview, the tech stack, what kind of expectations they would have, and what they’d be paying attention to.

Obviously, it’s not exact list, and there are probably other evaluation dimensions.

But since I was out of practice on some of those, I had Claude generate a dozen sample projects, with each a list of tasks in one document and the solutions in another, and got to it.

Midway, I thought of using codex to role play as an interviewer, to tell it my train of thought and ideas as I went, get feedback, question my choices, etc.

Sure I only went through two and half, maybe three of those projects… but it’s the first time I actually enjoyed prepping for an interview. And I actually learned some things in the process.

Hardest part was probably stopping the LLM from doing the tasks, but nothing unsolvable given a bit more time, clearer instructions, and separation.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#144
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

You can run to the farm to kill your own chicken so you can stay sharp and fit or figure out what's economically valuable. Or make a bet on what will be valuable later and commit to a brand of yourself

Re: The LLM Critics Are Right. I Use LLMs Anyway

#145
post #62

Earlier quoted context omitted.

I will just point out the benefit is not as obvious as you think. Developers have consistently overestimated LLM productivity gains, which still seems true for agentic AI: https://metr.org/blog/2026-05-11-ai-usage-survey/ It is particularly striking how similar the results are to LLMs before agents. Along with the total absence of long-term data, I think the benefit can be (weakly) denied. Maybe not in the employmemt…

> I will just point out the benefit is not as obvious as you think. Developers have consistently overestimated LLM I think there are two different claims here: - developers overestimate productivity gains, which is a solid finding in many of these studies. Skepticism of extremely large productivity gains is warranted and I flatly disbelieve "10x uplift" claims. - LLMs give no productivity uplift at all, which is much…

Developers are cashing in on the productivity gains. Meaning instead of using the increased productivity to do more work, they just become lazier or do fun irrelevant side projects instead, where as before there was just not much time for such things. I have definitely procrastinated on work simply because I know I can swoop in with an LLM and do it all in 15 minutes, whereas before I would have spent a few hours.

This is how LLMs can both result in greater productivity yet still not appear to yield much more benefit than the pre-LLM era.

And there is no benefit to the developer for doing the work first then just sitting idle. That’s how you get people putting more things on your plate.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#147
post #111

Earlier quoted context omitted.

I think the real disaster is that once you let the LLM work on a project for a bit, you start to lose understanding of what exactly is even happening under the hood in the project. You can take steps to mitigate this, but agents don't exactly encourage the behavior required to maintain a good understanding of what's going on.

Like becoming a manager? When a person becomes a manager, they do or do not have enough time and expertise to review all of the code that they trust the team to produce. Managers usually get into automated testing; unit tests, integration tests, acceptance tests, and maybe also BDD syntax Managers and developers are responsible for setting a test coverage threshold for merge approval. If there is 100% branch coverage…

Formal verification is always more valuable than mere testing, but it's hitherto more expensive. The thing that ultimately matters is closing the loop: how well do the tests match the requirements, both as written and as unwritten in the mind of the customer?

Working with an LLM has given me a real eye opener on unwritten requirements. It's like outsourcing. "Yes, you've given me what I wrote down, but I never expected you do to it in that way"

Re: The LLM Critics Are Right. I Use LLMs Anyway

#148

> a genuinely good tool that enriches your thinking A smartphone is also a genuinely good all-around tool. Even social media is a genuinely good tool for connecting people. Yet, I feel like we've been overly optimistic about the impact of said tools on us and our societies in the past two decades. Smartphones are so good, in fact, in some societies, half of us are addicted to them. Billions of people world-wide. I as…

There's a saying that the intelligence of an average prehistoric cave man should be, in general, higher than a modern day human simply because the lack of technology required stone age humans to be far more intelligent then we are today. Now you can survive by working as a clerk in McDs, but in the stone age you needed to be on your toes and smart af. LLMs are just continuing the trend humanity has long been travelin…

"Flynn effect" claimed that intelligence has been increasing over time. At least we can sort of measure things in the modern era, while objectively assessing the intelligence of the long-dead is turning into skull-measuring territory.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#149
post #55

Earlier quoted context omitted.

I will just point out the benefit is not as obvious as you think. Developers have consistently overestimated LLM productivity gains, which still seems true for agentic AI: https://metr.org/blog/2026-05-11-ai-usage-survey/ It is particularly striking how similar the results are to LLMs before agents. Along with the total absence of long-term data, I think the benefit can be (weakly) denied. Maybe not in the employmemt…

The productivity depends upon the requirements. If slop is fine (and sometimes it is), the benefits are undeniable. If the dev was the kind that would have produced slop anyway - again, undeniable boost. If the quality needs to be high I think it actually can slow you down, though.

Agreed, but also to expand, if the dev is mediocre and ai-assisted coding is a skill, the productivity gains are 10x more mediocre code. Since code is a liability, this is not desirable. Hence, mediocre devs being more productive is an underestimated problem of the age of ai-assisted coding. I see this every day.

The result is a whole bunch of dysfunctional systems unnecessarily dislodging perfectly acceptable processes.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#150
post #40

Earlier quoted context omitted.

> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. It will, but I'm not sure the impact of this will be all too great. We suffer from not knowing how to use an abacus because we have a calculator, and people who feel a pull to keep their low-level chops up will do so anyway.

Now imagine if your calculator billed per button press. And imagine you can't own a calculator because owning one outright requires too much hardware (or whatever).

This is just a repackaged argument against SaaS and cloud infrastructure. Every business could be using subscription free spreadsheet software and storing all of their data on prem and employing an IT team to manage the servers and data but the majority choose to pay a third party to handle all of that. Hell, they could even go so far as to do it all manually with written records and filing cabinets. All of those workflows still exist in varying degrees scattered across the myriad of businesses, the existence of SaaS doesn't eliminate the others. AI seems to be playing out in a very similar way with the big providers, local models and die hard human programmers.
Post reply on HN