Live data from Hacker News

The LLM Critics Are Right. I Use LLMs Anyway

theocharis.dev

21–30 of 330 posts

Re: The LLM Critics Are Right. I Use LLMs Anyway

#21
Good article! This matches how I feel about the situation.

It's really not incongruent to use LLMs and be in awe of their frankly incredible capabilities while at the same time recognize the risks and frankly real damage we are already seeing to junior training and hiring, open source communities and (in my opinion) very soon the entire fabric of our society.

I respect that people don't want to use agents themselves for whatever personal reason.

I respect maintainers not accepting AI-authored contributions. It's a tradeoff between progress, growing new contributors and maintainer sanity. Though I do feel that categoric opposition to anything AI will likely be futile in the mid-term.

I respect people pushing for regulation of AI or a global pause or whatever.

I don't particularly respect people dismissing everything AI authored as slop. Categorically refusing to read an article because it contains em-dashes or the term "load-bearing" is silly. While this is slowly changing now, many people are still in complete denial as to what the frontier AI is capable of.

Love it, hate it - I don't care, but at least respect it, goddamit.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#22

Earlier quoted context omitted.

If you have no critiques about a piece of technology in an area of technology that has existed for less than 10 years I think that speaks for itself.

so you are saying that the advent of internet also deserved criticism in much the same way as LLM's? - job displacement - ethics - environmental - skill atrophy

The advent of the internet was collaborative and based on introducing shared protocols for a couple of decades. It deserved criticism when globalised capitalism got involved, and monopolies started forming, leading to rent-seeking, excessive centralisation, and enshittification.

The impact is that the internet has a fraction of the value to improve people's lives as it should have. It is a very poor free market, incredibly poor competition because of lack of standards and protocols and interoperability. People's minds are ground down by social media, search engines don't work well any more and so on.

So yes - every new technology deserves many criticisms, so they can be addressed, and as a society we can gain the benefits of that technology and minimise the disadvantages.

The printing press lead to copyright, public libraries, universal literacy... All things which are now widely celebrated. They took centuries to work out, and are all government and regulatory intervention to fix problems critics noticed and campaigned about.

AI is the same, only it is at risk of moving much faster and having a much large negative impact before society reacts.

So no, most of the criticism of LLMs are not wrong - they are correct, as are the people saying the technology of LLMs is useful to people and the economy.

Critics are friends of a new technology - without responding to every criticism in a significant way, AI will rapidly lead to a Butlerian jihad. If you like AI, you should love criticism of AI even more.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#23
I think both the LLM critics and the LLM advocates are right.

Even this article has some cognitive dissonance in it. What it really comes down to is how much you trust your own verification process. The branches of questions an LLM generates are still trapped within the biases of its training data. Of course, the authority to craft that initial prompt, the very first question, comes from human experience and learning.

But I think thought itself is the easiest resource to outsource. People say the human did the thinking and the LLM just amplified it, but the truth is, the LLM outsources the thinking. Otherwise, when the result is good, people say "human thought was present," and when it's bad, they say "human thought was absent." But a part of the actual thinking really is outsourced. The alternatives, the counterexamples, the sentence structure. In programming terms, the reader's experience gets outsourced. When you write a blog post, you find yourself thinking about how to make something you understand easy for someone else to understand. With an LLM, that part gets outsourced.

But at the same time, I don't get the argument that you shouldn't use it at all. We don't "think" about everything. We have limited cognitive resources. So we study deeply the things we care about, but for the things we don't need, we mostly leave them to "common sense" or prejudice. We just skim the surface.

I think of "common sense" as "the largest collection of prejudice." Because what we call common sense usually just amounts to surface level knowledge, the kind of thing we know just enough about to get by.

That's why I think LLMs are good. The reason is simple. I don't think deeply about everything in the world anyway. For everything else, I'm buried in some kind of bias. You see it on HN all the time, right? People fight over some technology, but they often don't think about its internal structure or why it works the way it does. They just treat it as an identity. They fight over a particular language, a framework, an operating system, but they rarely check how that technology actually works internally or why it was designed that way. Why use MVC, why a different architecture might be better for my case, it's easier to just go with what's popular. Put more elegantly, "job mobility" gets bundled in there too. I use Windows. In my country, if it's not Windows, you literally can't do anything. You can't even do basic online banking. From regional context like that all the way down to personal interests, people are bound to be different. So I'm just going to use LLMs. The most common excuse you hear around this is the whole "reinventing the wheel" thing.

So yeah, I'm going to use LLMs. Because I recognize that I bias myself toward only thinking about what I want to think about. And I know that bias isn't cognitively healthy. But on the flip side, I think what the world values, whether it's knowing a lot or knowing one thing deeply, is going to change.

Honestly, I don't know what's right. I think both the advocates and the critics are making valid points. I respect the people who don't use it, and the people who do just have their own workflow. There's really no reason to fight over whose workflow is superior.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#24
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

>Conversely, I also am a user of LLMs (true shocker these days, I know), and am noticing a speedup in areas I was already familiar with, and a quicker introduction to new ones. The obvious benefit cannot be denied, and doing so regardless makes you look uninformed.

My largest concern comes from something tangential to this: I'm not sure we're all that good at deciding what should be learned and sticking to it.

Silly example: regex. LLMs are, as far as I know, well above the average dev when it comes to writing regex. Regex is also one of those things that for many people goes unused for months, but then you encounter the occasional perfect regex problem, and it's really easy to just lean on the LLM to write the regex for you rather than spending some time tinkering and testing. Regex can be frustrating and fickle, I think we've all been there.

But then, you just don't learn regex. So where does the intuition for what regex can do come from? Do you just become unable to write regex with no LLM? People stop writing resources for regex I guess?

My concern is that there's stuff I feel I can just chuck onto the LLM but I'm sure my judgement is not perfect. It's still probably worth it, all in all, but I'm not even sure of what I might be losing along the way and that's an uneasy feel.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#25
post #6
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. For sure. You cannot have "only higher level thoughts" without doing lower level work. Ironically llm themselves prove that because you cannot remove facts like 'paris is capital of france' from llm and have it just retain 'high level thoughts' like 'countries have cap…

> For sure. You cannot have "only higher level thoughts" without doing lower level work

What do you mean? I think people routinely think about things at a very high level with almost no understanding of the lower levels. How many people use a computer each day and reason about them at a very high level while knowing nothing of capacitors, logic gates, or programming languages?

Re: The LLM Critics Are Right. I Use LLMs Anyway

#26
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

> whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles

Well, I think most neuropsychologists would agree that the answer is "yes, there will be atrophy" - if you don't use it, you lose it.

> So what’s the ideal “middle ground” in this situation?

I've been thinking a lot about this myself. My current plan is to train myself to get good at recognizing the feeling of "there's potential effort here that I want to outsource to the LLM" and occasionally choosing to not outsource it and do it by hand - especially with personal projects, where there's far less pressure to ship with velocity than work projects - but I'm not settled on this. I'll take any idea!

Re: The LLM Critics Are Right. I Use LLMs Anyway

#27
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

I don't think there is necessarily one ideal middle ground here. It still feels to me like what's best is a function that depends on who and when.

I see it as something like a personal gradient descent. You're working on a problem, there are solutions down there somewhere, and you can kind of feel the gradient of the tools-and-techniques ground around you. Any way you walk means you're investing time improving some skill or another. So you should go the way that personally feels to you will best get you moving in the direction that you want to go.

For some people it's obvious LLMs are competent coders, getting better, sticking around... and those people should lean into that gradient. For some people what's obvious is nearly the exact opposites of all that, and I'd encourage those people to also follow their gradient/heart/nose down the path of sharpening their personal traditional coding skills. Some people are in a relatively flat area where nothing is obvious, and need to explore and maybe just keep doing their best to hedge with a bit of both.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#29

>as a senior, you don’t need juniors anymore. The mundane tasks, at least I find that a lot of people agree with that one, can be fully outsourced to an LLM Master craftsmen didn't take on apprentices to give them chores.

Master craftsmen paid apprentices almost next to nothing, and they were often contractually guaranteed to stick around for many years, so the teaching was a kind of wage and also a cost that could be recuperated later on. (The apprentice even often had to pay the craftsman to take them on.) None of those things are true for junior software engineers, who are paid to contribute and can leave at any moment. Also, yes apprentices often had to do chores. It is just not analogous at all.

Re: The LLM Critics Are Right. I Use LLMs Anyway

#30
post #6
post #2

> LLM’s amplify what you already have: opinions, structure, frameworks. So far, so agreeable, but… > If you have thoughts, they come out sharper and faster. I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thou…

> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles. For sure. You cannot have "only higher level thoughts" without doing lower level work. Ironically llm themselves prove that because you cannot remove facts like 'paris is capital of france' from llm and have it just retain 'high level thoughts' like 'countries have cap…

For sure. You cannot have "only higher level thoughts" without doing lower level work.

Spend 3 days a week writing Ruby on Rails and 2 days hand rolling x86 assembly. Every web dev I know has been doing this since long before LLMs. Ensures they can keep having high level Rails thoughts.

Post reply on HN