Live data from Hacker News

The Coming Loop

lucumr.pocoo.org

41–50 of 322 posts

Re: The Coming Loop

#41
As much as I like Claude Code, Boris has done a lot of harm by encouraging software engineering practices that lead to slopware. We have two camps of people at work, the first camp are the agent goes brrr. They don't understand the code they write. They have loops running, agent orchestrators or agent hype du jour. The second camp is people who are inundated with PRs, are holding the line on quality, and just exhausted. We've also had some management pressures where they think people are wasting time looking at code. Perhaps because some podcast they might be listening to, somebody says coding is largely solved.

> I don’t prompt Claude anymore. I have loops running that prompt Claude and figuring out what to do. My job is to write loops.

This is going to be a net negative on software quality for people who take this up, in my opinion.

I call out Boris but I also don't think he's being malicious. He's at the center of an important technological revolution and it would be hard not to get excited. I just wished he advocated for a more balanced and a realistic perspective.

Re: The Coming Loop

#42
post #14

Loops work when you spend the proper amount of time to understand what you want ahead of time. The prerequisite is clarity — enough clarity that you could write a careful specification that you could hand off to a junior colleague. Often, it takes 5-6 broken crappy versions of a thing until you understand that. There is no accelerating the 5-6 broken crappy versions - there’s no agent tech that’s going to help your m…

I had codex write a tool to extract all my pi sessions. (Had to filter out my prompts from the agents talking to subagents).

Then I had it analyze the patterns i was making and turned that into the flowchart for the outer guidance-creating-prompt.

I didn't have to spend too much time thinking what i wanted. I wanted it to do that.

The result is still mixed, and i'm not trusting it with delicate code bases, but for a game i've been building i dropped my check-in time to 1/5th i was previously spending on it.

Thats not a good thing per-se. I'm sure i'm missing good ideas by _not_ spending time with it. But previously I really had stagnated with my prompts becoming mechanical #now-do-this and #now-review-that with 90% of its suggestions being correct.

Just need to (automatically) remind it to "do the hard stuff first, clean up & refactor as you go" as well as a "reflect on your work" after its first return to get it to spill the beans on any crap left behind, and then process that in the guidance-creating-prompt to dish out new work.

Re: The Coming Loop

#43
I'm willing to be persuaded otherwise: Looping seems to (currently) be a side effect of token subsidies.

If token costs are nil, then you can afford to run verification and generation through the same models. If token costs are high, then you will go broke verifying code sprawl.

Currently costs are (mostly) absent from the conversation, even though costs are what decide the limits which shape experience.

Also: Firms can be held liable for the products they sell, so if code cannot be reviewed then that code is essentially a law suit waiting to happen. I believe this is what customers will be demanding in the future: someone to hold accountable when things go wrong.

Re: The Coming Loop

#44

Earlier quoted context omitted.

No, they really are my thoughts, I've been doing this stuff pretty much every day for the past 6 months

No offense, but this sentiment is diluted by commits like this: https://github.com/nfcampos/loop-dev/commit/e28b1fce0078e605... I assume that GP was just saying that they would prefer to read these thoughts written by a human author (preferably you). I agree.

This commit seems to mostly be grammar fixes? If someone used a spell/grammar checker it might produce a diff similar to this. Why does the fact it was Claude and not Microsoft Word or other matter in this case?

Re: The Coming Loop

#45
post #7

Earlier quoted context omitted.

> I feel uneasy, and I do not enjoy the work I deliver using LLMs. I have basically stopped writing code in my spare time since the advent of AI. Before I felt like I was working on a classic car. Was it a practical use of my time? No. I could go out and download software that did what I wanted. Did I have fun doing it? Yes, the act of working on it was important, I felt I was still learning and improving as I did. N…

I'm the opposite, couldn't be bothered to work on code outside of work. Barely did at work because I was more focused on wrangling a small army of shitty contractors (thanks strategic partner initiative for firing all of our small shop contractors and replacing them with morons from "offshore"). Now with LLMs I find myself doing small projects that interest me or have some utility for me outside of work, and doing a…

Agreed - there was always a set of things I wanted to do that I knew the magic core for, but wanted a team of implementers for the curft, the 100k of actual testing harnesses, hyperparameter exploration, etc.. . I now have that team of implementers. All the problems seem research-y though - optimal binary transport systems that are zero-copy and compatible with languages, fast physical simulation optimizers, etc etc... So, things that all had a _LOT_ of busywork around the magic core.

Re: The Coming Loop

#46
The issue is that whilst the loops will initially lead to good results they will be less and less as context gets bigger and bigger and tougher to understand for human and AI.

So it depends really on the size of your project.

Re: The Coming Loop

#48

Earlier quoted context omitted.

No offense, but this sentiment is diluted by commits like this: https://github.com/nfcampos/loop-dev/commit/e28b1fce0078e605... I assume that GP was just saying that they would prefer to read these thoughts written by a human author (preferably you). I agree.

That commit happens to be a find replace because i usually write for my company’s blog (we)

I would be more willing to believe you only used Claude for minor editing tasks if you disclosed your usage of Claude upfront.

Re: The Coming Loop

#49
>Yet even with a lot of manual steering, that type of code does not come out of LLMs naturally, and even if the code comes out naturally like that, they will still attempt to handle now impossible errors.

This is something I’ve struggled to fight against in many PR reviews. Especially once already written, convincing someone that their excessive null checking is harmful is an uphill battle. Short of better modeling (and languages that allow for sum types to enable it), I haven’t been able to come up with a universally convincing argument against this kind of “shotgun parsing.”

Maybe it really just isn’t that big of a deal? But when actually reading through and refactoring a codebase I’ve always found it frustrating to manage these unnecessary checks. Sometimes they’re nearly impossible to delete safely once present without first adding some kind of logging or broad investigation.

Re: The Coming Loop

#50
> the right fix is not "handle every malformed case." ... [LLMs] will still attempt to handle now impossible errors.

This is the number one code smell from LLMs and I don't know why they are so obsessed with it. In python, it often comes as `hasattr` checks on types that are defined to have that attribute, in a code base that is fully type-checked.

Why do they do that? Is it from pre-training or re-enforcement? If that latter, can the labs please fix this?

Post reply on HN