Earlier quoted context omitted.
[flagged]
That's a very good point. The OP is "quite weak at JavaScript" but their AI "vastly improved the quality of the extension." Like, my dude, how can you tell? Does the code look polished, it looks smart, the tests pass, or what?! How can you come forward and be the judge of something you're not an expert in? I mean, at this point, I'm beginning to be skeptical about half the content posted online. Anybody can come up w…
Ask HN: Do you have any evidence that agentic coding works?
161–170 of 478 posts
Re: Ask HN: Do you have any evidence that agentic coding works?
#162Earlier quoted context omitted.
[flagged]
Given the claims that AI is replacing jobs left and right, that there’s no more need for software developers or computer science education, then it had jolly well better be able to code a perfect application while I watch baseball.
Re: Ask HN: Do you have any evidence that agentic coding works?
#163The problem: there is no way, he verified the code in any way. The business logic behind the feature would take probably few days to check for correctness. But if it looks good -> done. Let the customer check it. Of course, he claims “he reviewed it”.
It feels to me, we just skip doing half the things proper senior devs did, and claim we’re faster.
Re: Ask HN: Do you have any evidence that agentic coding works?
#164Easiest way to get value is building tests. These don't ship.
You can get value from LLM as an additional layer of linting. Reviews don't ship either.
You can use LLM for planning. They can quickly scan across the codebases catch side effects of proposed changes or do gap analysis from the desired state.
Argumenting that agentic coding must be on or off seem very limiting.
Re: Ask HN: Do you have any evidence that agentic coding works?
#165Other things that seem to contribute to success with agents are:
- Static type systems (not tacked-on like Typescript)
- A test suite where the tests cover large swaths of code (i.e. not just unit testing individual functions; you want e2e-style tests, but not the flaky browser kind)
With all the above boxes ticked, I can get away with only doing "sampled" reviews. I.e. I don't review every single change, but I do review some of them. And if I find anything weird that I had missed from a previous change, I to tell it to fix it and give the fix a full review. For architectural changes, I plan the change myself, start working on it, then tell the agent to finish.
Re: Ask HN: Do you have any evidence that agentic coding works?
#166Caveat: can't be pure vibes. Needs ownership, care, review and willingness to git reset and try again when needed. Needs a lot of tests.
Cavaet: Greenfield.
Re: Ask HN: Do you have any evidence that agentic coding works?
#167A principal engineer at Google posted on Twitter that Claude Code did in an hour what the team couldn’t do in a year. Two days later, after people freaked out, context was added. The team built multiple versions in that year, each had its trade offs. All that context was given to the AI and it was able to produce a “toy” version. I can only assume it had similar trade offs. https://xcancel.com/rakyll/status/200765974…
Re: Ask HN: Do you have any evidence that agentic coding works?
#168Sure, here are my own examples: * I came up with a list of 9 performance improvement ideas for an expensive pipeline. Most of these were really boring and tedious to implement (basically a lot of special cases) and I wasn't sure which would work, so I had Claude try them all. It made prototypes that had bad code quality but tested the core ideas. One approach cut the time down by 50%, I rewrote it with better code an…
“Most of these were really boring and tedious to implement (basically a lot of special cases) and I wasn't sure which would work, so I had Claude try them all.”
I doubt you verified the boring edge cases.
Re: Ask HN: Do you have any evidence that agentic coding works?
#169Agentic coding is very similar to frameworks in this regard:
1. If the alignment is right, you have saved time.
2. If it's not right, it might take longer.
3. You won't have clear evidence of which of these cases applies until changing course becomes too expensive.
4. Except, in some cases, this doesn't apply and it's obvious... Probably....
I have a (currently dormant) project https://onolang.com/ that I need to get back to that tries to balance these exact concerns. It's like half written. Go to the docs part to see the idea.
Re: Ask HN: Do you have any evidence that agentic coding works?
#170AN AI managed to do basically the whole transfer. One big help is I said "The website output of the current version should be identical", so I had an easy way to test for correctness (assuming it didn't try cheating by saving the website of course, but that's easy for me to check for)