Live data from Hacker News

Code Review for Claude Code

claude.com

41–50 of 52 posts

Re: Code Review for Claude Code

#41
My experience has been similar. LLM reviews are useful, but they tend to always produce findings. Even on small or very clean changes you wll still get a list of suggestions.

So part of the workflow becomes filtering signal vs noise.

Re: Code Review for Claude Code

#42

Earlier quoted context omitted.

Nah, you're insane if you totally change your workflow to the point where you're reliant on them and your skills atrophy though.

Depends on the skills, I can’t read assembly

you dont pay to compile to assembly either

Re: Code Review for Claude Code

#43
Yeah, the "$15-20 a PR is cheaper than a great engineer" idea is doing a lot of hand‑waving here...

If you're a big shop pushing, say, 2,000 PRs a week and reviews average $15–25, that’s on the order of $30k–$50k a week in AI review spend, or $1.5-2.5M a year. That is quite a line item to justify.

"It's $20 cheaper than a senior engineer’s hourly rate,"... so what are you actually doing with your human reviewers once you add this on?

If you keep your existing review culture and just bolt this on, then you've effectively said "we’re willing to add $1–2M+ a year to the budget." That might be fine, but then you should be able to point to fewer incidents, shorter lead times, higher coverage, something like that.

Either this is a replacement story (fewer humans, different risk profile) or it's an augmentation story (same humans, bigger bill, hopefully better outcomes). "It’s cheaper than a great engineer" by itself skips over the fact that, at scale, you’re stacking this cost on top of the engineers you already have in the org.

Re: Code Review for Claude Code

#45
I shipped this parallel agent workflow with validator agents as an internal tool months ago. It got a 20% reduction in time-to-merge, had a similar cost, and left 10x the comments as any existing AI review tool.

It's totally worth it.

Re: Code Review for Claude Code

#48
Interesting to see this formalized. I've been running controlled experiments on why context separation improves LLM review quality — something I'm calling Cross-Context Review (CCR).

Setup: 30 artifacts (code, docs, scripts), 150 injected errors, 4 review conditions, 360 total reviews using Claude Opus 4.6.

Results:

- Cross-Context Review (artifact only, no production history): F1 28.6%

- Same-session self-review: F1 24.6% (p=0.008 vs CCR)

- Same-session repeated review (SR2): F1 21.7%

The SR2 result is the key finding — reviewing twice in the same session doesn't help (p=0.11 vs single review). The model generates more noise, not more signal. This rules out "two looks are better than one" as an explanation. It's the context separation itself that matters.

The gap is widest on critical errors: 40% detection for CCR vs 29% for same-session review.

Mechanism: production context introduces anchoring bias + sycophancy + context rot. A fresh session eliminates all three simultaneously by removing the conditioning tokens.

What Anthropic is doing here — dispatching independent agents that never saw the production context — is essentially this principle at industrial scale. Working on a paper but not published yet.

Re: Code Review for Claude Code

#49
post #48

Interesting to see this formalized. I've been running controlled experiments on why context separation improves LLM review quality — something I'm calling Cross-Context Review (CCR). Setup: 30 artifacts (code, docs, scripts), 150 injected errors, 4 review conditions, 360 total reviews using Claude Opus 4.6. Results: - Cross-Context Review (artifact only, no production history): F1 28.6% - Same-session self-review: F1…

Update: the paper is now on arXiv — https://arxiv.org/abs/2603.12123

"Cross-Context Review: Improving LLM Output Quality by Separating Production and Review Sessions"

Re: Code Review for Claude Code

#50
post #9
post #2

Interesting: "Reviews are billed on token usage and generally average $15–25, scaling with PR size and complexity."

This cost seems wild. For comparison GitHub Copilot Code Review is four cents per review once you're outside of the credits included with your subscription.

I don't know how good Claude's reviews are but I have yet to get a worthwhile GitHub Copilot review.
Post reply on HN