Live data from Hacker News

Code Review for Claude Code

claude.com

21–30 of 52 posts

Re: Code Review for Claude Code

#21
post #9
post #2

Interesting: "Reviews are billed on token usage and generally average $15–25, scaling with PR size and complexity."

This cost seems wild. For comparison GitHub Copilot Code Review is four cents per review once you're outside of the credits included with your subscription.

Yea, but copilot review is useless. The noise it generates easily costs that much in wasted time.

Re: Code Review for Claude Code

#22
Or, just spin up your own review workflow, I've been doing this for the past couple of months after experimenting with Greptile and it works pretty well, example setup below:

https://gist.github.com/rlueder/a3e7b1eb40d90c29f587a4a8cb7c...

An average of $0.04/review (200+ PRs with two rounds each approx.) total of $19.50 using Opus 4.6 over February.

It fills in a gap of working on a solo project and not having another set of eyes to look at changes.

Re: Code Review for Claude Code

#23
post #2

Interesting: "Reviews are billed on token usage and generally average $15–25, scaling with PR size and complexity."

Senior+ engineers easily make $100+ an hour. This is equivalent to 15 minutes of their time max.

I run a PR review via Claude on my own code before I push. It’s exceptionally good. $20 becomes an incredibly easy sell when I can review a PR in 10 minutes instead of an hour.

Re: Code Review for Claude Code

#25
post #5

what are the implications for the tens of code review platforms that have recently raised on sky high valuations?

Same as all the other companies that built on top of the API and then were obsoleted after the API provider made it a built-in feature. https://finance.yahoo.com/news/claude-just-killed-startup-sf...

Reminds me of a post here (or maybe it was on another forum) about someone who built a tool for their own use but deliberately chose not to develop it into a product, citing insufficient moat. Seems like they read the room correctly.

Re: Code Review for Claude Code

#26
post #9

Earlier quoted context omitted.

This cost seems wild. For comparison GitHub Copilot Code Review is four cents per review once you're outside of the credits included with your subscription.

Yea, but copilot review is useless. The noise it generates easily costs that much in wasted time.

Not sure about that, I find it's generally pretty good at finding niche issues that aren't as easily caught by humans. Especially with newer LLMs it gets even better.

Re: Code Review for Claude Code

#27
post #15

> We've been running Code Review internally for months: on large PRs (over 1,000 lines changed), 84% get findings, averaging 7.5 issues. On small PRs under 50 lines, that drops to 31%, averaging 0.5 issues. Engineers largely agree with what it surfaces: less than 1% of findings are marked incorrect. So the take would be that 84% heavily Claude driven PRs are riddled with ~7.5 issues worthy bugs. Not a great ad of age…

I ask Claude or codex to review staged work regularly, as part of my workflow. This is often after I’ve reviewed myself, so I’m asking it to catch issues I missed.

It will _always_ find about 8 issues. The number doesn’t change, but it gets a bit … weird if it can’t really find a defect. Part of the art of using the tool is recognizing this is happening, and understanding it’s scraping the bottom of its barrel.

However, if there _are_ defects, it’s quite good at finding and surfacing them prominently.

Re: Code Review for Claude Code

#28
post #15

> We've been running Code Review internally for months: on large PRs (over 1,000 lines changed), 84% get findings, averaging 7.5 issues. On small PRs under 50 lines, that drops to 31%, averaging 0.5 issues. Engineers largely agree with what it surfaces: less than 1% of findings are marked incorrect. So the take would be that 84% heavily Claude driven PRs are riddled with ~7.5 issues worthy bugs. Not a great ad of age…

How many bugs do a human introduce in 1000 line PRs and 50 line PRs?

Re: Code Review for Claude Code

#29
post #2

Interesting: "Reviews are billed on token usage and generally average $15–25, scaling with PR size and complexity."

This mostly matches my own estimates for pr-review command that I use. But it's pretty sophisticated: 6 specialized agents, best practices skills, CVE database, bunch of scripts. To reduce cost, most of agents use cheap open source models.

Re: Code Review for Claude Code

#30
post #5

what are the implications for the tens of code review platforms that have recently raised on sky high valuations?

There might still be plenty of room to compete, especially at $15-$25 per review. I'm starting to feel like the right harness makes more difference than the right model. The real competition for both claude and the platforms is a skill running locally against the very same code.

agree on it potentially being a big market, just not sure it's big enough for multiple unicorn startups trying to justify their valuation. competing on price, especially when code review is the main bottleneck seems misguided imo
Post reply on HN