Luna is great for grunt work, and has some intelligence, but the context window makes it terrible for any decent-sized review.
GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
151–160 of 166 posts
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#152Earlier quoted context omitted.
In our new world of non-deterministic output (that's why we love LLMs! they say such helpful/agreeable/sometimes wrong stuff!), I think CI won't be sufficient. CI is in the realm of Quality Control; when I build the thing, is it to spec and does it do what I need it to do? But when the model can shift underneath you, I think it will put pressure on Quality Assurance which is an evergreen task. As a parallel, drug man…
If that aspect is critical to your workflow, it seems like you could run the model of your choice off of hugging face, on GPU hardware under your control, so the model won't shift out from under you.
That's one good way to reduce the risk, but I don't think it eliminates it.
Even with the same model and the same input, the output is inconsistent. And what I've observed is that as the size of the input and output grows, the consistency and accuracy of the output seems to decrease. It gets more complicated when you don't control the full input, such as a chatbot with customers.
I think the problem remains even if it can be mitigated by freezing the model and the hardware, which carries the tradeoff of requiring a model you can download and run on your own so you can't use the SOTA models.
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#153Luna is great for grunt work, and has some intelligence, but the context window makes it terrible for any decent-sized review.
thats why pr size needs to stay scoped
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#154Earlier quoted context omitted.
Nah, we have AI code review at Google and it is shockingly good at catching bugs no one would have noticed. I absolutely depend on it now.
would you share a bit about the style of the code reviews and how its initiated? im trying to build something similar for my company
I have no idea how it works internally. Your assumptions about its workings are as good as mine.
It leaves comments though like a human reviewer would. I assume the key is a good prompt making sure the comments aren't too frivolous.
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#155Earlier quoted context omitted.
Nah, we have AI code review at Google and it is shockingly good at catching bugs no one would have noticed. I absolutely depend on it now.
Curious, which kind of model is used ? do y'all prefer using a lightweight model or a more capable one for code review ?
It's almost certainly Gemini but I don't know if it's Flash or Pro.
I would assume though advanced reasoning models would be best, especially since it's out of band. If I were building it maybe I'd run two adversarial models.
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#156[deleted]
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#157Updated link: https://entelligence.ai/blogs/gpt-6-astra-cost-1.6x-more-per...
The current link is a 404, seems like they didn't redirect it properly.
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#158Earlier quoted context omitted.
Only on the diff? Why? I found AI reviews garbage until they stopped being only on the diff and were actually able to query real context.
Because your local agent can already see the full codebase; the code review only needs to see what's changing and evaluate the change.
That’s strange. So your policy is “trust me bro my local agent knows best”?
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#159IMHO, Codex with Astra/Sol and Claude with Fable/Opus are all any professional programmer should be using in Sep 2026, if they can afford it. These models are still terrible compared to what we'd actually wish for, but they're the best available. If you can get away with using the $200/mo subscriptions, it's really not even a money thing for most professionals. Almost all of my work is now plan, generate, review, pla…
For side projects I pretty much exclusively use Luna xhigh. The $20/mo plan with the recent generous resets is more than enough for me. Sometimes I reach the 5hr limit, but haven't reached the weekly limit yet. The most recent project it finished was a SIP client for an ESP32 in-wall touch panel that I got from AliExpress for $50. It rings when someone is at my doorbell and let's me answer calls and see video. Yes an…
why not Luna at max?
Re: GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
#160Earlier quoted context omitted.
Quite good as work horses? To me Luna is the work horse and Sol and Astra are prancing thoroughbreds. If I use Sol or Astra for anything other than curated reasoning and planning I will burn through my usage limits in an hour.
Same. I use Luna for research/scout/test subagents, Sol for coordinator, Terra for delegate, and Astra high for review and simplify. Even with Astra in there, it’s fresh context, and I’m consistently amazed by how far I can stretch my $20 subscription with really good results.
what harness?