Astra seems to be really slow. Maybe it intends to read more context. But from my experience it is definitely slower than 5.6 sol when handling same tasks.
GPT-6 Astra in code review: Gains, privacy, and cost
11–20 of 75 posts
Re: GPT-6 Astra in code review: Gains, privacy, and cost
#12Re: GPT-6 Astra in code review: Gains, privacy, and cost
#13Comparison was done in the scope of coderabbit AI code review tool, which sadly makes it practically irrelevant. My personal experience as a software engineer, and a former security researcher who did manual code audit, is that this code review tool has such poor results that it isn't worth the "noise" and friction it causes developers during C/I code review
Yeah I personally don’t understand the point of AI code review tools all that much, as AI is already generating the code as well. All of these AI code review tools create so much noise, yet don’t catch the really important things.
Code review tools are designed for less organised dev teams that don’t do PRs and mandatory human reviews already.
It is papering over a lower level of competency without having to invest in actual human oversight or real process improvement.
Re: GPT-6 Astra in code review: Gains, privacy, and cost
#14Comparison was done in the scope of coderabbit AI code review tool, which sadly makes it practically irrelevant. My personal experience as a software engineer, and a former security researcher who did manual code audit, is that this code review tool has such poor results that it isn't worth the "noise" and friction it causes developers during C/I code review
Yeah I personally don’t understand the point of AI code review tools all that much, as AI is already generating the code as well. All of these AI code review tools create so much noise, yet don’t catch the really important things.
What really important things are human reviews catching in your org?
I just feel more and more like the effort invested in manual reviews is not worth it
Re: GPT-6 Astra in code review: Gains, privacy, and cost
#15Earlier quoted context omitted.
Yeah I personally don’t understand the point of AI code review tools all that much, as AI is already generating the code as well. All of these AI code review tools create so much noise, yet don’t catch the really important things.
What really important things are human reviews catching in your org? I just feel more and more like the effort invested in manual reviews is not worth it
1. Whether the thing should be done in the first place
2. If it's the correct solution on a high level
3. Whether it conflicts with or duplicates other parts of the system
4. Whether the comments are actually useful or restating the LLM chat
Also many others but these are the most common IME
Re: GPT-6 Astra in code review: Gains, privacy, and cost
#16From what I can tell, its shit.
Re: GPT-6 Astra in code review: Gains, privacy, and cost
#17Re: GPT-6 Astra in code review: Gains, privacy, and cost
#18Both OAI and Anthropic seem to have released a model that is slightly better but cost ~2x the previous iteration. Interesting play
That likely won’t change if other competitors don’t take the lead at some point. If companies are willing to pay top dollar for the best models AND they get to extract as much money from Chinese labs distilling Astra/Fable it makes no sense to lower prices. Obviously not great for everyday users who don’t have unlimited money.
Re: GPT-6 Astra in code review: Gains, privacy, and cost
#19Earlier quoted context omitted.
What really important things are human reviews catching in your org? I just feel more and more like the effort invested in manual reviews is not worth it
1. Whether the thing should be done in the first place 2. If it's the correct solution on a high level 3. Whether it conflicts with or duplicates other parts of the system 4. Whether the comments are actually useful or restating the LLM chat Also many others but these are the most common IME
All of these are angles an AI reviewer can test for as well, and will (IME) mostly catch mistakes correctly. I also still manually review code, and usually also catch issues, but the severity of what I find shrinks ever further as agents get better.
The sprawling code comments are becoming the most draining part of code review though, that's really killing me from the inside.
Re: GPT-6 Astra in code review: Gains, privacy, and cost
#20Comparison was done in the scope of coderabbit AI code review tool, which sadly makes it practically irrelevant. My personal experience as a software engineer, and a former security researcher who did manual code audit, is that this code review tool has such poor results that it isn't worth the "noise" and friction it causes developers during C/I code review
They do catch important things but it’s really contextual. You can’t grab a model slap it on top and say code review . Hence a dedicated review tool is almost dead . Code review should be part of your pipeline and consume test results from the original task , open spec etc . If you do not have that code review will not help if you do , what is the point of task rabbit just slap review against