GPT-6 Astra • Hacker News Board

Re: GPT-6 Astra

#751

Post by skue » Fri, Sep 04, 2026, 2:43 AM UTC

dingdong2026 wrote: post #538

intenex wrote: post #272

The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to the score it would receive with the responses API harness they used for GPT-6 Astra they'd have to do the same for the percentage…

Only someone who doesn't do any work of any meaningful difficulty could think these models have anything to do with AGI. Today I spent half a day trying to solve a moderately interesting software engineering problem. I was switching between GPT-5.6 Sol and Fable 5.1 to check each other's work in Cursor. And the result was gradually driving me insane. As the models struggled to find a solution that would actually work…

But that happens with humans as well. You are having the same experience with an AI that many managers have with their direct reports.

The smarter AI gets, the easier it becomes to move the AGI goalposts. Seems at this point there are people who will refuse to call anything less than omniintelligence AGI.

(And then the excuse will be, but it’s not omniscient! And even if it were, is it omnipotent?)

Re: GPT-6 Astra

#752

Post by weird-eye-issue » Fri, Sep 04, 2026, 2:43 AM UTC

jumploops wrote: post #544

I think the thing I'm most excited about is the increase in _user prompting_. If I give a poorly constrained/ambiguous prompt, I don't want the model one-shotting assumptions left and right. The demos of Fable/GPT-6 are impressive, but "real AGI" should act more like a collaborator than either a peon or overachiever. It's a tough balance to get right, and although this has been possible to achieve with additional pro…

Fable does a great job from my terrible prompts when coding

Re: GPT-6 Astra

#753

Post by tintor » Fri, Sep 04, 2026, 2:44 AM UTC

quyleanh wrote: post #697

> We also tested Astra on SRE-Bench [15], a benchmark that measures whether models can reverse engineer software binaries to understand its core logic without access to raw source code. Astra solved 88.0% of tasks in a single attempt and 99.2% within four attempts, compared with 55.9% and 68.7% for GPT‑5.6 Sol, respectively. So the closed source application should open its source in near future? [15] https://arxiv.or…

Not if OpenAI considers reverse engineering an offensive cybersecurity skill.

Re: GPT-6 Astra

#754

Post by throwatdem12311 » Fri, Sep 04, 2026, 2:45 AM UTC

gavinray wrote: post #388

XCSme wrote: post #368

It's fun, but every new model release makes me even less interested to create cool stuff. Like, what's the point, if the next AI can do it in 5 seconds?

> Like, what's the point, if the next AI can do it in 5 seconds? Live a life doing whatever makes you happy. Post-work society is an inevitability if we don't destroy our planet.

> Post-work society is an inevitability

Ah yes because these AI companies are just gonna give away the models for free that I use with my free computer and free smartphone while I eat with my free food in my free apartment.

Re: GPT-6 Astra

#755

Post by wonnage » Fri, Sep 04, 2026, 2:45 AM UTC

sensanaty wrote: post #614

manlymuppet wrote: post #444

I have nothing to say about the actual model, but unrelated--why do so many of these demos include people buying things autonomously? Even if I did trust an AI to get everything right, it's not like the AI can read my mind. If I was ordering food normally and without AI, I would want more control over the process--looking over the options, prices, thinking about what I really want. People don't know what they really…

Despite access to """"""AGI""""""" all the marketing teams at these companies can only dream up 2 things, buying plane tickets and online shopping autonomously. Sometimes they're feeling extra spicy and throw in sorting emails or something along those lines. I suspect it's because it's tailored towards VCs and other similar rich ghouls as a replacement for their overworked and underpaid secretaries

Don’t forget making podcasts and telling you what to bake with your kids

Re: GPT-6 Astra

#756

Post by jpgvm » Fri, Sep 04, 2026, 2:46 AM UTC

zachthewf wrote: post #457

dalemhurley wrote: post #312

OpenAI is killing it now that they are more focused. Killing projects like Sora et al have seen it go from irrelevant to level footing with Anthropic. Sol is so much better than Fable 5. Then we get Astra (yet to use it) few days after Fable 5.1 (which is very impressive). Codex is slightly better than Claude Code. Good on Sam Altman getting back to basics and turning OpenAI around.

I’ve found Sol performance to be incredibly spiky. It has tremendous IQ and can fix very difficult bugs. But it is horrible at design (both visual and system design), anything that involves thinking about users or UX, and massively overcomplicates almost all work.

I vastly prefer Sol. It does what I tell it to almost exactly, pretty much every time.

I work on very low level stuff (think RTL/FPGA, firmware, software where optimising for nanoseconds is just normal).

For me Sol is the only cost effective model available. Fable 5.1 is indeed good and vastly better than original Fable (which refused to work on most of my stuff for 'safety' reasons).

It's very good at this sort of low level stuff to the point that I really can't understand/relate to people having a good time with Opus (which comparatively performs extremely poorly on my particular workload).

I also just don't like how lazy Anthropic models are. They will do 10% of what is asked and then summarily declare victory.

Sol on the other hand is more like "one of us", slight touch of the 'tism, extremely pedantic, will go to the edge of the known universe if that is what it takes to prove/fix/build what you asked for or run out out of credits trying.

It's a personal and workload dependent thing. For me right now Sol for 99% of stuff because Fable 5.1 still burns through $5k in credits a day.

Re: GPT-6 Astra

#757

Post by elzbardico » Fri, Sep 04, 2026, 2:52 AM UTC

And meanwhile, another wrapper layer is being embraced. Why would a vibecoder use Lovable when he got Sites right from ChatGPT?

Re: GPT-6 Astra

#758

Post by bitexploder » Fri, Sep 04, 2026, 2:52 AM UTC

andxor wrote: post #541

dalemhurley wrote: post #312

OpenAI is killing it now that they are more focused. Killing projects like Sora et al have seen it go from irrelevant to level footing with Anthropic. Sol is so much better than Fable 5. Then we get Astra (yet to use it) few days after Fable 5.1 (which is very impressive). Codex is slightly better than Claude Code. Good on Sam Altman getting back to basics and turning OpenAI around.

> Sol is so much better than Fable 5 I'm genuinely so confused when people say this with a straight face. Are you talking about coding? Desktop use? Prose? Or something else? Sol is a much smaller models and it shows. It often misses the forest for the trees.

I feel like a lot happened this week and people are glazing how ridiculously strong Flash 3.8 is right now compared to Fable/Opus/Sol/Astra.

Re: GPT-6 Astra

#759

Post by bitexploder » Fri, Sep 04, 2026, 2:53 AM UTC

fnordpiglet wrote: post #611

dalemhurley wrote: post #312

OpenAI is killing it now that they are more focused. Killing projects like Sora et al have seen it go from irrelevant to level footing with Anthropic. Sol is so much better than Fable 5. Then we get Astra (yet to use it) few days after Fable 5.1 (which is very impressive). Codex is slightly better than Claude Code. Good on Sam Altman getting back to basics and turning OpenAI around.

Codex is missing a few things that Claude code has had for some time like defined plugin subagents and a few other things. But overall it’s fairly capable. The biggest gripe I have is that codex really restricts context window sizes and compaction leads to a lot of grounding work, and overall codex GPT is too literal in many situations - it’s follows direction slavishly, and when subagent reviewers are used, they ten…

Opus 5 is a genuinely infuriating model. I hate it’s behavior.

Re: GPT-6 Astra

#760

Post by Forgeties79 » Fri, Sep 04, 2026, 2:58 AM UTC

giancarlostoro wrote: post #343

mvkel wrote: post #290

Earlier quoted context omitted.

Take it from the mouth of the creator of ARC-AGI: When we released ARC 3, I got asked, "when do you think a frontier model will saturate it?", and I answered "in about a year, though it depends on how much it gets explicitly targeted" That was 6 months ago, so the progress that Astra represents happened about 2x faster than I anticipated. I think the speed of progress will surprise a lot of people, and what the new m…

I feel like AGI's definition got watered down, and these tests do not cover the original definition, what is your definition and thoughts on aligning with what all of us understood from the original claim? I feel like this test is just helping someone like Sam Altman pretend like he implemented AGI as originally pitched for an IPO when in fact, he has not. Shameful. > AGI is essentially the equivalent of a median hum…

> I feel like AGI's definition got watered down

Typical result of venture capital and too many bag holders unfortunately.