GPT-6 Astra • Hacker News Board

Re: GPT-6 Astra

#281

Post by Planktonne » Thu, Sep 03, 2026, 8:32 PM UTC

I'm sure it's going to do great on all sorts of benchmarks, but the video--the actual marketing video that if anything is incentivised to overstate things--is full of careful cuts just before it would do anything that still wouldn't actually be that impressive.

It's AGI, and it's going to upload photos, or change a background slide colour. Even the people hyping it up, who believe that it's really artificial intelligence in every sense of the word, couldn't get it to do more than that.

This is farcical.

Re: GPT-6 Astra

#282

Post by intrasight » Thu, Sep 03, 2026, 8:32 PM UTC

intenex wrote: post #272

The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to the score it would receive with the responses API harness they used for GPT-6 Astra they'd have to do the same for the percentage…

It has to pass the Turing test

Re: GPT-6 Astra

#283

Post by mvkel » Thu, Sep 03, 2026, 8:32 PM UTC

The ARC-AGI-3 score is an incredible feat. It needed to effectively create a symbolic world model from scratch to solve the games.

If you've played the games firsthand, you know what an accomplishment this is. The "games" feel like a weird conduit to a lower level of your brain, where you move pieces to a specific place because it just "feels" right. For AI to nail it better than a human speaks to some magic happening underneath.

Looking forward to ARC-AGI-4,5,6 and slowly chipping away at the remaining problem sets.

Re: GPT-6 Astra

#284

Post by dmitrygr » Thu, Sep 03, 2026, 8:33 PM UTC

driverdan wrote: post #271

abixb wrote: post #247

I want to take a step back: So, this is GPT-6 -- the natural number version release comparable to GPT-4 and GPT-5 from the past few years. The ARC-AGI-3 score is obviously impressive at 99.9% (we'll need to wait for more details on how they used the response API harness on GPT-6 Astra, wrt reasoning retention and compaction), but every other benchmarks seems to be a relatively modest improvement, comparable with any…

> If this is truly AGI (subject to one's definition of AGI still) Scoring well in a benchmark that's called AGI does not make an LLM AGI.

Hey now! Keep your reason out of their marketin^H^H lies!

Re: GPT-6 Astra

#285

Post by sashank_1509 » Thu, Sep 03, 2026, 8:33 PM UTC

Benchmark wise 5% improvement over Sol in coding tasks and a 2-3% improvement over Fable 5.1 seems pretty disappointing, but maybe it is actually much better in real world usage. Let’s see

Re: GPT-6 Astra

#286

Post by seemaze » Thu, Sep 03, 2026, 8:33 PM UTC

rektomatic wrote: post #164

petilon wrote: post #146

This is wild: OpenAI is basically declaring that AGI is here. https://www.theverge.com/ai-artificial-intelligence/989601/o... “If we fast-forward a couple of years, and we look back and say, ‘When was it, really, that AGI was created?’ I think it’s going to be about this time, and I think it might be about this model,” OpenAI president Greg Brockman said during a Thursday press briefing. Later in the call, he added,…

Remember when the term "AGI" meant something? Pepperidge farm remembers

Remember when The Verge was not a pay-walled visual headache?

Re: GPT-6 Astra

#287

Post by the_duke » Thu, Sep 03, 2026, 8:34 PM UTC

Huge gains on some benchmarks, but for coding it sits barely above Fable

It will be interesting to see how it performs in the real world ...

Re: GPT-6 Astra

#288

Post by bananaflag » Thu, Sep 03, 2026, 8:34 PM UTC

Cu3PO42 wrote: post #58

Just two days ago, a preprint by Julia Stadlmann went up on arXiv [0] improving the prime gap from 246 to 240. Now OpenAI announces Astra has shown a gap of 186 [1]. That must really blow. [0] https://arxiv.org/abs/2608.31126 [1] https://cdn.openai.com/pdf/51126fac-1b68-4128-9666-c908bcc16...

Where did you get the link to the pdf? Was it announced somewhere?

Re: GPT-6 Astra

#289

Post by tripleee » Thu, Sep 03, 2026, 8:34 PM UTC

pixl97 wrote: post #75

kegs_ wrote: post #45

I guess this "limited set of organizations" is just the standard now. It's just incredibly deflating to see my future as a second class citizen has already come

This has always been the case for people that have not had piles of money. I mean do you get access to the best yachts? To the top of the 5 star hotels? To the best resorts? To the best military equipment? Hell, the best computer equipment has nearly always been out of reach of the average person.

I couldn't care less about owning a yacht.

On the other hand even a modest house, basic healthcare and ability to not work like a slave for scraps feels like it's going to be out of reach.

Re: GPT-6 Astra

#290

Post by mvkel » Thu, Sep 03, 2026, 8:34 PM UTC

intenex wrote: post #272

The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to the score it would receive with the responses API harness they used for GPT-6 Astra they'd have to do the same for the percentage…

Take it from the mouth of the creator of ARC-AGI:

When we released ARC 3, I got asked, "when do you think a frontier model will saturate it?", and I answered "in about a year, though it depends on how much it gets explicitly targeted"

That was 6 months ago, so the progress that Astra represents happened about 2x faster than I anticipated. I think the speed of progress will surprise a lot of people, and what the new models can do will challenge the views of AI that people developed by using prior generations of models.