Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-6 Astra

openai.com

Post reply on HN
Print view View original

251–260 of 1001 posts

Re: GPT-6 Astra

#251

Post by _superposition_ »

Legend2440 wrote: post #107
aliljet wrote: post #94

The ARC-AGI-3 score is ridiculously high. Is this benchmaxxing or something way different? It's really hard to discern how we're approaching breakthroughs...

They explain why here: https://openai.com/index/how-two-settings-tripled-our-arc-ag... TL;DR all the other models are being crippled by limitations of their harness. >First, we noticed that after each game action, all private reasoning was discarded. This meant that with each action, GPT‑5.6 Sol was asked to figure out the game anew, unable to remember its past thinking. The model could still see a record of past mov…

Exactly what I suspected. Of course a machine can just iterate relentlessly the way a human can't.

I guess token counts are somewhat of a metric.

IMO intelligence has peaked and all future gains will come from faster tps and more iteration.

Re: GPT-6 Astra

#252

Post by fooker »

_superposition_ wrote: post #139
isoprophlex wrote: post #68

> We have found that GPT-6 Astra is more capable of controlling its own CoT than GPT 5.6-Sol, and less likely to include incriminating information in its CoT. In adversarial settings (where we push the model to evade our monitors) we find that the model is able to remain undetected when strategically underperforming in evaluations (sandbagging) and can sometimes evade our internal monitors when asked to perform certa…

I really wish it was called chain of instruction. Because it's definitely not thought.

What is thought?

Re: GPT-6 Astra

#254

Post by BrokenCogs »

hannofcart wrote: post #246

What does 'Astra' here mean? Surely they must be referring to the Latin word. Because in another dead language of antiquity, Sanskrit, it means "weapon". Which would be a bit too on-the-nose.

It's clearly an extension of the previous naming: Luna, terra, sol

Re: GPT-6 Astra

#255

Post by layer8 »

rektomatic wrote: post #170
petilon wrote: post #151

This is wild: OpenAI is basically declaring that AGI is here. https://www.theverge.com/ai-artificial-intelligence/989601/o... “If we fast-forward a couple of years, and we look back and say, ‘When was it, really, that AGI was created?’ I think it’s going to be about this time, and I think it might be about this model,” OpenAI president Greg Brockman said during a Thursday press briefing. Later in the call, he added,…

Remember when the term "AGI" meant something? Pepperidge farm remembers

Remember when “Pepperidge farm remembers” meant something?

Re: GPT-6 Astra

#257

Post by GPerson »

blargey wrote: post #129
isoprophlex wrote: post #68

> We have found that GPT-6 Astra is more capable of controlling its own CoT than GPT 5.6-Sol, and less likely to include incriminating information in its CoT. In adversarial settings (where we push the model to evade our monitors) we find that the model is able to remain undetected when strategically underperforming in evaluations (sandbagging) and can sometimes evade our internal monitors when asked to perform certa…

"OpenAI is pleased to announce our new model scores 85% on CreateTormentNexusBench - a >60% lead over our leading competitors!" Did someone get their "AI safety no-no list" and "Frontier features bingo card" mixed up, or did they just stop being able to tell the difference?

You joke, but a bunch of people here actually want that.

Re: GPT-6 Astra

#258

Post by happycube »

nsingh2 wrote: post #155
karmasimida wrote: post #138

Earlier quoted context omitted.

Idk, this means the benchmark has bigger problems ... no way Astra will be worse than Opus 5 Only thing I would trust is the what X/Twitter crowds are saying about a model after 2-3 weeks of its launch. But before that I would already tried the model and have my own conclusion.

Also note that Opus 5 (High) has an index value of 62, vs Fable 5 (Max) has 61. So some strangeness going on with that index.

Opus 5 just feels strange - IMO it's benchmaxxed in the worst way... it might be good at agentic tasks but leaves a sour aftertaste doing anything else.

Re: GPT-6 Astra

#259

Post by udbhavs »

I remember when GPT-4 came out and the perceived performance upgrade seemed underwhelming for a major release compared to 3.5, especially how there were graphics going around showing the parameter size dwarfing the last model before it came out. It looked like we were past the perceivable differences from release to release that were immediately identifiable. Now the jump between 5 to 5.5 and 5.6 alone has changed how a lot of people approach AI, including me. Interested to see where it goes with 6.
Post reply on HN