I guess this "limited set of organizations" is just the standard now. It's just incredibly deflating to see my future as a second class citizen has already come
Same. Fortunately DeepSeek keeps getting better.
GPT-6 Astra
231–240 of 1001 posts
Re: GPT-6 Astra
#232Played the racing game but that was a pretty poor experience. Would have expected more specifically if it's shared on their release page.
Re: GPT-6 Astra
#233The ARC-AGI-3 score is ridiculously high. Is this benchmaxxing or something way different? It's really hard to discern how we're approaching breakthroughs...
They explain why here: https://openai.com/index/how-two-settings-tripled-our-arc-ag... TL;DR all the other models are being crippled by limitations of their harness. >First, we noticed that after each game action, all private reasoning was discarded. This meant that with each action, GPT‑5.6 Sol was asked to figure out the game anew, unable to remember its past thinking. The model could still see a record of past mov…
Exactly what I suspected. Of course a machine can just iterate relentlessly the way a human can't.
I guess token counts are somewhat of a metric.
IMO intelligence has peaked and all future gains will come from faster tps and more iteration.
Re: GPT-6 Astra
#234> We have found that GPT-6 Astra is more capable of controlling its own CoT than GPT 5.6-Sol, and less likely to include incriminating information in its CoT. In adversarial settings (where we push the model to evade our monitors) we find that the model is able to remain undetected when strategically underperforming in evaluations (sandbagging) and can sometimes evade our internal monitors when asked to perform certa…
I really wish it was called chain of instruction. Because it's definitely not thought.
What is thought?
Re: GPT-6 Astra
#235Artificial analysis blog
https://artificialanalysis.ai/articles/benchmarking-gpt-6-as...
Re: GPT-6 Astra
#236What does 'Astra' here mean? Surely they must be referring to the Latin word. Because in another dead language of antiquity, Sanskrit, it means "weapon". Which would be a bit too on-the-nose.
It's clearly an extension of the previous naming: Luna, terra, sol
Re: GPT-6 Astra
#237This is wild: OpenAI is basically declaring that AGI is here. https://www.theverge.com/ai-artificial-intelligence/989601/o... “If we fast-forward a couple of years, and we look back and say, ‘When was it, really, that AGI was created?’ I think it’s going to be about this time, and I think it might be about this model,” OpenAI president Greg Brockman said during a Thursday press briefing. Later in the call, he added,…
Remember when the term "AGI" meant something? Pepperidge farm remembers
Remember when “Pepperidge farm remembers” meant something?
Re: GPT-6 Astra
#238Minor nitpick, but the handling in the Kart Racer game is terrible. It feels more like nudging than turning.
Re: GPT-6 Astra
#239> We have found that GPT-6 Astra is more capable of controlling its own CoT than GPT 5.6-Sol, and less likely to include incriminating information in its CoT. In adversarial settings (where we push the model to evade our monitors) we find that the model is able to remain undetected when strategically underperforming in evaluations (sandbagging) and can sometimes evade our internal monitors when asked to perform certa…
"OpenAI is pleased to announce our new model scores 85% on CreateTormentNexusBench - a >60% lead over our leading competitors!" Did someone get their "AI safety no-no list" and "Frontier features bingo card" mixed up, or did they just stop being able to tell the difference?
You joke, but a bunch of people here actually want that.
Re: GPT-6 Astra
#240I remember when GPT-4 came out and the perceived performance upgrade seemed underwhelming for a major release compared to 3.5, especially how there were graphics going around showing the parameter size dwarfing the last model before it came out. It looked like we were past the perceivable differences from release to release that were immediately identifiable. Now the jump between 5 to 5.5 and 5.6 alone has changed how a lot of people approach AI, including me. Interested to see where it goes with 6.