Artificial analysis blog
https://artificialanalysis.ai/articles/benchmarking-gpt-6-as...
GPT-6 Astra
241–250 of 1001 posts
Re: GPT-6 Astra
#242What does 'Astra' here mean? Surely they must be referring to the Latin word. Because in another dead language of antiquity, Sanskrit, it means "weapon". Which would be a bit too on-the-nose.
It's clearly an extension of the previous naming: Luna, terra, sol
Re: GPT-6 Astra
#243This is wild: OpenAI is basically declaring that AGI is here. https://www.theverge.com/ai-artificial-intelligence/989601/o... “If we fast-forward a couple of years, and we look back and say, ‘When was it, really, that AGI was created?’ I think it’s going to be about this time, and I think it might be about this model,” OpenAI president Greg Brockman said during a Thursday press briefing. Later in the call, he added,…
Remember when the term "AGI" meant something? Pepperidge farm remembers
Remember when “Pepperidge farm remembers” meant something?
Re: GPT-6 Astra
#244Minor nitpick, but the handling in the Kart Racer game is terrible. It feels more like nudging than turning.
Re: GPT-6 Astra
#245> We have found that GPT-6 Astra is more capable of controlling its own CoT than GPT 5.6-Sol, and less likely to include incriminating information in its CoT. In adversarial settings (where we push the model to evade our monitors) we find that the model is able to remain undetected when strategically underperforming in evaluations (sandbagging) and can sometimes evade our internal monitors when asked to perform certa…
"OpenAI is pleased to announce our new model scores 85% on CreateTormentNexusBench - a >60% lead over our leading competitors!" Did someone get their "AI safety no-no list" and "Frontier features bingo card" mixed up, or did they just stop being able to tell the difference?
You joke, but a bunch of people here actually want that.
Re: GPT-6 Astra
#246Earlier quoted context omitted.
Idk, this means the benchmark has bigger problems ... no way Astra will be worse than Opus 5 Only thing I would trust is the what X/Twitter crowds are saying about a model after 2-3 weeks of its launch. But before that I would already tried the model and have my own conclusion.
Also note that Opus 5 (High) has an index value of 62, vs Fable 5 (Max) has 61. So some strangeness going on with that index.
Opus 5 just feels strange - IMO it's benchmaxxed in the worst way... it might be good at agentic tasks but leaves a sour aftertaste doing anything else.
Re: GPT-6 Astra
#247I remember when GPT-4 came out and the perceived performance upgrade seemed underwhelming for a major release compared to 3.5, especially how there were graphics going around showing the parameter size dwarfing the last model before it came out. It looked like we were past the perceivable differences from release to release that were immediately identifiable. Now the jump between 5 to 5.5 and 5.6 alone has changed how a lot of people approach AI, including me. Interested to see where it goes with 6.
Re: GPT-6 Astra
#248https://youtu.be/1QNsdr-Qx_I?si=coXwStCl7clpGVC1 Launch video
I enjoyed it! for a big corporation, that's a well-executed video
Re: GPT-6 Astra
#249Just two days ago, a preprint by Julia Stadlmann went up on arXiv [0] improving the prime gap from 246 to 240. Now OpenAI announces Astra has shown a gap of 186 [1]. That must really blow. [0] https://arxiv.org/abs/2608.31126 [1] https://cdn.openai.com/pdf/51126fac-1b68-4128-9666-c908bcc16...
Happened to multiple people I know.
Re: GPT-6 Astra
#250I'm going to call it. By 2030 all software is done and complete. But we are going to have more and new jobs.
'all' software? aircraft flight control systems? infant heart monitors? drug manufacturing dose calibration controllers?