The FrontierCode 1.1 Extended benchmark is the only benchmark that aligns with my actual LLM experiences and Astra isn't significantly better or cheaper. All this celebration, and yet it's only on-par with an already existing model? I don't get it.
GPT-6 Astra
251–260 of 1001 posts
Re: GPT-6 Astra
#252Argh! I hit a wrong keyboard shortcut and moved the entire thread. Please stand by... it will all come back shortly
500 upvotes with 2 comments would have been a new record. ;)
Re: GPT-6 Astra
#253This is wild: OpenAI is basically declaring that AGI is here. https://www.theverge.com/ai-artificial-intelligence/989601/o... “If we fast-forward a couple of years, and we look back and say, ‘When was it, really, that AGI was created?’ I think it’s going to be about this time, and I think it might be about this model,” OpenAI president Greg Brockman said during a Thursday press briefing. Later in the call, he added,…
Why does he say what he feels? Is that how leading figures in the space define AGI - a gut feeling? What are the usual definitions and how can we test for it? Is there something like a Turing test for AGI?
The “I” alone is already not well-defined. That’s why.
Re: GPT-6 Astra
#254I hope they don't `fable` it and block people from doing they daily jobs with it, by introducing huge amounts of restrictions that are not really needed.
Re: GPT-6 Astra
#255I wonder how they were able to get it to get 99.9% on ARC-AGI-3. That seems truly insane.
Re: GPT-6 Astra
#256Argh! I hit a wrong keyboard shortcut and moved the entire thread. Please stand by... it will all come back shortly
500 upvotes with 2 comments would have been a new record. ;)
https://news.ycombinator.com/item?id=49555647 was the one I meant to move, but I did the inverse and moved everything else.
All fixed now.
Re: GPT-6 Astra
#257[deleted]
Re: GPT-6 Astra
#258I decided to front run and added support for it in Dirac (coding agent) a couple of hours ago, using best guess pricing: input/output/cache: $10/$50/$1.
Re: GPT-6 Astra
#259Argh! I hit a wrong keyboard shortcut and moved the entire thread. Please stand by... it will all come back shortly
Luckily there’s a standard keyboard shortcut for “undo” as well. ;)
Re: GPT-6 Astra
#260[dead]