Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-6 Astra

openai.com

Post reply on HN
Print view View original

761–770 of 1001 posts

Re: GPT-6 Astra

#761

Post by serbuvlad »

zug_zug wrote: post #380
intenex wrote: post #247

The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to the score it would receive with the responses API harness they used for GPT-6 Astra they'd have to do the same for the percentage…

> I'd be curious to hear takes on what would make you think Astra is yet to be AGI, and what would still need to be achieved for this to effectively be AGI from this point forward. To me AGI is all about the "G" general (we already had the AI part). General meaning universal, everything. It's not a function of knowledge or specific hardcoded tests, it's that you could give it a test it's never heard of before and nev…

To me all this makes the label of AGI completely meaningless.

What AGI has always meant (eg. in 2019) is Artifical General Intelligence.

Artificial -- something made by humans instead of occurring naturally

General -- not confined by specialization or careful limitation

Intelligence -- the capacity to learn, reason, solve problems, think abstractly, and adapt to new situations

Basically, the metric was that any healthy adult human on the planet represents a general intelligence. This has certainly long been reached.

Also some of the stuff you're listing has long been solved as well, such as listing what it knows and what it doesn't know, and what information it would need. Other is just poorly defined: "be able to argue persuasively". AI can certainly write an argument on almost any topic that would pass any University homework in 2019.

Re: GPT-6 Astra

#762

Post by treefry »

kroaton wrote: post #295
dalemhurley wrote: post #283

OpenAI is killing it now that they are more focused. Killing projects like Sora et al have seen it go from irrelevant to level footing with Anthropic. Sol is so much better than Fable 5. Then we get Astra (yet to use it) few days after Fable 5.1 (which is very impressive). Codex is slightly better than Claude Code. Good on Sam Altman getting back to basics and turning OpenAI around.

I think it mostly shows that there is no moat and the only advantage the U.S companies have over the Chinese is more compute. Qwen Max, Kimi K3, GLM 5.3 are really close to Opus/Sol/Fable/Astra and they are open weights.

From my experience with complex coding tasks (AI infra), I don't think these open weight models are close.

Re: GPT-6 Astra

#763

Post by moomoo11 »

sensanaty wrote: post #540
manlymuppet wrote: post #395

I have nothing to say about the actual model, but unrelated--why do so many of these demos include people buying things autonomously? Even if I did trust an AI to get everything right, it's not like the AI can read my mind. If I was ordering food normally and without AI, I would want more control over the process--looking over the options, prices, thinking about what I really want. People don't know what they really…

Despite access to """"""AGI""""""" all the marketing teams at these companies can only dream up 2 things, buying plane tickets and online shopping autonomously. Sometimes they're feeling extra spicy and throw in sorting emails or something along those lines. I suspect it's because it's tailored towards VCs and other similar rich ghouls as a replacement for their overworked and underpaid secretaries

tarpit ideas

Re: GPT-6 Astra

#764

Post by wraptile »

manlymuppet wrote: post #395

I have nothing to say about the actual model, but unrelated--why do so many of these demos include people buying things autonomously? Even if I did trust an AI to get everything right, it's not like the AI can read my mind. If I was ordering food normally and without AI, I would want more control over the process--looking over the options, prices, thinking about what I really want. People don't know what they really…

I really wonder what the demo people are thinking as there are many great uses of LLMs in day-to-day lives but all we get is these 3 rehashed use cases. No wonder normal people think LLMs still can't do anything.

Re: GPT-6 Astra

#765

Post by jgilias »

intenex wrote: post #247

The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to the score it would receive with the responses API harness they used for GPT-6 Astra they'd have to do the same for the percentage…

I’m so tired of every model release being touted as AGI or similar. Since GPT-2.

Re: GPT-6 Astra

#766

Post by taurath »

XCSme wrote: post #332

It's fun, but every new model release makes me even less interested to create cool stuff. Like, what's the point, if the next AI can do it in 5 seconds?

I find it regularly incapable of doing the most basic things - maybe the idea is to think in terms of more detail?

It’s kind of like saying what’s the point of poetry when a dictionary exists

Re: GPT-6 Astra

#768

Post by xg15 »

intenex wrote: post #247

The ARC-AGI-3 scorecard is extremely misleading given that it clearly states itself that "with [the responses API] harness, we estimate Sol would score in the ballpark of ~30%." but it shows a score of 7.8% for GPT-5.6 Sol presumably since if they updated the percentage for GPT-5.6 Sol to the score it would receive with the responses API harness they used for GPT-6 Astra they'd have to do the same for the percentage…

Maybe I'm out of the loop, but wasn't AGI the full-on scifi version of AI, where the AI is a persistent, conscious entity? I don't see how task benchmark scores are relevant for that.

Re: GPT-6 Astra

#769

Post by tom2026hn »

tintor wrote: post #77

ARC AGI-3 saturated by Astra! https://arcprize.org/leaderboard

AGI means that the answers to these benchmarks are now accessible, and the defense capabilities of the testing organizations are now negligible.

Re: GPT-6 Astra

#770

Post by JacobAsmuth »

sensanaty wrote: post #540
manlymuppet wrote: post #395

I have nothing to say about the actual model, but unrelated--why do so many of these demos include people buying things autonomously? Even if I did trust an AI to get everything right, it's not like the AI can read my mind. If I was ordering food normally and without AI, I would want more control over the process--looking over the options, prices, thinking about what I really want. People don't know what they really…

Despite access to """"""AGI""""""" all the marketing teams at these companies can only dream up 2 things, buying plane tickets and online shopping autonomously. Sometimes they're feeling extra spicy and throw in sorting emails or something along those lines. I suspect it's because it's tailored towards VCs and other similar rich ghouls as a replacement for their overworked and underpaid secretaries

All those stupid Bell Labs researchers not inventing Uber or Tinder. How come they didn't just build the obviously popular and profitable businesses that became possible once they invented the internet?
Post reply on HN