Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5.5

openai.com

Post reply on HN
Print view View original

251–260 of 1001 posts

Re: GPT-5.5

#251

Post by henry2023 »

endymi0n wrote: post #103
tedsanders wrote: post #19

Just as a heads up, even though GPT-5.5 is releasing today, the rollout in ChatGPT and Codex will be gradual over many hours so that we can make sure service remains stable for everyone (same as our previous launches). You may not see it right away, and if you don't, try again later in the day. We usually start with Pro/Enterprise accounts and then work our way down to Plus. We know it's slightly annoying to have to…

Did you guys do anything about GPT‘s motivation? I tried to use GPT-5.4 API (at xhigh) for my OpenClaw after the Anthropic Oauthgate, but I just couldn‘t drag it to do its job. I had the most hilarious dialogues along the lines of „You stopped, X would have been next.“ - „Yeah, I‘m sorry, I failed. I should have done X next.“ - „Well, how about you just do it?“ - „Yep, I really should have done it now.“ - “Do X, righ…

I’m sorry for you but this is hilarious.

Re: GPT-5.5

#253

Post by foota »

ulimn wrote: post #219
energy123 wrote: post #186

Earlier quoted context omitted.

Look a cost per intelligence or cost per task instead of cost per token.

Isn't the outcome / solution for a given task non-deterministic? So can we reliably measure that?

Yes, sort of. Generally you can measure the pass rate on a benchmark given a fixed compute budget. A sufficiently smart model can hit a high pass rate with fewer tokens/compute. Check out the cost efficiency on https://artificialanalysis.ai/ (say this posted here the other day, pretty neat charts!)

Re: GPT-5.5

#254

Post by postalcoder »

deflator wrote: post #238
postalcoder wrote: post #234

Earlier quoted context omitted.

I made pelicans at different thinking efforts: https://hcker.news/pelican-low.svg https://hcker.news/pelican-medium.svg https://hcker.news/pelican-high.svg https://hcker.news/pelican-xhigh.svg Someone needs to make a pelican arena, I have no idea if these are considered good or not.

They are not good, and they seem to get worse as you increased effort. Weird

Yeah. I've always loosely correlated pelican quality with big model smell but I'm not picking that up here. I thought this was supposed to be spud? Weird indeed.

Re: GPT-5.5

#255

Post by wild_egg »

pantulis wrote: post #231
arjie wrote: post #135

Earlier quoted context omitted.

Get the actual prompt and have Claude Code / Codex try it out via curl / python requests. The full prompt will yield debugging information. You have to set a few parameters to make sure you get the full gpt-5 performance. e.g. if your reasoning budget too low, you get gpt-4 grade performance. IMHO you should just write your own harness so you have full visibility into it, but if you're just using vanilla OpenClaw you…

> IMHO you should just write your own harness Can you point to some online resources to achieve this? I'm not very sure where I'd begin with.

At the core, they're really very simple [1]. Run LLM API calls in a loop with some tools.

From there, you can get much fancier with any aspect of it that interests you. Here's one in Bash [2] that is fully extensible at runtime through dynamic discovery of plugins/hooks.

[1] https://ampcode.com/notes/how-to-build-an-agent

[2] https://github.com/wedow/harness

Re: GPT-5.5

#256

Post by XCSme »

6thbit wrote: post #176

Mythos 5.5 SWE-bench Pro 77.8%* 58.6% Terminal-bench-2.0 82.0% 82.7%* GPQA Diamond 94.6%* 93.6% H. Last Exam 56.8%* 41.4% H. Last Exam (tools) 64.7%* 52.2% BrowseComp 86.9% 84.4% (90.1% Pro)* OSWorld-Verified 79.6%* 78.7% Still far from Mythos on SWE-bench but quite comparable otherwise. Source for mythos values: https://www.anthropic.com/glasswing

They mentioned in their release page, that the Claude team noticed memorization of the SWE-bench test, so the test is actually in the training data.

Here: https://www.anthropic.com/news/claude-opus-4-7#:~:text=memor...

Re: GPT-5.5

#257

Post by Rapzid »

In Copilot where it's easy to switch models Opus 4.6 was still providing, IMHO, better stock results than GPT-5.4.

Particularly in areas outside straight coding tasks. So analysis, planning, etc. Better and more thorough output. Better use of formatting options(tables, diagrams, etc).

I'm hoping to see improvements in this area with 5.5.

Re: GPT-5.5

#258

Post by tech234a »

jfkimmes wrote: post #143
tnkuehne wrote: post #127

Earlier quoted context omitted.

isnt it like cyber question are being routed to dumper models at openai?

Do you have a source for that? Neither the release post, nor the model card seems to indicate anything like this?

I see it here https://developers.openai.com/codex/concepts/cyber-safety

Re: GPT-5.5

#259

Post by adammarples »

endymi0n wrote: post #103
tedsanders wrote: post #19

Just as a heads up, even though GPT-5.5 is releasing today, the rollout in ChatGPT and Codex will be gradual over many hours so that we can make sure service remains stable for everyone (same as our previous launches). You may not see it right away, and if you don't, try again later in the day. We usually start with Pro/Enterprise accounts and then work our way down to Plus. We know it's slightly annoying to have to…

Did you guys do anything about GPT‘s motivation? I tried to use GPT-5.4 API (at xhigh) for my OpenClaw after the Anthropic Oauthgate, but I just couldn‘t drag it to do its job. I had the most hilarious dialogues along the lines of „You stopped, X would have been next.“ - „Yeah, I‘m sorry, I failed. I should have done X next.“ - „Well, how about you just do it?“ - „Yep, I really should have done it now.“ - “Do X, righ…

Part of me actually loves that the hitchhiker's guide was right, and we have to argue with paranoid, depressed robots to get them to do their job, and that this is a very real part of life in 2026. It's so funny.

Re: GPT-5.5

#260

Post by butlike »

endymi0n wrote: post #103
tedsanders wrote: post #19

Just as a heads up, even though GPT-5.5 is releasing today, the rollout in ChatGPT and Codex will be gradual over many hours so that we can make sure service remains stable for everyone (same as our previous launches). You may not see it right away, and if you don't, try again later in the day. We usually start with Pro/Enterprise accounts and then work our way down to Plus. We know it's slightly annoying to have to…

Did you guys do anything about GPT‘s motivation? I tried to use GPT-5.4 API (at xhigh) for my OpenClaw after the Anthropic Oauthgate, but I just couldn‘t drag it to do its job. I had the most hilarious dialogues along the lines of „You stopped, X would have been next.“ - „Yeah, I‘m sorry, I failed. I should have done X next.“ - „Well, how about you just do it?“ - „Yep, I really should have done it now.“ - “Do X, righ…

This brings up an interesting philosophical point: say we get to AGI... who's to say it won't just be a super smart underachiever-type?

"Hey AGI, how's that cure for cancer coming?"

"Oh it's done just gotta...formalize it you know. Big rollout and all that..."

I would find it divinely funny if we "got there" with AGI and it was just a complete slacker. Hard to justify leaving it on, but too important to turn it off.

Post reply on HN