Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5.6

openai.com

Post reply on HN
Print view View original

591–600 of 1001 posts

Re: GPT-5.6

#591

Post by alex0015 »

cmrdporcupine wrote: post #385
revolvingthrow wrote: post #376

Benchmarks look really promising. Suspiciously good, even. I guess we’ll see soon enough. My question to previewers: how are the guardrails for random joe that wasn’t personally blessed by the ai pope to access the non-nerfed model? Fable is a nightmare in this regard, but I’m not sure whether 5.6 also gets a critical side-eye from the gubmint when you ask it to fix bugs in your code (you filthy hacker, you).

I almost immediately ran into "This request requires additional safety checks, which can take extra time. Hang tight or retry with a faster model for a quicker response, though it may be less capable of handling complex requests." Which is something I've never seen with codex before, and I wasn't doing anything funky. Just writing CUDA kernels and benchmarks for them.

I was getting that regularly last week with regular 5.5 medium on the plus plan. I was doing benchmarking for a photo editor in Swift.

Re: GPT-5.6

#592

Post by dmitriy_ko »

10xDev wrote: post #234
meetpateltech wrote: post #154

GPT-5.6 Sol sets a new SOTA on ARC-AGI-3: 7.8% Sol is the first verified frontier model to ever beat an ARC-AGI-3 game https://arcprize.org/results/openai-gpt-5-6

Seeing the dramatic differences in scores just going from high to xhigh is just another demonstration of the bitter lesson: Just keep scaling search and learning. We are probably going to need a lot more GPUs.

And a lot more electricity to power them.

Re: GPT-5.6

#593

Post by rpdillon »

217 wrote: post #72
Syntaf wrote: post #6

Ok long time Claude Code user here; lately I've started to realize there's other great models out there I should be trying, but I'm hesitant to leave Claude Code behind for something new. What's the consensus today on codex vs claude code, does it really matter anymore?

Consensus itself does NOT matter, omp is objectively the best harness for power users yet it has 0 hn posts about it, zero. You're fully free to use and try anything and without caring about what others think is right

omp is amazing. Daily driver for me.

Re: GPT-5.6

#594

Post by guybedo »

it seems terra is pretty much useless, you either want luna max for everyday coding (cheaper and same perf as 5.5 high), or sol xhigh/max for demanding tasks

Re: GPT-5.6

#595

Post by typon »

vatsachak wrote: post #247
osti wrote: post #226

Earlier quoted context omitted.

Mythos probably wouldn't, otherwise they'd have included it in their release. Next version of Mythos probably will though. And yeah.. Reality has not been kind to LeCun.

Are you joking? They spend billions of dollars training LLMs to get a 7.8% on arc agi 3 whereas DINO models are near sota in image classification, provide meaningful embeddings to the point where image segmentation is just PCA. The spend on DINO cannot be more than five million (correct me if I'm wrong) JEPA is just getting started

DinoV3 paper: https://arxiv.org/pdf/2508.10104#page=36

"we use a rough estimate of a total 9M GPU hours"

From CoreWeave, at current prices (~$2.46/hr spot to ~$6.16/hr on demand) would correspond to $22M–$55M.

The dataset is really where the cost is though - they used LVD-1689M - 1.6B images of curated web data from roughly 17B instagram images. This probably cost a huge amount of hours in human annotation, compute for algorithmic filtering, etc and not to mention probably a 20-50 person team working on this model.

You might want to change assumptions about how expensive these models are.

Re: GPT-5.6

#596

Post by beaker52 »

We Openly hate OpenAI because they’re not very Open but we secretly hope they win against not-open-at-all Anthropic.

Re: GPT-5.6

#597

Post by XCSme »

GPT-5.6 is a really good model, and quite cheap. I can finally replace GPT-5.3-Codex for my Tool Calling in n8n.

Here's my benchmark results for GPT-5.6:

https://aibenchy.com/?q=gpt-5.6

(the high reasoning variants are still running, uploading them soon too)

EDIT: The high variants are there too, enjoy the hamsters[0].

[0]: https://aibenchy.com/showcase/?q=gpt-5.6

Re: GPT-5.6

#598

Post by wrs »

ravenstine wrote: post #94
minimaxir wrote: post #26

The developer's guide ( https://developers.openai.com/api/docs/guides/latest-model ) has some interesting semantic tips for using the model: > Intent understanding: GPT-5.6 can better infer the user’s underlying goal and intended level of work without you specifying every step. Continue to state important constraints, approval boundaries, and success criteria explicitly. > Original image detail: GPT-5.6 preserves the…

> Avoid generic brevity instructions That part is confusing because it's not like they provide an example of how default GPT-5.6 output compares with GPT-5.5 both with default output and prompted for brevity. Whenever I use such prompts, it's usually because I want the model to give me the gist in a few sentences. I'd be stunned if GPT-5.6 was that concise by default. I would think that could "break" a lot of things…

> could "break" a lot of things for developers who didn't know to make prompt changes after upgrading to 5.6.

How does this differ from the other changes in behavior in 5.6 that will also break things? New models always break things.

Re: GPT-5.6

#599

Post by gorgmah »

HarHarVeryFunny wrote: post #559
gorgmah wrote: post #536

Earlier quoted context omitted.

I live in fear lol. More seriously, I was blindly trusting the auto-classifier from claude code (same as the middle option when you do `/permissions` in codex), and it actually allowed the agent to do pretty hardcore `rm` and `git push --force-with-lease` commands, which I would have expected to have to approve manually. Luckily no major issue from those yet. The best option imo is the integrated cloud environments f…

Interesting - I'd never heard of this Claude Code VM option. Does it auto install all the dev/test tools it needs, maybe including things like web server & browser? Does your code live in the VM, or in some external repository? Is the lifetime of the VM the same as the agent, or does it persist until you remove it? Where can I find documentation on this?

I use it for basic web stuff so haven't pushed it to the limit, but they have tons of stuff you can configure (up to self-hosting your environments): https://platform.claude.com/docs/en/managed-agents/environme...

Re: GPT-5.6

#600

Post by William_BB »

aroman wrote: post #492
ryan_n wrote: post #474

Earlier quoted context omitted.

Genuine question/not a critique-are you actually reviewing all that code or just sending it and hoping for the best? I just can't imagine someone is reading/reviewing that much code every day, but maybe I'm wrong?

Like before AI, the scrutiny varies with the sensitivity of the area being edited. Simple UI change? I do an AI review, but otherwise neither read nor write the code. The models are good enough they write better UI code than me, 9 out of 10 times. Not always the more idiomatic, but usually safer and more correct. Change to our core data plane? I might spend 2-3 times more effort reviewing it than before AI. Yes, I go…

> AI is also scarily good at writing tests

:-) I hope you read those tests before claiming it's "scary good"

Post reply on HN