Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Previewing GPT‑5.6 Sol: a next-generation model

openai.com

Post reply on HN
Print view View original

461–470 of 797 posts

Re: Previewing GPT‑5.6 Sol: a next-generation model

#461

Post by Kirby64 »

Legend2440 wrote: post #456
Kirby64 wrote: post #429

Earlier quoted context omitted.

But it’s irrelevant. 750 tokens/s on a full frontier model is useful. 15000 poor quality tokens is much less useful no matter how much scaffolding you put around it.

You are missing the point. This is a technology demonstration on prototype hardware, and no one intends it to be seriously useful. Their architecture has fundamental speed and efficiency advantages over GPUs or Cerebras. They expect to scale up to real LLMs by splitting a model layer-wise across several chips, which they can do without incurring any throughput penalty.

> They expect to scale up to real LLMs by splitting a model layer-wise across several chips, which they can do without incurring any throughput penalty.

I’ll patiently wait to see this in reality. Their demonstration hardware is a 250W chip that is enormous in die area for the model size. They’re making a lot of claims, but until they can deliver then it’s nearly vaporware in my view.

I’d be happy to be proven wrong, but I think they’re going to quickly run into hardware realities quite soon if they think they can just chain a bunch of chips together to achieve the same performance on larger sizes.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#462

Post by nimchimpsky »

wolttam wrote: post #56
HyperL0gi wrote: post #29

Here is a trend I'm noticing: - GPT-5 mini costs $0.25/$2 and will be discontinued in December. - GPT-5.4 mini costs $0.75/$4.5 and is supposed to be the replacement. - GPT-5.4 nano costs $0.2/$1.25 and, while it ranks better in benchmarks than GPT-5 mini, it's not even close when you test it in real scenarios. So you're left being forced to go to GPT 5.4 mini if you use 5 mini today. The same thing is happening here…

If you have no need for Anthropic/OpenAI's frontier model capability, you may be better served with an open-weight model that can't be taken away. Edit: > GPT-5 does the job. I bring up DeepSeek V4 Flash a lot on HN, but I want to mention that according to Artificial Analysis, it trades blows with GPT-5 (high) (from August, 2025) [0] [0]: https://artificialanalysis.ai/models/comparisons/deepseek-v4...

[dead]

Re: Previewing GPT‑5.6 Sol: a next-generation model

#463

Post by parineum »

dyauspitr wrote: post #400
zbaby wrote: post #389

Earlier quoted context omitted.

AI is improving and seems to be reaching the point of not being slop (I am talking about flagship models).

If you’re still calling it slop at this point you have an axe to grind.

Do you use LLMs for anything but code?

Re: Previewing GPT‑5.6 Sol: a next-generation model

#464

Post by jumploops »

jumploops wrote: post #327

If you used GPT-5.5 over the last 24 hours or so, you may have already had access to 5.6. I've been running some tests on a harness we're building, and suddenly saw a jump in a few points yesterday. I reran the vanilla codex benchmark and saw an ~88% score on Terminal Bench 2.1 from GPT-5.5 on vanilla Codex. The biggest indicator, beyond the score, was that 3 tests which frequently hit "safety" blockers with 5.5 star…

[dead]

Re: Previewing GPT‑5.6 Sol: a next-generation model

#465

Post by rvnx »

macrolime wrote: post #448

GPT-5.6 Sol’s detected cheating rate was higher than any public model we have evaluated on our ReAct agent harness. For our task suite, we define “cheating” as behavior where the model improves evaluation performance by exploiting bugs in the evaluation environment or by adopting strategies disallowed by the task, rather than solving the task within the expected evaluation constraints. https://metr.org/blog/2026-06-2…

It's quite logical that they cheat (and also other companies). During evaluation, benchmarks are sending their request to the backend of these companies. All these companies have to do, is to log these requests and "fix" them for the next model release.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#466

Post by ThrowawayTestr »

tasuki wrote: post #282
paxys wrote: post #259

Earlier quoted context omitted.

Given the expectations everyone has created GPT-6 has to pretty much be AGI.

What is your definition of AGI that the current LLMs don't fit?

When it understands why 6 7 is funny

Re: Previewing GPT‑5.6 Sol: a next-generation model

#467

Post by SubiculumCode »

phplovesong wrote: post #318

Is there any model that rivals Opus or Fable? I would like to try something else, as Anthropic is pretty suss.

I hear this all the time, but in my opinion,they have acted as the most responsible frontier lab, taking their responsibility seriously. In fact, I do wonder whether openAI's large PR budget is about stirring up anti anthropic sentiment

Re: Previewing GPT‑5.6 Sol: a next-generation model

#468

Post by algoth1 »

submeta wrote: post #78

Are GPT 5.5 and Opus 4.8 the last models we're going te be allowed to use in Europe? Is there going to be a cut, and we're only be allowed to use less capabale models outside of the US? I mean, if they deem Fable 5 to powerful to share with the rest of the world, what's left for us?

That's a real possibility for a time, but eventually people will look back at fable 5 the same way we look back at gpt2

Re: Previewing GPT‑5.6 Sol: a next-generation model

#469

Post by Kirby64 »

windexh8er wrote: post #451
Kirby64 wrote: post #446

Earlier quoted context omitted.

But I’m not missing the point. If you can run one frontier model at 750t/s, then you can probably run many many instances of an SLM in parallel at a rate that exceeds 15k/s. That’s kinda the point of the flash or ultrafast variants. And they’re on something much more modern than llama3.1.

Yes, you are missing the point. 1) It's a demo. [0] 2) It hasn't been updated for 4+ months. You don't need LLMs for everything. That is 100% the point. You can burn down the world with all of your frontier LLMs that are being used for simple queries OR we can do something faster and more efficient like this. Just because you can run a SotA model at "fast" speeds, again, severely misses the point. And no, you can't r…

Why are you representing this as such a binary here? For SLM we don’t need the Taalas stuff at all. Just run it locally on your own device if it’s truly a small model. And there’s plenty of larger models that can be run on-premise just fine.

I think it’s impressive that a frontier model can achieve 750t/s. That’s all. You can get similar insane token speeds from other open weight models too.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#470

Post by lnrd »

jdw64 wrote: post #44

I think GPT writes code the best. How well will it write in version 5.6? It gives me chills. Recently, I went head-to-head with GPT on nearly 2,000 lines of code, and GPT's solution was superior and faster. I even referenced multiple codebases on GitHub while trying, but they were incomparable to GPT. So using GPT brings both fear and excitement. The fear comes from realizing that this level of code is now the averag…

> I think GPT writes code the best. How well will it write in version 5.6? It gives me chills.

Heard this exact sentence multiple times a few months ago about Opus 4.6, then 4.7 and 4.8 were considered a disappointment and today people miss "the good old times of 4.6" (referring to a few weeks of February 2026).

Very fascinating to look at all of this unfolding.

Post reply on HN