Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Previewing GPT‑5.6 Sol: a next-generation model

openai.com

Post reply on HN
Print view View original

351–360 of 797 posts

Re: Previewing GPT‑5.6 Sol: a next-generation model

#351

Post by baddash »

seviu wrote: post #77
jdw64 wrote: post #44

I think GPT writes code the best. How well will it write in version 5.6? It gives me chills. Recently, I went head-to-head with GPT on nearly 2,000 lines of code, and GPT's solution was superior and faster. I even referenced multiple codebases on GitHub while trying, but they were incomparable to GPT. So using GPT brings both fear and excitement. The fear comes from realizing that this level of code is now the averag…

I am on the opposite camp. Open models are starting to perform better. GPT 5.5 keeps on messing things up. On the contrary, pi + glm + DeepSeek… bliss. Fable was a different kind of beast though. Rip.

how much does your setup cost you? just curious

Re: Previewing GPT‑5.6 Sol: a next-generation model

#352

Post by kalstone »

donquichotte wrote: post #286
gandreani wrote: post #177

Easily the most interesting part of this announcement is buried in the second to last paragraph: "We're also launching GPT‑5.6 Sol on Cerebras at up to 750 tokens per second in July, bringing frontier intelligence to customers at unprecedented speed. Access will initially be limited to select customers as we expand capacity." 750 tokens/s on a frontier model is going to be extremely interesting. I doubt this new vers…

> I can think of the tedious task of finding certain functionality within a codebase. I usually can't beat an AI agent harness at this task today. Yup, I remember "racing" the AIs to figure things out in codebases just a year ago. Today, I have no chance. Whether it is due to degraded reasoning capabilities on my part or better models, I don't know.

AI is always going to be able to write a grep statement faster and more accurately than a human

Re: Previewing GPT‑5.6 Sol: a next-generation model

#353

Post by [deleted] »

brookst wrote: post #308
JohnRoseDev wrote: post #256

I can’t help but think that these benchmarks are completely fake. Sam even posted a benchmark on X a couple days ago of how the ‘complete version’ of 5.5 cyber was already ahead of Mythos apparently. This just feels like absolutely fake nonsense. The impact of Mythos on the industry was clear and in front of everyone’s eyes. The amount of vulnerabilities Mozilla fixed. The vulnerabilities and exploits Anthropic showc…

Well if they are posting fraudulent benchmarks, that's a good sign to invest in their IPO. It's pure downside protection: IPO does well, profit. IPO does poorly, concrete evidence of pre-IPO fraud. I personally don't think it's likely that OpenAI would post completely fake numbers in this pre-IPO period, but if you do, this is an opportunity.

[deleted]

Re: Previewing GPT‑5.6 Sol: a next-generation model

#354

Post by fragmede »

comboy wrote: post #324
sberens wrote: post #185

Earlier quoted context omitted.

For comparison, openrouter says opus 4.8 is ~55 tokens/s and fast mode is ~102. 750 tokens/s for their largest model is going to be nuts

But it seems that there is some queuing/load balancing on their side, I mean when opus is actually outputting this 55t/s it feles fast, but apart from it's internal reasoning I think there's sometimes just waiting.

Oh wait yeah good point. At 750 tokens a second and the same amount of human patients they can set it to think for the same amount of time but four or five times the amount of thinking tokens, which may improve the quality of the eventual output.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#355

Post by taneq »

beering wrote: post #339
small_model wrote: post #291

Earlier quoted context omitted.

Used it, very fast but tiny context window and doesn't have good reasoning. (good for quick simple code changes)

Agreed, 1000tok/s just fills up the context window (which is big by 2004 standards) super fast. But seems like 5.3-spark was just a taste of what’s to come.

2004 standards? O.o

Re: Previewing GPT‑5.6 Sol: a next-generation model

#356

Post by aaroninsf »

baq wrote: post #182
seviu wrote: post #77

Earlier quoted context omitted.

I am on the opposite camp. Open models are starting to perform better. GPT 5.5 keeps on messing things up. On the contrary, pi + glm + DeepSeek… bliss. Fable was a different kind of beast though. Rip.

Yeah, Opus/GPT need multiple rounds of reviews from each other to get to clean auto review. Fable was like, it is done and indeed… crickets in bot comments. ‘No issues’ galore.

I wonder if this will hold as other models with different biases achieve parity.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#357

Post by nharada »

ddp26 wrote: post #8

I'm going to pre-register my prediction that GPT-5.6 Sol is significantly behind Claude Fable 5, as evaluated by general consensus once time has passed for people to get familiar with both.

Is that the correct comparison? Fable is twice the price

Re: Previewing GPT‑5.6 Sol: a next-generation model

#358

Post by [deleted] »

jumploops wrote: post #327

If you used GPT-5.5 over the last 24 hours or so, you may have already had access to 5.6. I've been running some tests on a harness we're building, and suddenly saw a jump in a few points yesterday. I reran the vanilla codex benchmark and saw an ~88% score on Terminal Bench 2.1 from GPT-5.5 on vanilla Codex. The biggest indicator, beyond the score, was that 3 tests which frequently hit "safety" blockers with 5.5 star…

[deleted]

Re: Previewing GPT‑5.6 Sol: a next-generation model

#359

Post by Stitch4223 »

fph wrote: post #225
Stitch4223 wrote: post #25

Earlier quoted context omitted.

With the $200/month plan I’ve never ran into any limits or issues. The product can be used every day for extensive sessions and development. What is everyone doing that makes them talk about tokens versus dollars?

But let's put it in perspective: what you're paying them is more than the average salary in many poorer countries.

Fair. From a business perspective said amount is very reasonable in Europe / USA. For personal use it’s already different. Sometimes the answer is simple, thanks.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#360

Post by dennisy »

bob1029 wrote: post #350
gandreani wrote: post #177

Easily the most interesting part of this announcement is buried in the second to last paragraph: "We're also launching GPT‑5.6 Sol on Cerebras at up to 750 tokens per second in July, bringing frontier intelligence to customers at unprecedented speed. Access will initially be limited to select customers as we expand capacity." 750 tokens/s on a frontier model is going to be extremely interesting. I doubt this new vers…

At a certain rate we will be able to move towards continuous / real-time inference systems. The discrete, turn based solutions are quite confining with how they must be trained. Continuous and real-time would fundamentally alter the domain. From an information theory perspective we are still in dial-up territory with regard to the actual information rate. 750 tokens per second would be a really bad dialup connection.…

That would be interesting.

Do you feel most of the speed upgrade will come from the software or hardware side?

Post reply on HN