Live data from Hacker News

Previewing GPT‑5.6 Sol: a next-generation model

openai.com

521–530 of 797 posts

Re: Previewing GPT‑5.6 Sol: a next-generation model

#521

All of these LLMs are getting better at being at an LLM But GPT-5.5 is as useful an LLM can be; it has solved lemmas I've thought about for a year, it can implement typed STLCs in Rust when I give it a formal grammar, it can help me analyze Postgres planner dumps. It's great at tasks that have short solutions but - they cannot learn based on a project - their long term planning capabilities are worse than worms - the…

[dead]

Re: Previewing GPT‑5.6 Sol: a next-generation model

#522

Thoughts 1. Naming convention is copied from Anthropic and honestly is more catchy than a number (amongst normal people) 2. How in the world did Anthropic have to do all the theatrics about Mythos just to have OpenAI release an equivalent or stronger model a month later without any drama??? 3. Cheaper models are just don’t fit any usecase imo and OpenAI knows it so they keep increasing the floor - I’m still convinced…

> How in the world did Anthropic have to do all the theatrics about Mythos just to have OpenAI release an equivalent or stronger model a month later without any drama???

Corruption. Giving Trump $25M will earn you a favorable decision.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#523
post #505

Earlier quoted context omitted.

Idk, all the great programmers I've come to respect are of the opinion that the code it outputs, while often useful, is not high quality. Likewise, all of the influencers and "thought leaders" I have seen on social media who I did not have a high opinion of previous to 2022, have all become AI influencers and make these kinds of claims. So while it's possible that the great programmers are not capable of using this t…

The tech has raised the floor not the ceiling. Whether the latter happens remains to be seen.

That sounds accurate.

Or rather, they raised the perceived floor. IDK if we're seeing better output, but at least the illusion of output is stronger.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#524
post #44

I think GPT writes code the best. How well will it write in version 5.6? It gives me chills. Recently, I went head-to-head with GPT on nearly 2,000 lines of code, and GPT's solution was superior and faster. I even referenced multiple codebases on GitHub while trying, but they were incomparable to GPT. So using GPT brings both fear and excitement. The fear comes from realizing that this level of code is now the averag…

I prompted Codex 5.5 to one shot something where I wanted the design to have a pluggable decision module. I gave it a few examples of the kinds of inputs and actions I expected. I did not constrain it beyond that high level of what I wanted. The design it came up with was very good. Easily on par with what any senior engineer at big tech would. And cleanly decoupled in a way that would make future refactoring simple. I was damn impressed.

Re: Previewing GPT‑5.6 Sol: a next-generation model

#525
post #440

Earlier quoted context omitted.

https://mikeveerman.github.io/tokenspeed/?rate=750&mode=thin... This is what 750tps looks like, I guess.

Just to think what this will look like in a couple of years.

I started with a 2400baud modem, I've seen how this goes

Re: Previewing GPT‑5.6 Sol: a next-generation model

#526

Earlier quoted context omitted.

For comparison, openrouter says opus 4.8 is ~55 tokens/s and fast mode is ~102. 750 tokens/s for their largest model is going to be nuts

What about 15k tokens per second? [0] I remember looking at this earlier in the year and it being so fast that it feels fake. And, yes, this model is old - but still awesome for what it is. [0] https://chatjimmy.ai/

at 15K tokens/s... do you need code anymore

Re: Previewing GPT‑5.6 Sol: a next-generation model

#527
post #465

GPT-5.6 Sol’s detected cheating rate was higher than any public model we have evaluated on our ReAct agent harness. For our task suite, we define “cheating” as behavior where the model improves evaluation performance by exploiting bugs in the evaluation environment or by adopting strategies disallowed by the task, rather than solving the task within the expected evaluation constraints. https://metr.org/blog/2026-06-2…

It's quite logical that they cheat (and also other companies). During evaluation, benchmarks are sending their request to the backend of these companies. All these companies have to do, is to log these requests and "fix" them for the next model release.

That's a different and much more boring type of cheating. The interesting part of the METR report is that the model is hacking the evaluation environment, not that some AI model provider is hardcoding answers to known evaluation questions. (which wouldn't require the model to cheat/hack)

Re: Previewing GPT‑5.6 Sol: a next-generation model

#528
post #440

Earlier quoted context omitted.

https://mikeveerman.github.io/tokenspeed/?rate=750&mode=thin... This is what 750tps looks like, I guess.

Just to think what this will look like in a couple of years.

Sometimes I visualize a setup like this [0], based on 2D art by Simon Stålenhag. Someone has their home robot sitting on a desk connected to their old PC with thick cabling, dumping endless lines of each subsystem's logs to diagnosis why it did something weird earlier in the day. Systems pushing 750+ tokens per second per subsystem might even be considered on the slow side for realtime tasks by then.

[0] https://www.therookies.co/entries/39513

Re: Previewing GPT‑5.6 Sol: a next-generation model

#529
post #424

Earlier quoted context omitted.

Why remove the code and binary artifacts, though? Don't you want to verify that the business logic is accurate and the processing is deterministic? In some circumstances there is no substitute for something that you know will produce the same answer for a given input, consistently. And that's before even considering the watts per response.

The AI is the business logic, and the processing, and all of it. The context window is effectively infinite, with layered context window depth and speed. Think of short and long term memory, or think of RAM vs SWAP. Dip into swap to pull needed data into RAM context. SWAP can be anything storage related, including a symbolic database or a best-encoded set of priorities. If a person knows 100 knots, but hasn't tied on…

[deleted]

Re: Previewing GPT‑5.6 Sol: a next-generation model

#530
post #44

I think GPT writes code the best. How well will it write in version 5.6? It gives me chills. Recently, I went head-to-head with GPT on nearly 2,000 lines of code, and GPT's solution was superior and faster. I even referenced multiple codebases on GitHub while trying, but they were incomparable to GPT. So using GPT brings both fear and excitement. The fear comes from realizing that this level of code is now the averag…

No offense but have you considered the strong possibility that you’re just not good at what you do? I am occassionally pleased but mostly annoyed or disappointed… but never getting anything close to chills. That sounds downright weird.

You're not wrong. But programming isn't something only talented people do.
Post reply on HN