Claude Opus 4.6

Post by smcleod » Thu, Feb 05, 2026, 9:37 PM UTC

wasmainiac wrote: post #265

gizmodo59 wrote: post #107

5.3 codex https://openai.com/index/introducing-gpt-5-3-codex/ crushes with a 77.3% in Terminal Bench. The shortest lived lead in less than 35 minutes. What a time to be alive!

Dumb question. Can these benchmarks be trusted when the model performance tends to vary depending on the hours and load on OpenAI’s servers? How do I know I’m not getting a severe penalty for chatting at the wrong time. Or even, are the models best after launch then slowly eroded away at to more economical settings after the hype wears off?

Post by g947o » Thu, Feb 05, 2026, 9:38 PM UTC

shoeb00m wrote: post #190

g947o wrote: post #152

Earlier quoted context omitted.

Great question, and my guess: If you build React in C++ and Rust, even if the framework is there, you'll likely need to write your components in C++/Rust. That is a difficult problem. There are actually libraries out there that allow you to build web UI with Rust, although they are for web (+ HTML/CSS) and not specifically CLI stuff. So someone needs to create such a library that is properly maintained and such. And…

Opencode wrote their own tui library in zig, and then build a solidjs library on top of that. https://github.com/anomalyco/opentui

Post by Havoc » Thu, Feb 05, 2026, 9:40 PM UTC

mattddowney wrote: post #93

Havoc wrote: post #51

Earlier quoted context omitted.

Saw a comment earlier today about google seeing a big (50%+) fall in Gemini serving cost per unit across 2025 but can’t find it now. Was either here or on Reddit

From Alphabet 2025 Q4 Earnings call: "As we scale, we’re getting dramatically more efficient. We were able to lower Gemini serving unit costs by 78% over 2025 through model optimizations, efficiency and utilization improvements." https://abc.xyz/investor/events/event-details/2026/2025-Q4-E...

Post by pdntspa » Thu, Feb 05, 2026, 9:40 PM UTC

g947o wrote: post #152

thehamkercat wrote: post #45

Earlier quoted context omitted.

Same with opencode and gemini, it's disgusting Codex (by openai ironically) seems to be the fastest/most-responsive, opens instantly and is written in rust but doesn't contain that many features Claude opens in around 3-4 seconds Opencode opens in 2 seconds Gemini-cli is an abomination which opens in around 16 second for me right now, and in 8 seconds on a fresh install Codex takes 50ms for reference... -- If their m…

Great question, and my guess: If you build React in C++ and Rust, even if the framework is there, you'll likely need to write your components in C++/Rust. That is a difficult problem. There are actually libraries out there that allow you to build web UI with Rust, although they are for web (+ HTML/CSS) and not specifically CLI stuff. So someone needs to create such a library that is properly maintained and such. And…

Post by zamadatix » Thu, Feb 05, 2026, 9:43 PM UTC

tedsanders wrote: post #369

wasmainiac wrote: post #265

Earlier quoted context omitted.

Dumb question. Can these benchmarks be trusted when the model performance tends to vary depending on the hours and load on OpenAI’s servers? How do I know I’m not getting a severe penalty for chatting at the wrong time. Or even, are the models best after launch then slowly eroded away at to more economical settings after the hype wears off?

We don't vary our model quality with time of day or load (beyond negligible non-determinism). It's the same weights all day long with no quantization or other gimmicks. They can get slower under heavy load, though. (I'm from OpenAI.)