Advancing the price-performance frontier with GPT‑5.6 • Hacker News Board

Re: Advancing the price-performance frontier with GPT‑5.6

#191

Post by nerdsniper » Thu, Jul 30, 2026, 7:07 PM UTC

jcul wrote: post #159

iamjackg wrote: post #137

Earlier quoted context omitted.

Holy crap, I was not prepared for how fast it responded. I just wrote "Just wanted to see how fast you are! Can you write me a quick story about a tiger who lives inside a block of cheese the size of a house?" I pressed Enter, and the response was instant . > Generated in 0.037s • 14,205 tok/s This is unbelievable.

It's crazy. Are they doing any precomputing as you type, I wonder if you paste a block of text is it the same speed.

I pasted and instantly hit enter on this prompt: "I generated a filter set using REW v5.31.3 using real-world sweep tone measurements from the room I'm listening in . How can I use it as my MacOS output equalizer so that my spotify music is adjusted for this room and speakers"

and it gave a very reasonable answer in non-perceptible time.

Re: Advancing the price-performance frontier with GPT‑5.6

#192

Post by Pesto » Thu, Jul 30, 2026, 7:07 PM UTC

I truly wonder what kind of model is luna now.

Before I thought it was just an improved version or at least in the same class as gpt 5.4 mini but now it's being priced like a nano model!

I thought about it because Terra has similar pricing to 5.4 and Sol is similar to 5.5.

Luna was already my workhorse before, it performs very well on high/xhigh for most of the tasks, very happy about this drop.

Re: Advancing the price-performance frontier with GPT‑5.6

#193

Post by throwuxiytayq » Thu, Jul 30, 2026, 7:08 PM UTC

jcul wrote: post #159

iamjackg wrote: post #137

Earlier quoted context omitted.

Holy crap, I was not prepared for how fast it responded. I just wrote "Just wanted to see how fast you are! Can you write me a quick story about a tiger who lives inside a block of cheese the size of a house?" I pressed Enter, and the response was instant . > Generated in 0.037s • 14,205 tok/s This is unbelievable.

It's crazy. Are they doing any precomputing as you type, I wonder if you paste a block of text is it the same speed.

No, it really does take ~0.03s to generate the answer. Try your browser's developer tools and watch the requests.

Re: Advancing the price-performance frontier with GPT‑5.6

#194

Post by paxys » Thu, Jul 30, 2026, 7:09 PM UTC

msejas wrote: post #169

Isn't OpenAI burning billions and have billions more spending commitments? If they managed to downsize so much the cost they should have kept the price the same and become profitable, really weird move, unsure what led to this.

Supply demand curve is a thing. Cutting price on something does not mean you are going to make less money.

Re: Advancing the price-performance frontier with GPT‑5.6

#195

Post by dgellow » Thu, Jul 30, 2026, 7:09 PM UTC

msejas wrote: post #169

Isn't OpenAI burning billions and have billions more spending commitments? If they managed to downsize so much the cost they should have kept the price the same and become profitable, really weird move, unsure what led to this.

More than $650B due 2030. I don’t understand how it makes any sense that they reduce the price so much, unless they expect seriously such a massive saving and increase in demand from their latest improvements?

Re: Advancing the price-performance frontier with GPT‑5.6

#196

Post by anthonypasq » Thu, Jul 30, 2026, 7:10 PM UTC

dgellow wrote: post #185

How is that economically possible? I’m so confused by those prices

how many times do you have to be metaphorically hit in the head with a brick before you realize inference margins at api pricing were 80%+

Re: Advancing the price-performance frontier with GPT‑5.6

#197

Post by Dig1t » Thu, Jul 30, 2026, 7:10 PM UTC

8cvor6j844qw_d6 wrote: post #166

iamjackg wrote: post #137

Earlier quoted context omitted.

Holy crap, I was not prepared for how fast it responded. I just wrote "Just wanted to see how fast you are! Can you write me a quick story about a tiger who lives inside a block of cheese the size of a house?" I pressed Enter, and the response was instant . > Generated in 0.037s • 14,205 tok/s This is unbelievable.

I'd like to imagine the things that can be done with this speed and the current frontier models.

Seriously, if Fable or even Opus was this fast that would be a real game changer.

Re: Advancing the price-performance frontier with GPT‑5.6

#198

Post by dgellow » Thu, Jul 30, 2026, 7:10 PM UTC

paxys wrote: post #194

msejas wrote: post #169

Isn't OpenAI burning billions and have billions more spending commitments? If they managed to downsize so much the cost they should have kept the price the same and become profitable, really weird move, unsure what led to this.

Supply demand curve is a thing. Cutting price on something does not mean you are going to make less money.

But they still have to cover compute cost, and they already committed to more than $650B in infra expenses for 2035

Re: Advancing the price-performance frontier with GPT‑5.6

#199

Post by pimeys » Thu, Jul 30, 2026, 7:10 PM UTC

GodelNumbering wrote: post #44

"Half the money I spend on advertising is wasted; the trouble is I don't know which half." -John Wanamaker This applies even more strongly to model choosing. I know for a fact that majority of my work doesn't require a very strong model, but separating the trivial and non-trivial tasks is a famously hard problem (if at all decidable).

If you have agents and users, you can run evals and see how far the models go. Luna is not greatest in tool calls, but if you define your problem well and the tools well, it is comparable to Gemini 4 Flash with much lower price tag.

Re: Advancing the price-performance frontier with GPT‑5.6

#200

Post by ElijahLynn » Thu, Jul 30, 2026, 7:14 PM UTC

jaggederest wrote: post #131

jrflo wrote: post #115

Earlier quoted context omitted.

Burning the weights into silicon would be many orders of magnitude increase, not just 10x. It's kind of crazy that this hockey stick the AI hype bros talk about seems more and more every day like it might be real

https://taalas.com/ has done it already for a wildly obsolete model. 14000 tokens per second. https://chatjimmy.ai/ is their interactive. Tiny context, very dumb, but absurdly fast. Imagine this as a tool call for claude code for trivial changes - the tool call from the harness takes longer than the execution.

Wow! You weren't kidding,

I just tried it too and 14,098 tokens in .05 seconds, I barely blinked and it was done. There was no typing at all appearing on the screen. It just showed up.

https://chatjimmy.ai/chats/01dc66a4-4b1b-4dea-bb5f-926855e37...