Advancing the price-performance frontier with GPT‑5.6
1–10 of 424 posts
Re: Advancing the price-performance frontier with GPT‑5.6
#2> GPT‑5.6 Luna, our fastest and most affordable model, will cost 80% less
Looks like the Chinese models are really making a dent. Having 3 different price categories with the "most affordable" one still costing more than GLM 5.2 never made sense.
Re: Advancing the price-performance frontier with GPT‑5.6
#3> The kernel work helped reduce the end-to-end cost of serving the model by 20%, while its experiments increased token-generation efficiency by more than 15%.
If the cost of serving GPT-5.6 just dropped by 20%, does that add up to literally billions of dollars in savings per month?
We know Anthropic spend $1.25 billion renting inference capacity from SpaceX (in two Colossus datacenters) from the SpaceX IPO, but we don't know how much of Anthropic's inference capacity that is (presumably a small fraction, since they were operating on top of AWS and other providers before the SpaceX deal.)
I've not seen any numbers that hint at OpenAI's per-month inference bill, but surely that has to be in the multiple billions of dollars as well.
So 20% is a really, really big deal.
Re: Advancing the price-performance frontier with GPT‑5.6
#4Making Luna, which was already very cheap and extremely capable, 5x cheaper is crazy. I use Sol at work but Luna at home, and while there's definitely a difference, it doesn't feel like night-and-day. After a year of ever-increasing prices it suddenly feels (between this, Kimi K3, GLM 5.2) that prices are falling again.
Re: Advancing the price-performance frontier with GPT‑5.6
#5Making Luna, which was already very cheap and extremely capable, 5x cheaper is crazy. I use Sol at work but Luna at home, and while there's definitely a difference, it doesn't feel like night-and-day. After a year of ever-increasing prices it suddenly feels (between this, Kimi K3, GLM 5.2) that prices are falling again.
[deleted]
Re: Advancing the price-performance frontier with GPT‑5.6
#6Model segmentation & distillation like this that asks the consumers to pick exactly which version of the algorithm will solve their problem is evidence for lack of intelligence instead of its presence.
Re: Advancing the price-performance frontier with GPT‑5.6
#7> The kernel work helped reduce the end-to-end cost of serving the model by 20%, while its experiments increased token-generation efficiency by more than 15%. If the cost of serving GPT-5.6 just dropped by 20%, does that add up to literally billions of dollars in savings per month? We know Anthropic spend $1.25 billion renting inference capacity from SpaceX (in two Colossus datacenters) from the SpaceX IPO, but we do…
imagine writing that on your resume
> reduced inference cost by 20 percent saving company x billion dollars per month
Re: Advancing the price-performance frontier with GPT‑5.6
#8They don't mention Grok at all.
Re: Advancing the price-performance frontier with GPT‑5.6
#9Making Luna, which was already very cheap and extremely capable, 5x cheaper is crazy. I use Sol at work but Luna at home, and while there's definitely a difference, it doesn't feel like night-and-day. After a year of ever-increasing prices it suddenly feels (between this, Kimi K3, GLM 5.2) that prices are falling again.
> Sol vs Luna
> it doesn't feel like night-and-day.
I see what you did there. :)
Re: Advancing the price-performance frontier with GPT‑5.6
#10Making Luna, which was already very cheap and extremely capable, 5x cheaper is crazy. I use Sol at work but Luna at home, and while there's definitely a difference, it doesn't feel like night-and-day. After a year of ever-increasing prices it suddenly feels (between this, Kimi K3, GLM 5.2) that prices are falling again.
depends on what you are doing. if you are doing verifiable tasks like fixing bugs then any model would do as long as you write the right verification.