GPT-5.5 Price Increase: What It Costs
openrouter.ai
GPT-5.5 Price Increase: What It Costs
1–10 of 80 posts
Re: GPT-5.5 Price Increase: What It Costs
#2This doesn't seem to be controlling for the number of turns in any way. Am I missing something?
Stronger models needing fewer turns to achieve a task feels like a prime source of efficiency gains for agentic coding, more so than individual responses being shorter.
Re: GPT-5.5 Price Increase: What It Costs
#3This doesn't seem to be controlling for the number of turns in any way. Am I missing something? Stronger models needing fewer turns to achieve a task feels like a prime source of efficiency gains for agentic coding, more so than individual responses being shorter.
They also don't mention what their sample size is, or anything about the distribution of input and response lengths.
It'd be interesting to see the distributions if the author actually plotted the data, so we could see if their analysis holds water or not.
A plot of the input lengths using ggplot2 geom_density with color and fill by model, 0.1 alpha, and an appropriate bandwidth adjustment would allow us to see if the input data distribution looks similar across the two, and using the same for the output length distributions, faceted by the input length bins would give us an idea if those look the same too.
Edit: Or even a faceted plot using input bins of output length/input length.
Re: GPT-5.5 Price Increase: What It Costs
#4[dead]
Re: GPT-5.5 Price Increase: What It Costs
#5Has any enterprising hacker here yet graphed price vs "output" over time since 2023, taking "quality" into account?
That's got to be a very tricky analysis given how subjective quality is. But I'm sure there are people trying to pin it down.
Re: GPT-5.5 Price Increase: What It Costs
#6Has any enterprising hacker here yet graphed price vs "output" over time since 2023, taking "quality" into account? That's got to be a very tricky analysis given how subjective quality is. But I'm sure there are people trying to pin it down.
Quality would be performance against different given benchmarks, I assume?
There's multiple open weight models you can run on a pretty standard computer at home, which match the quality of GPT 4. I guess that would also change the equation.
Re: GPT-5.5 Price Increase: What It Costs
#7I feel that the recent iterations of LLM haven't provided an intuitive qualitative leap. Have they entered a bottleneck period so quickly?
Re: GPT-5.5 Price Increase: What It Costs
#8it does seem like a step change in token efficiency, though based on the earlier artificial analysis reporting it's also quite the cost lottery and i'm not sure i am comfortable with that
Re: GPT-5.5 Price Increase: What It Costs
#9Has any enterprising hacker here yet graphed price vs "output" over time since 2023, taking "quality" into account? That's got to be a very tricky analysis given how subjective quality is. But I'm sure there are people trying to pin it down.
anything that compares proprietary models will be very miscalibrated and may not be indicative, there have been too many model changes in both chat and the api where model providers did not even say the word before it got too noticable
Re: GPT-5.5 Price Increase: What It Costs
#10I feel that the recent iterations of LLM haven't provided an intuitive qualitative leap. Have they entered a bottleneck period so quickly?
My take is that demand is also increasing, so maybe they are making incremental improvements to model quality while focusing on improving inference costs. Prices are increasing though because even if they achieve a very efficient model, they are still selling at a loss.