No benchmark comparisons to other models, especially Gemini 2.5 Pro, is telling.
Gemini 2.5 Pro gets 64% on SWE-bench verified. Sonnet 3.7 gets 70% They are reporting that GPT-4.1 gets 55%.
Are those with «thinking» or without?
GPT-4.1 in the API
31–40 of 513 posts
Re: GPT-4.1 in the API
#32GPT-4.1 probably is a distilled version of GPT-4.5 I dont understand the constant complaining about naming conventions. The number system differentiates the models based on capability, any other method would not do that. After ten models with random names like "gemini", "nebula" you would have no idea which is which. Its a low IQ take. You dont name new versions of software as completely different software Also, Yest…
> The number system differentiates the models based on capability, any other method would not do that. Please rank GPT-4, GPT-4 Turbo, GPT-4o, GPT-4.1-nano, GPT-4.1-mini, GPT-4.1, GPT-4.5, o1-mini, o1, o1 pro, o3-mini, o3-mini-high, o3, and o4-mini in terms of capability without consulting any documentation.
Very easy with the naming system?
Re: GPT-4.1 in the API
#33Testing against unspecified other "leading" models allows for shenanigangs:
> Qodo tested GPT‑4.1 head-to-head against other leading models [...] they found that GPT‑4.1 produced the better suggestion in 55% of cases
The linked blog post goes 404: https://www.qodo.ai/blog/benchmarked-gpt-4-1/
Re: GPT-4.1 in the API
#34It seems that OpenAI is really differentiating itself in the AI market by developing the most incomprehensible product names in the history of software.
[deleted]
Re: GPT-4.1 in the API
#35It seems that OpenAI is really differentiating itself in the AI market by developing the most incomprehensible product names in the history of software.
I wonder how they decide whether the o or the digit needs to come first. (eg. o3 vs 4o)
Re: GPT-4.1 in the API
#36Re: GPT-4.1 in the API
#37Re: GPT-4.1 in the API
#38GPT-4.1 Pricing (per 1M tokens): gpt-4.1 - Input: $2.00 - Cached Input: $0.50 - Output: $8.00 gpt-4.1-mini - Input: $0.40 - Cached Input: $0.10 - Output: $1.60 gpt-4.1-nano - Input: $0.10 - Cached Input: $0.025 - Output: $0.40
The cached input price is notable here: previously with GPT-4o it was 1/2 the cost of raw input, now it's 1/4th.
It's still not as notable as Claude's 1/10th the cost of raw input, but it shows OpenAI's making improvements in this area.
Re: GPT-4.1 in the API
#39The big change about this announcement is the 1M context window on all models. But the price is what matters.
Nothing compared to Llama 4's 7M. What matters is how well it performs with such long context, not what the technical maximum is.
Re: GPT-4.1 in the API
#40GPT-4.1 probably is a distilled version of GPT-4.5 I dont understand the constant complaining about naming conventions. The number system differentiates the models based on capability, any other method would not do that. After ten models with random names like "gemini", "nebula" you would have no idea which is which. Its a low IQ take. You dont name new versions of software as completely different software Also, Yest…
Just add SemVer with an extra tag:
4.0.5.worsethan4point5