Earlier quoted context omitted.
For coding, I like the Aider polyglot benchmark, since it covers multiple programming languages. Gemini 2.5 Pro got 72.9% o3 high gets 81.3%, o4-mini high gets 68.9%
where do you find those o3 high numbers? https://aider.chat/docs/leaderboards/ currently has gemini 2.5 pro as the leader at, as you say, 72.9%.
OpenAI o3 and o4-mini
191–200 of 527 posts
Re: OpenAI o3 and o4-mini
#192Earlier quoted context omitted.
They are all now available on the Pro plan. Y'all really ought to have a little bit more grace to wait 30 minutes after the announcement for the rollout.
Or maybe OpenAI could wait until they'd released it before telling people to use it now .
Re: OpenAI o3 and o4-mini
#193Interesting that using tools to zoom around the image is useful for the model. I was kind of assuming that these models were beyond such things and could attend to all aspects image simultaneously anyway, but perhaps their input is still limited in the resolution? Very cool, in any case, spooky progress as always.
Re: OpenAI o3 and o4-mini
#194Re: OpenAI o3 and o4-mini
#195Earlier quoted context omitted.
ChatGPT was released in 2022, so OP's point stands perfectly well.
They're rumored to be working on a social network to rival X with the focus being on image generations. https://techcrunch.com/2025/04/15/openai-is-reportedly-devel... The play now seems to be less AGI, more "too big to fail" / use all the capital to morph into a FAANG bigtech. My bet is that they'll develop a suite of office tools that leverage their model, chat/communication tools, a browser, and perhaps a device.…
Why would anyone use a social network run by Sam Altman? No offense but his reputation is chaotic neutral to say the least.
Social networks require a ton of momentum to get going.
BlueSky already ate all the momentum that X lost.
Re: OpenAI o3 and o4-mini
#196Re: OpenAI o3 and o4-mini
#197Earlier quoted context omitted.
Im old enough to remember the mystery and hype before o*/o1/strawberry that was supposed to be essentially AGI. We had serious news outlets write about senior people at OpenAI quitting because o1 was SkyNet Now we're up to o4, AGI is still not even in near site (depending on your definition, I know). And OpenAI is up to about 5000 employees. I'd think even before AGI a new model would be able to cover for at least 45…
Remember that Docusign has 7,000 employees. I think OpenAI is pretty lean for what they're accomplishing.
Or maybe it’s just nonsensical to compare the number of employees across companies - especially when they don’t do nearly the same thing.
On a related note, wait until you find out how many more employees that Apple has than Google since Apple has hundreds of retail employees.
Re: OpenAI o3 and o4-mini
#198Earlier quoted context omitted.
Lots of releases but very little actual performance increases
Sonnet and Gemini saw fairly substantial perf increases recenly
Re: OpenAI o3 and o4-mini
#199Earlier quoted context omitted.
Remember that Docusign has 7,000 employees. I think OpenAI is pretty lean for what they're accomplishing.
[flagged]
Re: OpenAI o3 and o4-mini
#200So at this point OpenAI has 6 reasoning models, 4 flagship chat models, and 7 cost optimized models. So that's 17 models in total and that's not even counting their older models and more specialized ones. Compare this with Anthropic that has 7 models in total and 2 main ones that they promote. This is just getting to be a bit much, seems like they are trying to cover for the fact that they haven't actually done much.…
"haven't actually done much" being popularizing the chat llm and absolutely dwarfing the competition in paid usage