Earlier quoted context omitted.
That's slowly changing. I know some relatively non-tech savvy young people using things like Claude for various reasons, so people are exploring options.
Very, very slowly. OpenAI vs Anthropic on Google Trends https://trends.google.com/trends/explore?date=today%203-m&q=... ChatGPT vs Claude on Google Trends https://trends.google.com/trends/explore?date=today%203-m&q=...
OpenAI dropped the price of o3 by 80%
141–150 of 518 posts
Re: OpenAI dropped the price of o3 by 80%
#142Is this a reaction to Apple paper showing that reasoning models don’t really reason?
Re: OpenAI dropped the price of o3 by 80%
#143Note that they have not actually dropped the price yet: https://x.com/OpenAIDevs/status/1932463601119637532 > We’ll post to @openaidevs once the new pricing is in full effect. In $10… 9… 8… There is also speculation that they are only dropping the input price, not the output price (which includes the reasoning tokens).
I think that was a joke. New pricing is already in place: Input: $2.00 / 1M tokens Cached input: $0.50 / 1M tokens Output: $8.00 / 1M tokens https://openai.com/api/pricing/ Now cheaper than gpt-4o and same price as gpt-4.1 (!).
Re: OpenAI dropped the price of o3 by 80%
#144Is there also a corresponding increase in weekly messages for ChatGPT Plus users with o3? In my experience, o4-mini and o4-mini-high are far behind o3 in utility, but since I’m rate-limited for the latter, I end up primarily using the former, which has kind of reinforced the perception that OpenAI’s thinking models are behind the competition altogether.
Re: OpenAI dropped the price of o3 by 80%
#145Earlier quoted context omitted.
It's probably optimized in some way, but if the optimizations degrade performance, let's hope it is reflected in various benchmarks. One alternative hypothesis is that it's the same model, but in the early days they make it think "harder" and run a meta-process to collect training data for reinforcement learning for use on future models.
It's a bit dated now, but it would be cool if people submitted PRs for this one: https://aider.chat/docs/leaderboards/by-release-date.html
Re: OpenAI dropped the price of o3 by 80%
#146Earlier quoted context omitted.
Are there any benchmarks that track historical performance?
Aider has one, but it hasn't been updated in months. People kept claiming models were getting worse, but the results proved that they weren't.
Re: OpenAI dropped the price of o3 by 80%
#147They could drop the price 100% and I still wouldn't use it, so long as they're retaining my data.
Sounds like you want their Zero Data Retention plan: https://platform.openai.com/docs/guides/your-data#zero-data-... (It's "contact us" pricing, so I have no idea how much that would set you back. I'm guessing it's not cheap.)
Re: OpenAI dropped the price of o3 by 80%
#148Despite the popular take that LLMs have no moat and are burning cash, I find OpenAI's situation really promising. Just yesterday, they reported an annualized revenue run rate of 10B. Their last funding round in March valued them at 300B. Despite losing 5B last year, they are growing really fast - 30x revenue with over 500M active users. It reminds me a lot of Uber in its earlier years—fast growth, heavy investment, b…
Re: OpenAI dropped the price of o3 by 80%
#149how do we know it's not a quantized version of o3? what's stopping these firms from announcing the full model to perform well on the benchmarks and then gradually quantizing it (first at Q8 so no one notices, then Q6, then Q4, ...). I have a suspicion that's how they were able to get gpt-4-turbo so fast. In practice, I found it inferior to the original GPT-4 but the company probably benchmaxxed the hell out of the tu…
I got 700+ tokens/sec on o3 after the announcement, I suspect it's very much a quantized version. https://x.com/hyperknot/status/1932476190608036243