I'd like to offer a cautionary tale that involves my experience after seeing this post. First, I tried enabling o3 via OpenRouter since I have credits with them already. I was met with the following: "OpenAI requires bringing your own API key to use o3 over the API. Set up here: https://openrouter.ai/settings/integrations " So I decided I would buy some API credits with my OpenAI account. I ponied up $20 and started…
This is in part "abuse prevention"[1] and in part marketing . Making customers feel like they're signing up to access state secrets makes the models seem more "special". Sama is well known to use these SV marketing tricks, like invite-only access, waiting lists, etc to psychologically manipulate users into thinking they're begging for entry to an exclusive club instead of just swiping a credit card to access an API.…
OpenAI dropped the price of o3 by 80%
281–290 of 518 posts
Re: OpenAI dropped the price of o3 by 80%
#282I'd like to offer a cautionary tale that involves my experience after seeing this post. First, I tried enabling o3 via OpenRouter since I have credits with them already. I was met with the following: "OpenAI requires bringing your own API key to use o3 over the API. Set up here: https://openrouter.ai/settings/integrations " So I decided I would buy some API credits with my OpenAI account. I ponied up $20 and started…
Re: OpenAI dropped the price of o3 by 80%
#283Earlier quoted context omitted.
This is in part "abuse prevention"[1] and in part marketing . Making customers feel like they're signing up to access state secrets makes the models seem more "special". Sama is well known to use these SV marketing tricks, like invite-only access, waiting lists, etc to psychologically manipulate users into thinking they're begging for entry to an exclusive club instead of just swiping a credit card to access an API.…
Gemini doesn't give you reasoning via API though, at least as far as I'm aware.
Maybe you’re thinking of deep research mode which is web UI only for now.
Re: OpenAI dropped the price of o3 by 80%
#284Earlier quoted context omitted.
The problem is your costs also scale with revenue. Ideally you want to have control costs as you scale (the first you build is expensive, but as you make more your costs come down). For OpenAI, the more people use the product, the same you spend on compute unless they can supplement it with another ways of generating revenue. I dont unfortunately think OpenAI will be able to hit sustained profitability (see Netflix f…
All costs are not equal. There is a classic pattern of dogfights for winner-take-most product categories where the long term winner does the best job of acquiring customers at the expense of things like "engineering to reduce costs". I have no idea how the AI space is going to shake out, but if I had to pick between OpenAI's mindshare in the broadest possible cohort of users vs. best/most efficient model, I'd pick th…
Re: OpenAI dropped the price of o3 by 80%
#285Earlier quoted context omitted.
I think they're probably more concerned about fake accounts and people finding ways to get free stuff.
What free stuff? It requires a paid API.
Re: OpenAI dropped the price of o3 by 80%
#286Re: OpenAI dropped the price of o3 by 80%
#287I'd like to offer a cautionary tale that involves my experience after seeing this post. First, I tried enabling o3 via OpenRouter since I have credits with them already. I was met with the following: "OpenAI requires bringing your own API key to use o3 over the API. Set up here: https://openrouter.ai/settings/integrations " So I decided I would buy some API credits with my OpenAI account. I ponied up $20 and started…
(So I’m remaining locked out of my linkedin account.)
Re: OpenAI dropped the price of o3 by 80%
#288Earlier quoted context omitted.
I was more excited by the process, like, there exists a model out there so powerful it requires KYC which, after using it, fair! It found a zero day
[flagged]
Re: OpenAI dropped the price of o3 by 80%
#289Earlier quoted context omitted.
I was more excited by the process, like, there exists a model out there so powerful it requires KYC which, after using it, fair! It found a zero day
I think they're probably more concerned about fake accounts and people finding ways to get free stuff.
- generating synthetic data to train their own models
- hacking and exploitation research
etc
Re: OpenAI dropped the price of o3 by 80%
#290Earlier quoted context omitted.
It's not a PR statement, it's a change in price. Literally putting money where the mouth is.
o3 probably used to have a HUGE profit margin on inference, so I'd say it's unclear how much optimo was done;
- Carefully interleaving shared memory loading with computation, and the whole kernel with global memory loading.
- Warp shuffling for softmax.
- Avoiding memory access conflicts in matrix multiplication.
I'm sure the guys at ClosedAI have many more optimizations they've implemented ;). They're probably eventually going to design their own chips or use photonic chips for lower energy costs, but there's still a lot of gains to be made in the software.