Live data from Hacker News

OpenAI dropped the price of o3 by 80%

twitter.com

51–60 of 518 posts

Re: OpenAI dropped the price of o3 by 80%

#51
Despite the popular take that LLMs have no moat and are burning cash, I find OpenAI's situation really promising.

Just yesterday, they reported an annualized revenue run rate of 10B. Their last funding round in March valued them at 300B. Despite losing 5B last year, they are growing really fast - 30x revenue with over 500M active users.

It reminds me a lot of Uber in its earlier years—fast growth, heavy investment, but edging closer to profitability.

Re: OpenAI dropped the price of o3 by 80%

#52
post #26

Earlier quoted context omitted.

I swear every time a new model is released it's great at first but then performance gets worse over time. I figured they were fine-tuning it to get rid of bad output which also nerfed the really good output. Now I'm wondering if they were quantizing it.

[flagged]

But OpenAI breathes honesty. They're open source! They would never do such a thing. /s

Re: OpenAI dropped the price of o3 by 80%

#53

how do we know it's not a quantized version of o3? what's stopping these firms from announcing the full model to perform well on the benchmarks and then gradually quantizing it (first at Q8 so no one notices, then Q6, then Q4, ...). I have a suspicion that's how they were able to get gpt-4-turbo so fast. In practice, I found it inferior to the original GPT-4 but the company probably benchmaxxed the hell out of the tu…

> users found them more pleasing. Some users. For me the drop was so huge it became almost unusable for the things I had used it for.

Same here. One of my apps straight out stopped working because the gpt-4o outputs were noticeably worse than the gpt-4 that I built the app based on.

Re: OpenAI dropped the price of o3 by 80%

#54
post #29

Earlier quoted context omitted.

How are LLMs cached? Every prompt would be different so it's not clear how that would work. Unless you're talking about caching the model weights...

You would use a KV cache to cache a significant chunk of the inference work.

Do you mean that they provide the same answer to verbatim-equivalent questions, and pull the answer out of storage instead of recalculating each time? I've always wondered if they did this.

Re: OpenAI dropped the price of o3 by 80%

#55

how do we know it's not a quantized version of o3? what's stopping these firms from announcing the full model to perform well on the benchmarks and then gradually quantizing it (first at Q8 so no one notices, then Q6, then Q4, ...). I have a suspicion that's how they were able to get gpt-4-turbo so fast. In practice, I found it inferior to the original GPT-4 but the company probably benchmaxxed the hell out of the tu…

This is almost certainly what they're doing and rebranding the original o3 model as "o3-pro"

Re: OpenAI dropped the price of o3 by 80%

#56

how do we know it's not a quantized version of o3? what's stopping these firms from announcing the full model to perform well on the benchmarks and then gradually quantizing it (first at Q8 so no one notices, then Q6, then Q4, ...). I have a suspicion that's how they were able to get gpt-4-turbo so fast. In practice, I found it inferior to the original GPT-4 but the company probably benchmaxxed the hell out of the tu…

This is almost certainly what they're doing and rebranding the original o3 model as "o3-pro"

> rebranding the original o3 model as "o3-pro"

interesting take, I wouldn't be surprised if they did that.

Re: OpenAI dropped the price of o3 by 80%

#57

how do we know it's not a quantized version of o3? what's stopping these firms from announcing the full model to perform well on the benchmarks and then gradually quantizing it (first at Q8 so no one notices, then Q6, then Q4, ...). I have a suspicion that's how they were able to get gpt-4-turbo so fast. In practice, I found it inferior to the original GPT-4 but the company probably benchmaxxed the hell out of the tu…

I swear every time a new model is released it's great at first but then performance gets worse over time. I figured they were fine-tuning it to get rid of bad output which also nerfed the really good output. Now I'm wondering if they were quantizing it.

I've heard lots of people say that, but no objective reproducible benchmarks confirm such a thing happening often. Could this simply be a case of novelty/excitement for a new model fading away as you learn more about its shortcomings?

Re: OpenAI dropped the price of o3 by 80%

#58

It's going to be a race to the bottom, they have no moat.

My understanding was that OpenAI couldn't make money at their previous price point, and I don't think operation and training cost have gone down sufficiently to make up for those short comings. So how are they going to make money by lowering the price by 80%?

I get the point is to be the last man standing, and poaching customers by lowering the price, and perhaps attract a few people who wouldn't have bought a subscription at the higher price. I just question how long investors can justify pouring money into OpenAI. OpenAI is also the poster child for modern AI, so if they fail the market will react badly.

Mostly I don't understand Silicon Valley venture capital, but dumping price, making wild purchases for investor money and mostly only leading on branding, why isn't this a sign that OpenAI is failing?

Re: OpenAI dropped the price of o3 by 80%

#59

Despite the popular take that LLMs have no moat and are burning cash, I find OpenAI's situation really promising. Just yesterday, they reported an annualized revenue run rate of 10B. Their last funding round in March valued them at 300B. Despite losing 5B last year, they are growing really fast - 30x revenue with over 500M active users. It reminds me a lot of Uber in its earlier years—fast growth, heavy investment, b…

I don't think the no moat approach makes sense. In a world where more an more content and interaction is done with and via LLMs, the data of your users chatting with your LLM is a super valuable dataset.

Re: OpenAI dropped the price of o3 by 80%

#60

how do we know it's not a quantized version of o3? what's stopping these firms from announcing the full model to perform well on the benchmarks and then gradually quantizing it (first at Q8 so no one notices, then Q6, then Q4, ...). I have a suspicion that's how they were able to get gpt-4-turbo so fast. In practice, I found it inferior to the original GPT-4 but the company probably benchmaxxed the hell out of the tu…

This is almost certainly what they're doing and rebranding the original o3 model as "o3-pro"

-pro models appear to be a best-of-10 sampling of the original full size model
Post reply on HN