Earlier quoted context omitted.
Stop R&D and the competition is at parity with 10x cheaper models in 3-6 months. Stop training and your code model generates tech debt after 3-6 month
It's pretty well accepted now that for pre-training LLMs the curve is S not an exponential, right? Maybe it's all in RL post-training now, but my understanding(?) is that it's not nearly as expensive as pre-training. I don't think 3-6 months is the time to 10X improvement anymore (however that's measured), it seems closer to a year and growing assuming the plateau is real. I'd love to know if there are solid estimate…
OpenAI's H1 2025: $4.3B in income, $13.5B in loss
201–210 of 720 posts
Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#202Earlier quoted context omitted.
Unlike railroads and fibre, all the best compute in 2025 will be lacklustre in 2027. It won’t retain much value in the same way as the infrastructure of previous bubbles did?
The A100 came out 5.5 years ago and is still the staple for many AI/ML workloads. Even AI hardware just doesn’t depreciate that quickly.
Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#203Everyone is trying to compare AI companies with something that happened in the past, but I don't think we can predict much from that. GPUs are not railroads or fiber optics. The cost structure of ChatGPT and other LLM based services is entirely different than web, they are very expensive to build but also cost a lot to serve. Companies like Meta, Microsoft, Amazon, Google would all survive if their massive investment…
Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#204Everyone is trying to compare AI companies with something that happened in the past, but I don't think we can predict much from that. GPUs are not railroads or fiber optics. The cost structure of ChatGPT and other LLM based services is entirely different than web, they are very expensive to build but also cost a lot to serve. Companies like Meta, Microsoft, Amazon, Google would all survive if their massive investment…
It's not that the investments just won't pay off, it's that the global markets are likely to crash like happened with the subprime mortgage crisis.
Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#205Earlier quoted context omitted.
> Unlike railroads and fibre, all the best compute in 2025 will be lacklustre in 2027. I definitely don't think compute is anything like railroads and fibre, but I'm not so sure compute will continue it's efficiency gains of the past. Power consumption for these chips is climbing fast, lots of gains are from better hardware support for 8bit/4bit precision, I believe yields are getting harder to achieve as things get…
Unfortunately the chips themselves probably won’t physically last much longer than that under the workloads they are being put to. So, yes, they won’t be totally obsolete as technology in 2028, but they may still have to be replaced.
If we're talking about the whole compute system like a gb200, is there a particular component that breaks first? How hard are they to refurbish, if that particular component breaks? I'm guessing they didn't have repairability in mind, but I also know these "chips" are much more than chips now so there's probably some modularity if it's not the chip itself failing.
Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#206Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#207Everyone is trying to compare AI companies with something that happened in the past, but I don't think we can predict much from that. GPUs are not railroads or fiber optics. The cost structure of ChatGPT and other LLM based services is entirely different than web, they are very expensive to build but also cost a lot to serve. Companies like Meta, Microsoft, Amazon, Google would all survive if their massive investment…
Nvidia may well be at the mercy of them! Hence the recent circular dealing
Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#208Earlier quoted context omitted.
It's not that the investments just won't pay off, it's that the global markets are likely to crash like happened with the subprime mortgage crisis.
The fed could still push the real value of stocks quite a bit by destroying the USD, if they want, by pinning interest rates near 0 and forcing a rush to the exits to buy stock and other asset classes.
Re: OpenAI's H1 2025: $4.3B in income, $13.5B in loss
#209These numbers are pretty ugly. You always expect new tech to operate at a loss initially but the structure of their losses is not something one easily scales out of. In fact it gets more painful as they scale. Unless something fundamentally changes and fast this is gonna get ugly real quick.
There is an exceptionally obvious solution for OpenAI & ChatGPT: ads. In fact it's an unavoidable solution. There is no future for OpenAI that doesn't involve a gigantic, highly lucrative ad network attached to ChatGPT. One of the dumbest things in tech at present is OpenAI not having already deployed this. It's an attitude they can't actually afford to maintain much longer. Ads are a hyper margin product that are ve…
Fascist corporatism will throw them in for whatever Intel rescue plan Nvidia is forced to participate in. If the midterms flip congress or if we have another presidential election, maybe something will change.