Live data from Hacker News

The Growing Compute Shortage

apollo.com

11–20 of 99 posts

Re: The Growing Compute Shortage

#11

Earlier quoted context omitted.

https://epoch.ai/data-insights/ai-chip-production from the beginning of 2026 claimed global AI compute capacity was doubling every 7 months.

> from the beginning of 2026 claimed global AI compute capacity was doubling every 7 months. That's definitely one way to say "it doubled this year"

I read it as "was posted earlier this year. It claimed that compute has been doubling every seven months for quite some time, on average"

Re: The Growing Compute Shortage

#12

Earlier quoted context omitted.

https://epoch.ai/data-insights/ai-chip-production from the beginning of 2026 claimed global AI compute capacity was doubling every 7 months.

Graphs like this are all I can think of when I see unsustainable euphoria like above. https://www.bigtrends.com/education/lessons-from-the-past-10...

Ah I thought you would link https://xkcd.com/605/

Re: The Growing Compute Shortage

#13
Yes but how much of that compute shortage is from demand that is subsidized? We’ve seen companies like Uber drastically cut how much they are willing to spend on AI because they are paying actual usage costs, while at the same time OpenAI and Anthropic increase the limits on their fixed cost plans for individuals meaning people not paying usage costs are using it more and more… doesn’t this show that the compute shortage is because OpenAI and Anthropic are paying for it, not their customers? And the moment OpenAI and Anthropic stop paying for it, demand will collapse.

Re: The Growing Compute Shortage

#15

Yes but how much of that compute shortage is from demand that is subsidized? We’ve seen companies like Uber drastically cut how much they are willing to spend on AI because they are paying actual usage costs, while at the same time OpenAI and Anthropic increase the limits on their fixed cost plans for individuals meaning people not paying usage costs are using it more and more… doesn’t this show that the compute shor…

The compute demand is not fake. Non-coding industries have barely begun to deploy this technology. In the legal sector, I’ve been a tech pessimist my entire career, because it was uniformly quite bad. I’ve spent the last few months demoing legal tools backed by frontier models, and we’re definitely going to buy one of them. They’re real and they work and they address a bunch of needs.

Re: The Growing Compute Shortage

#16

Yes but how much of that compute shortage is from demand that is subsidized? We’ve seen companies like Uber drastically cut how much they are willing to spend on AI because they are paying actual usage costs, while at the same time OpenAI and Anthropic increase the limits on their fixed cost plans for individuals meaning people not paying usage costs are using it more and more… doesn’t this show that the compute shor…

"subsidizing" aka making 30% gross margin instead of 90%.

Re: The Growing Compute Shortage

#17
post #10

GPUs aren’t scarce. There is just a lot of demand, so prices have gone up. Anyone can get GPUs right now and build out what they need; it’s just a matter of paying more for them than the next company. I’ve been looking at building a multi-TB HBM system lately and they’re readily available - they just cost $400k.

> GPUs aren’t scarce. There is just a lot of demand, so prices have gone up.

What does "scarce" mean to you?

I'd wager that to most reasonable people it means "available in a supply that, measured against demand, is low". Market forces typically react to such a state by pushing prices up. Saying "they're not scarce, they're just expensive" is just silly.

The exception to this would be during e.g. supply chain hiccups (lots of compute sitting there, unable to get to its operational destination) or when other forces artificially push up prices. But that's not what we're seeing here. Compute is much scarcer than it's been for years.

Re: The Growing Compute Shortage

#18
post #5

If instead of us training the models to be human utility maximizers, the models had figured out how to train us to maximize their own utility, could we tell the difference?

I suspect that utility may not enter the picture at all, and what we have are LLMs that have been optimized for getting the sort of humans who decide what to spend money on to maximize spending on LLMs and related infrastructure. The LLMs in turn could be anything from Skynet to a very spicy cold-reading autocomplete.

Re: The Growing Compute Shortage

#19

Yes but how much of that compute shortage is from demand that is subsidized? We’ve seen companies like Uber drastically cut how much they are willing to spend on AI because they are paying actual usage costs, while at the same time OpenAI and Anthropic increase the limits on their fixed cost plans for individuals meaning people not paying usage costs are using it more and more… doesn’t this show that the compute shor…

Recent Kimi K3 release is supposedly frontier-grade, so would be interesting to see what it really costs to run inference for models of this class, when the weights get released and other independent providers pick it up (then we could reasonably expect competitive pricing with low-ish margins).

Re: The Growing Compute Shortage

#20
post #10

GPUs aren’t scarce. There is just a lot of demand, so prices have gone up. Anyone can get GPUs right now and build out what they need; it’s just a matter of paying more for them than the next company. I’ve been looking at building a multi-TB HBM system lately and they’re readily available - they just cost $400k.

"Shortage" means exactly that. It doesn't mean "there's no GPUs at all." In a gasoline shortage, prices go up and there are lines at the pump, but there are still cars on the road.
Post reply on HN