Live data from Hacker News

IBM CEO says there is 'no way' spending on AI data centers will pay off

businessinsider.com

451–460 of 985 posts

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#451

Earlier quoted context omitted.

Xerox was also famously early with a lot of things but failed to create proper products out of it. Google falls somewhere in the middle. They have great R&D but just can’t make products. It took OpenAI to show them how to do it, and the managed to catch up fast .

"They have great R&D but just can’t make products" Is this just something you repeat without thinking? It seems to be a popular sentiment here on Hacker News, but really makes no sense if you think about it. Products: Search, Gmail, Chrome, Android, Maps, Youtube, Workspace (Drive, Docs, Sheets, Calendar, Meet), Photos, Play Store, Chromebook, Pixel ... not to mention Cloud, Waymo, and Gemini ... So many widely adopt…

> Products: Search, Gmail, Chrome, Android, Maps, Youtube, Workspace (Drive, Docs, Sheets, Calendar, Meet), Photos, Play Store, Chromebook, Pixel ... not to mention Cloud, Waymo, and Gemini ...

Many of those are acquisitions. In-house developed ones tend to be the most marginal on that list, and many of their most visibly high-effort in-house products have been dramatic failures (e.g. Google+, Glass, Fiber).

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#452
post #241
post #39

Earlier quoted context omitted.

It’s far more extreme: old servers are still okay on I/O, and memory latency, etc. won’t change that dramatically so you can still find productive uses for them. AI workloads are hyper-focused on a single type of work and, unlike most regular servers, a limiting factor in direct competition with other companies.

I mean you could use training GPUs for inference right? That would be use case number 1 for a 8 * a100 box in a couple of years. It can also be used for non IO limited things like folding proteins or other 'scientific' use cases. Push comes to shove im sure an old A100 will run crysis.

> Push comes to shove im sure an old A100 will run crysis.

They don’t have video out ports!

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#453
post #425

Earlier quoted context omitted.

> the secondary market is still alive. this is the crux. Will these data center cards, if a newer model came out with better efficiency, have a secondary market to sell to? It could be that second hand ai hardware going into consumers' hands is how they offload it without huge losses.

Data centre cards a don’t have fans and don’t have video out these days.

i dont mean consumer market for video cards - i mean a consumer buying ai chips to run themselves so they can have it locally.

If i can buy a $10k ai card for less than $5000 dollars, i probably would, if i can use it to run an open model myself.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#454
post #24

As an elder millennial, I just don't know what to say. That a once in a generation allocation of capital should go towards...whatever this all will be, is certainly tragic given current state of the world and its problems. Can't help but see it as the latest in a lifelong series of baffling high stakes decisions of dubious social benefit that have necessarily global consequences.

Yes this capital allocation is a once in a lifetime opportunity to crate AGI that will solve diseases and poverty.

We have 8.3 billion examples of general intelligence alive on the planet right now.

Surely an artificial one in a data center, costing trillions and beholden to shareholders, will solve all society's issues!

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#455

Earlier quoted context omitted.

That would be true for general purpose servers. But what they want is lots of special purpose AI chips. While is still possible to use that for something else, it's very different from having a generic server farm.

I can't imagine everybody suddenly leaving AI like a broken toy and taking all special purpose AI chips offline. AI serves millions of people every day. It's here to stay even if it doesn't get any better than it is it already brings immense value to the users. It will keep being worth something.

Yes, it will be worth something. But when the value is less than its cost, you have a loss - and nobody runs a service at a loss.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#456

Earlier quoted context omitted.

What does that have to do with the current CEO's assessment of the situation?

[flagged]

The AI astroturfing campaign.

If you had billions to gain, would you invest a few 100k or millions in an astroturfing campaign?

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#457
post #62

I would add an addendum to this -- there is no way the announced spending on AI data centers will all come to fruition. I have no doubt that there will be a massive build-out of infrastructure, but it can't reach the levels that have been announced. The power requirements alone will stop that from happening.

[flagged]

me very smart. me go college get fancy paper. me move money out of ai stocks. flat rocks not think so well, use too much fire. me trade for shiny yellow rock instead.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#458

Earlier quoted context omitted.

I disagree on that and covered a lot of it in this blog (sorry for the plug!) https://martinalderson.com/posts/are-we-really-repeating-the...

100% of technical innovations have had the same pattern. The same thing happens every time because this is the only way the system can work: excess is required because there is some uncertainty, lots of companies are designing strategies to fill this gap, and if this gap didn't exist then there would be no investment (as happens in Europe). Also, demand wasn't over-estimated in the 2000s. This is all ex-post reasonin…

> Also, demand wasn't over-estimated in the 2000s. This is all ex-post reasoning you use data from 2002 to say...well, this ended up being wrong.

Well, the estimate was higher than the reality, by definition it was over-estimated. They built out as if the tech boom was going to go on forever, and of course it didn't. You can argue that they made the best estimates they could with the information available, but ultimately it's still true that their estimates were wrong.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#459

Earlier quoted context omitted.

Tokens are, roughly speaking, how you pay for AI. So you can approximate revenue by multiplying tokens per year by the revenue for a token. (6.29 10^16 tokens a year) * ($10 per 10^6 tokens) = $6.29 10^11 = $629,000,000,000 per year in revenue Per the article > "It's my view that there's no way you're going to get a return on that, because $8 trillion of capex means you need roughly $800 billion of profit just to pay…

The math here is mixing categories. The token calculation for a single 1-GW datacenter is fine, but then it gets compared to the entire industry’s projected $8T capex, which makes the conclusion meaningless. It’s like taking the annual revenue of one factory and using it to argue that an entire global build-out can’t be profitable. On top of that, the revenue estimate uses retail GPT-5.1 pricing, which is the absolut…

> but then it gets compared to the entire industry’s projected $8T capex, which makes the conclusion meaningless.

Aren't they comparing annual revenue to the annual interest you might have to pay on $8T? Which the original article estimates at $800B. That seems consistent.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#460
post #425
post #402

Earlier quoted context omitted.

How different is this from rental car companies changing over their fleets? I don't know, this is a genuine question. The cars cost 3-4x as much and last about 2x as far as I know, and the secondary market is still alive.

> the secondary market is still alive. this is the crux. Will these data center cards, if a newer model came out with better efficiency, have a secondary market to sell to? It could be that second hand ai hardware going into consumers' hands is how they offload it without huge losses.

[deleted]
Post reply on HN