Live data from Hacker News

Hyperscalers have already outspent most famous US megaprojects

twitter.com

211–220 of 296 posts

Re: Hyperscalers have already outspent most famous US megaprojects

#211
post #202

Earlier quoted context omitted.

> What other uses do GPU's have that are critical...? lol GPUs are essential to every kind of scientific and engineering simulation you can think of. AI-accelerated simulations are a huge deal now.

GPUs that have lives of..? Now compare that with the life a rail road. Amusing.

Some of those railroad bridges might never have been constructed without those simulations.

Re: Hyperscalers have already outspent most famous US megaprojects

#212

Earlier quoted context omitted.

So your argument basically boils down to, the datacenter build out is not a waste of resources because if it was, these companies wouldn’t be building them. Got it.

I mean, your argument is that Google has had increasing revenue and profit for a decade, to the point that they have $400B in revenue + profit this year, and that they are going to lose money because they plan to spend $180B on capital projects for new data centers next year, because you know their business better than they do.

Argument from authority with a little whataboutism thrown in. I’m done wasting time with you.

Re: Hyperscalers have already outspent most famous US megaprojects

#213

Earlier quoted context omitted.

GPUs don't really have six year lifespans, though. The hardware itself lasts far longer than that, even hardware that's been used for cryptomining in terrible makeshift setups is absolutely fine for reuse.

Each of these GPUs pull up to a kilowatt of power. The average commercial power cost is 13.4 ¢/kWh. That means running a single H100 full tilt 24/7 is a power operationing cost of $1,100 per card per year. In three years the current generation of GPUs will be 50% or more faster. In six years your talking more than 100% faster. For the same energy costs. If you're running a GPU data center on six year old GPUs, your c…

One thing I am not entirely sure if there will be huge efficiency gains. Just looking at TDP that is the power consumption of say 3090 and 5090 and the increase is substantial then compare it to performance and the performance lift stops looking that great...

Re: Hyperscalers have already outspent most famous US megaprojects

#214
post #73
post #3

This tweet shows it as a percentage of US GDP: https://x.com/paulg/status/2045120274551423142 Makes it a little less dramatic. But also shows what a big **'n deal the railroads were!

GDP adjustments are warranted, but it is more stark than both the estimates suggest. The megaprojects of the previous generations all had decades long depreciation schedules. Many 50-100+ year old railways, bridges, tunnels or dams and other utilities are still in active use with only minimal maintenance Amortized Y-o-Y the current spends would dwarf everything at the reported depreciation schedule of 6(!) years for…

I think there's more nuance to it. The real asset is the models that are being created.

Imagine this world: the bubble "pops" in a couple years. The GPUs stick around for a few more years after that. At the end, we pretty much don't train new foundation models anymore - no one wants to spend the money on the hardware needed to make a real advance.

People continue to refine, distill, and optimize the existing foundation models for the next century or two, just like people keep laying new track over old railway right of ways.

Re: Hyperscalers have already outspent most famous US megaprojects

#215
post #159

Earlier quoted context omitted.

European railroad bubble failed? Can you explain that? I really have no idea what you are referring to?

The search term is the "Railway Mania", which predominant describes the UK's railroad bubble, with smaller similar booms on mainland europe. (You will have to look up French and German sources for the best info on those) The bubble failed in the sense that massive commitments for new railways were made, and then the 1847 economic crisis caused investment to dry up, which collapsed the bubble and put a halt to the rai…

This is actually an interesting piece of history I haven't heard about. Thanks for the pointers

Re: Hyperscalers have already outspent most famous US megaprojects

#216

Earlier quoted context omitted.

Personalized medical treatment looks like the most promising candidate so far, would that do it for you?

What exactly does “personalized medical treatment” entail? Writing prescriptions? Ok, I can see how AI could theoretically do that (assuming it doesn’t hallucinate and kill a bunch of people). Oh and don’t think it’ll be so easy to give AI the legal authority to prescribe controlled substances. And insurance companies may take issue with expensive prescriptions written by a chat bot. Perform surgeries? Stitch wounds?…

maybe he's referring to people doing research on their own variant of disease through LLMs to find cures

Re: Hyperscalers have already outspent most famous US megaprojects

#217
post #45

Earlier quoted context omitted.

The railroads and the interstate are arguably the biggest and broadest impact, especially in 2nd order effects (everything West of the Mississippi would be vastly different economically without them). I am not an ai-booster, but I would not be surprised at AI having a similar enabling effect over the long term. My caveat being that I am not sure the massive data center race going on right now will be what makes it ha…

I agree that AI will probably have bigger effects that we could possibly predict right now. But unlike past booms/bubbles, I suspect the infrastructure being built now won't be useful after it resolves. The railroads, interstate system, and dotcom fiber buildout are all still useful. AI will need to get more efficient to be useful as established technology, so the huge datacenters will be overbuilt. And almost none o…

Early railroads didn't have a lot of standardization, so plenty of that investment did get deprecated

Re: Hyperscalers have already outspent most famous US megaprojects

#218

Earlier quoted context omitted.

I just don’t see it. Both professionally and personally I’m producing so much more now. Back burner projects that weren’t worth months of my time are easily worth a few hours and $20 or whatever. Why would I pull back?

You're forgetting that the 20$ are not a sustainable price point. Would your backburner personal app thingy be worth 200$?

I’ve wondered about this too.

Perhaps if we used something exotic like solid gold cookware, there might be some amazing benefits that people would love.

But it would be far from practical without being wildly subsidized…

With AI, it feels too much like the “grownups” are acting worse than the kids…

Re: Hyperscalers have already outspent most famous US megaprojects

#219
post #216

Earlier quoted context omitted.

What exactly does “personalized medical treatment” entail? Writing prescriptions? Ok, I can see how AI could theoretically do that (assuming it doesn’t hallucinate and kill a bunch of people). Oh and don’t think it’ll be so easy to give AI the legal authority to prescribe controlled substances. And insurance companies may take issue with expensive prescriptions written by a chat bot. Perform surgeries? Stitch wounds?…

maybe he's referring to people doing research on their own variant of disease through LLMs to find cures

That’s fine and dandy but it won’t do anything for most people with serious health problems.

Re: Hyperscalers have already outspent most famous US megaprojects

#220
post #78

Earlier quoted context omitted.

We could have had non-carbon energy independence by now.

But the AI fanatics claimed that AI would solve cold fusion, making that whole thing moot. The only problem is, if AI doesn’t solve cold fusion, we’re back to square one. And a few trillion dollars in the hole.

There’s a joke that in a couple of years, after spending trillions of dollars, burning mountains of coal to run country-sized datacenters and boiling all the oceans, we finally achieve AGI.

Then the first question we ask it is: 'How do we fix climate change?' And it answers: 'you can start by unplugging me'

Post reply on HN