Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

openai.com

Post reply on HN
Print view View original

481–490 of 668 posts

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#481

Post by whatever1 »

ComputerGuru wrote: post #371

Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…

DCs need to align their training cycles with the peak of renewable power generation

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#482

Post by typpilol »

OtherShrezzing wrote: post #321
jlokier wrote: post #203

onlyrealcuzzo wrote: > Google is pretty useful. It uses 15 TWh per year. 15TWh per year is about 1.7GW. Assuming the above figures, that means OpenAI and Nvidia new plan will consume about 5.8 Googles worth of power, by itself. At that scale, there's a huge opportunity for ultra-low-power AI compute chips (compared with current GPUs), and right now there are several very promising technology pathways to it.

This one datacenter should be able to perform a 51% attack on any of the big cryptocurrencies with that much compute. An interesting hedge in case the AI bubble pops.

Someone did the math above and said all of it would only be about 0.05 percent for Bitcoin.

I'm not sure about the GPU pow coins though

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#483

Post by kulahan »

elbasti wrote: post #403
ComputerGuru wrote: post #371

Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…

I work in the datacenter space. The power consumption of a data center is the "canonical" way to describe their size. Almost every component in a datacenter is upgradeable—in fact, the compute itself only has a lifespan of ~5 years—but the power requirements are basically locked-in. A 200MW data center will always be a 200MW data center, even though the flops it computes will increase. The fact that we use this unit…

That's pretty interesting. Is it just because the power channels are the most fundamental aspect of the building? I'm sorta surprised you can't rip out old cables and drop in new ones, or something to that effect, but I also know NOTHING about electricity.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#484

Post by typpilol »

aurareturn wrote: post #454
OtherShrezzing wrote: post #321

Earlier quoted context omitted.

This one datacenter should be able to perform a 51% attack on any of the big cryptocurrencies with that much compute. An interesting hedge in case the AI bubble pops.

You're downvoted but it's a real threat. Imagine hackers or state sponsored entities use one of these mega data centers to destroy a few cryptocurrencies.

They are nothing compared to BTC Asics

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#485

Post by sedawkgrep »

leetharris wrote: post #16
gmm1990 wrote: post #5

Strange unit of measurement. Who would find that more useful than expected compute or even just the number of chips.

Probably because you can't reliably predict how much compute this will lead to. Power generation is probably the limiting factor in intelligence explosion.

That, and compute always goes up.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#486

Post by jacquesm »

elbasti wrote: post #403
ComputerGuru wrote: post #371

Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…

I work in the datacenter space. The power consumption of a data center is the "canonical" way to describe their size. Almost every component in a datacenter is upgradeable—in fact, the compute itself only has a lifespan of ~5 years—but the power requirements are basically locked-in. A 200MW data center will always be a 200MW data center, even though the flops it computes will increase. The fact that we use this unit…

It is the opposite of refining energy. Electrical energy is steak, what leaves the datacenter is heat, the lowest form of energy that we might still have a use for in that concentration (but most likely we are just dumping it in the atmosphere).

Refining is taking a lower quality energy source and turning it into a higher quality one.

What you could argue is that it adds value to bits. But the bits themselves, their state is what matters, not the energy that transports them.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#487

Post by basilgohar »

dantillberg wrote: post #475
ComputerGuru wrote: post #371

Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…

Prices of _everything_ went up over the past five years. Datacenter expansion was far from the main driver. Dollars and cents aren't worth what they used to be.

Elsewhere it was mentioned that DCs pay less for electricity per Wh than residential customers. If that is the case, then it's not just about inflation, but also unfair pricing putting more of the infrastructure costs on residential customers whereas the demand increase is coming from commercial ones.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#488

Post by [deleted] »

skhameneh wrote: post #13
ddtaylor wrote: post #4

For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.

Before reading your comment I did some napkin math using 600W per GPU: 10,000,000,000 / 600 = 16,666,666.66... With varying consumption/TDP, could be significantly more, could be significantly less, but at least it gives a starting figure. This doesn't account for overhead like energy losses, burst/nominal/sustained, system overhead, and heat removal.

[deleted]

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#489

Post by justincormack »

whatever1 wrote: post #481
ComputerGuru wrote: post #371

Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…

DCs need to align their training cycles with the peak of renewable power generation

They are starting to include batteries so they dont have to adjust to external factors

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#490

Post by apimade »

ComputerGuru wrote: post #371

Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…

An 8% increase y/o/y is quite substantial, however keep in mind globally we experienced the 2022 fuel shock. In Australia for example we saw energy prices double that year.

Although wholesale electricity prices show double-digit average year-on-year swings, their true long-run growth is closer to ~6% per year, slightly above wages at ~4% during the same period.

So power has become somewhat less affordable, but still remains a small share of household income. In other words, wage growth has absorbed much of the real impact, and power prices are still a fraction of household income.

You can make it sound shocking with statements like “In 1999, a household’s wholesale power cost was about $150 a year, in 2022, that same household would be charged more than $1,000, even as wages only grew 2.5x”, but the real impact (on average, obviously there are outliers and low income households are disproportionately impacted in areas where gov doesn’t subsidise) isn’t major.

https://www.aer.gov.au/industry/registers/charts/annual-volu...

Post reply on HN