Live data from Hacker News

OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

openai.com

11–20 of 668 posts

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#12
> Strategic partnership enables OpenAI to build and deploy at least 10 gigawatts of AI datacenters with NVIDIA systems representing millions of GPUs

I know watts but I really can’t quantify this. How much of Nvidia is there in the amount of servers that consume 10GW? Do they all use the same chip? What if there is newer chip that consumes less, does the deal imply more servers? Did GPT write this post?

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#13
post #4

For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.

Before reading your comment I did some napkin math using 600W per GPU: 10,000,000,000 / 600 = 16,666,666.66...

With varying consumption/TDP, could be significantly more, could be significantly less, but at least it gives a starting figure. This doesn't account for overhead like energy losses, burst/nominal/sustained, system overhead, and heat removal.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#14
post #5

Strange unit of measurement. Who would find that more useful than expected compute or even just the number of chips.

A point of reference is that the recently announced OpenAI-Oracle deal mentioned 4.5 GW. So this deal is more than twice as big.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#15
post #3

So OpenAI is breaking up with Microsoft and Azure?

It was more like Microsoft refused to build the capacity OpenAI was asking for, so they gave them blessing to buy additional compute from others.

It does seem like Satya believes models will get commoditized, so no need to hitch themselves with OpenAI that strongly.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#16
post #5

Strange unit of measurement. Who would find that more useful than expected compute or even just the number of chips.

Probably because you can't reliably predict how much compute this will lead to. Power generation is probably the limiting factor in intelligence explosion.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#17
post #5

Strange unit of measurement. Who would find that more useful than expected compute or even just the number of chips.

I wouldn't be surprised if power consumption is a starting point due to things like permitting and initial load planning.

I imagine this as a subtractive process starting with the maximum energy window.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#19
post #10

What does this mean? "To support the partnership, NVIDIA intends to invest up to $100 billion in OpenAI progressively as each gigawatt is deployed."

That they will invest 10$ in OpenAI for each W of NVIDIA chips that is deployed? EDIT: In steps of 1GW it seems.
Post reply on HN