For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.
Before reading your comment I did some napkin math using 600W per GPU: 10,000,000,000 / 600 = 16,666,666.66... With varying consumption/TDP, could be significantly more, could be significantly less, but at least it gives a starting figure. This doesn't account for overhead like energy losses, burst/nominal/sustained, system overhead, and heat removal.
OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
111–120 of 668 posts
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#112For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#113Strange unit of measurement. Who would find that more useful than expected compute or even just the number of chips.
It's a very useful reference point actually because once you hit 1.21 GW the AI model begins to learn at a geometric rate and we finally get to real AGI. Last I've heard this was rumored as a prediction for AI 2027, so we're almost there already.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#114Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#115For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.
How much cable (and what kind) to connect them all? That number would be 100x the number of gpus. I would think they just clip on metal racks no cables but then I saw the xai data center that can blue wire cables everywhere
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#116Wouldn't Nvidia be better served investing the $100B in expanding GPU manufacturing capacity?
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#117In accounting terms, this is a shady business practice known as "round tripping" where you invest in a company for the sole purpose of them buying your product. It allows you to count your revenue multiple times.
Microsoft and Google have been doing it for decades. Probably, MS started that practice.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#118This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#119Can we get some laws to force these companies to start subsidizing the consumer grids they're pummeling? The electric bills are getting out of hand.