Live data from Hacker News

OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

openai.com

71–80 of 668 posts

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#71
post #46
post #36

Earlier quoted context omitted.

Is it counting revenue multiple times? It's buying your own products really, but not sure how that counts as double counting revenue

Customer A pays you $100 for goods that cost you $10. You invest $100-$10=$90 in customer B so that they'll pay you $90 for goods that cost you $9. Your reported revenue is now $100+$90=$190, but the only money that entered the system is the original $100.

And your evaluation also rises as a consequence of your increased revenue.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#72
post #4

For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.

It's a ridiculous amount claimed for sure. If its 2 kW per it's around 5 million, and 1 to 2 kW is definitely the right ballpark at a system level.

The NVL72 is 72 chips is 120 kW total for the rack. If you throw in ~25 kW for cooling its pretty much exactly 2 kW each.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#74

Did I miss the part where they mention the 10 large nuclear plants needed to power this new operation? Where's all the power coming from for this?

Consumer electric grids.

Exactly this. This is essentially a new consumer tax in your electrical bill. The buildout of the electrical grid is being put on consumers essentially as a monthly tax with the increase in electrical costs. Everyone in the country is paying for the grid infrastructure to power these data centers owned by trillion dollar companies who aren't paying for their needs.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#77

Earlier quoted context omitted.

Build this thing in the middle of the desert and you would need around 100 sq mile of solar panels + a fuck load of batteries for it to be energy independent. The solar farm would be around $10 billion which is probably far less than the gpus cost

[flagged]

[dead]

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#78

Earlier quoted context omitted.

Build this thing in the middle of the desert and you would need around 100 sq mile of solar panels + a fuck load of batteries for it to be energy independent. The solar farm would be around $10 billion which is probably far less than the gpus cost

[flagged]

Environmentalists are just against progress. A few desert species going extinct is not a big deal. It's an arid wasteland. When we eventually terraform it (with desalinated water from solar / fusion) those species are going to die out anyway.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#79
post #4

For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.

Safely in "millions of devices." The exact number depends on assumptions you make regarding all the supporting stuff, because typically the accelerators consume only a fraction of total power requirement. Even so, millions.

"GPUs per user" would be an interesting metric.

(Quick, inaccurate googling) says there will be "well over 1 million GPUs" by end of the year. With ~800 million users, that's 1 NVIDIA GPU per 800 people. If you estimate people are actively using ChatGPT 5% of the day (1.2 hours a day), you could say there's 1 GPU per 40 people in active use. Assuming consistent and even usage patterns.

That back of the envelope math isn't accurate, but interesting in the context of understanding just how much compute ChatGPT requires to operate.

Edit: I asked ChatGPT how many GPUs per user, and it spit out a bunch of calculations that estimates 1 GPU per ~3 concurrent users. Would love to see a more thorough/accurate break down.

Post reply on HN