To put this into perspective this datacenter would have the land area of Monaco (740 acres) given assumptions of a 80kW/rack per case.
So, basically a single BYD factory
OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
181–190 of 668 posts
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#182Earlier quoted context omitted.
What is this a bubble on? What does said bubble collapsing look like?
Nvidia is giving OpenAi money (through investment) to buy Nvidia chips. The bubble is that Nvidia got that money from its crazy high stock price, the extra investment raises OpenAi’s evaluation and the increased sells raises Nvidia’s evaluation. If the valuations see a correction then spending like this will decrease, further decreasing valuations. Bubble collapsing looks like enshittification of OpenAI tools as they…
> Bubble collapsing looks like enshittification of OpenAI tools as they try to raise revenues
Why does monetizing OpenAI tools lead to bubble collapse? People are clearly willing to pay for LLMs
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#183Earlier quoted context omitted.
High end server gpus and AI roi expectations.
I think everyone is underestimating the advancements in wafer tech and server compute over the last decade. Easy to miss when it’s out of sight out of mind but this isn’t going anywhere but up. The current SOTA is going to pale in comparison to what we have 10 years from now.
> I think everyone is underestimating the advancements in wafer tech and server compute over the last decade.
What advancements?
We have done a fabulous job at lowering power consumption while exponentially increasing density of cores and to a lesser extent transistors.
Delivering power to data centers was becoming a problem 20 ish years ago. Today Power density and heat generation are off the charts. Most data center owners are lowering per rack system density to deal with the "problem".
There are literal projects pushing not only water cooling but refrigerant in the rack systems, in an attempt to get cooling to keep up with everything else.
The dot com boom and then Web 2.0 were fueled by Mores law, by Clock doubling and then the initial wave of core density. We have run out of all of those tricks. The new steps that were putting out have increased core densities but not lowered costs (because yields have been abysmal). Look at Nvidia's latests cores, They simply are not that much better in terms of real performance when compared to previous generations. If the 60 series shows the same slack gains then hardware isnt going to come along to bail out AI --- that continues to demand MORE compute cycles (tokens on thinking anyone) rather than less with each generation.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#184This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…
The real question is not whether this is a bubble since as you mentioned even if AI settles into a somewhat useful semi-mainstream tech, there is no way any of the likely outcomes can justify this level of investment. The real question is what are we gonna do with all this cheap GPU compute when the bubble pops! Will high def game streaming finally have its time to shine? Will VFX outsource all of its render to the c…
Ai is already in semi-useful mainstream tech. There's a massive misunderstanding on this site (and other neo luddite sites) that somehow there is no "long tail" of business applications being transformed into ai applications.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#185Earlier quoted context omitted.
I do not think the leveraging is going to end there. I suspect this will be used to justify/secure power generation investments, possibly even nuclear. Likely via one or more of the OpenAI/Altman adjacent power startups.
On the bright side, if lots of power capacity is added and most of the GPUs end up idle, then there might be cheap power available for other uses.
Not if Ellison trickles it out for maximum profit.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#186Where is Apple? Even from an investment perspective.
My MacBook Pro runs local models better than anything else in the house and I have not yet needed to install a small nuclear reactor to run it, so, I feel like they're doing fine.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#187[deleted]
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#188Earlier quoted context omitted.
You could think of it as "as much power as is used by NYC and Chicago combined". Which is fucking insanely wasteful.
I dunno. Google is pretty useful. It uses >15 TWh per year. Theoretically, AI could be more useful than that. Theoretically, in the future, it could be the same amount of useful (or much more) with substantially less power usage. It could be a short-term crunch to pull-forward (slightly) AI advancements. Additionally, I'm extremely skeptical they'll actually turn on this many chips using that much energy globally in…
For other readers: "15 Twh per year" is equivalent to 1.71 GW, 17.1% of the "10GW" number used to describe the deal.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#189Next Year: OpenAI announces it is seeking funding for a Dyson Sphere
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#190Earlier quoted context omitted.
On the bright side, if lots of power capacity is added and most of the GPUs end up idle, then there might be cheap power available for other uses.
Power generation is not a monolithic enterprise. If more supply is built than needed, certain suppliers will go bankrupt.
What are the chances suppliers will go bankrupt but the plants get sold and still produce power?