Waiting patiently for the Ed Zitron article on this...
OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
521–530 of 668 posts
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#522Earlier quoted context omitted.
I'm also wondering what kind of threat this could be to PoW blockchains.
Literally none at all because asic
What happens if AI doesn't pay off before the GPUs wear out or are in need of replacement?
So at that point a DC replaces them all with ASICs instead?
Or if they just feel like doing that any time.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#523Earlier quoted context omitted.
> The bubble is that Nvidia got that money from its crazy high stock price, This is totally False, NVDA has not done any stock offerings. The money is coming from the ungodly amount of GPUs they are selling. In fact they are doing the opposite, they are buying back their stock because they have more money that they know what to do with.
A company buys back its stock if it thinks the stock is underpriced. Otherwise when “you have more money than you know what to with” you give it to your shareholders via a dividend. A concept mostly forgotten by tech companies.
A company buys back stock because distributing dividends incurs a 30% withholding tax.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#524Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…
0,19 per kwh. Damn man, here it is like 0,97 per kwh (Western Europe) … stop complaining
[deleted]
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#525Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…
0,19 per kwh. Damn man, here it is like 0,97 per kwh (Western Europe) … stop complaining
Regulated price in France:
- 0,1952 per kWh for uniform price.
- 0,1635 / 0,2081 for day/nigh pricing
- 0,1232 /... / 0,6468 for variable pricing
https://particulier.edf.fr/content/dam/2-Actifs/Documents/Of...
You have a very bad deal if you pay 0.97€ per kWh.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#526Earlier quoted context omitted.
It's 100% plausible and believable that there's going to be a spectacular bubble popping, but saying we are way past peak LLM would be like saying we were way past peak internet in 1999-2001 -- in reality, we weren't even remotely close to peak internet (and possibly still aren't). In fact, we were so far from the peak in 2001 that entire technological revolutions occurred many years later (e.g., smartphones) that ju…
[flagged]
[deleted]
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#527Earlier quoted context omitted.
I think you're pushing the metaphor a bit far, but the parallel was to something like ore. A power plant "mines" electron, which the data center then refines into words. or whatever. The point is that energy is the raw material that flows into data centers.
Maybe more like converting energy to data, as a more specific type of refinement.
Using energy to decrease the entropy of data. Or to organize and structure data.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#528Earlier quoted context omitted.
This. A local to me ~40W datacenter used to be in really high demand, and despite having excess rack space, had no excess power. It was crazy.
40W - is that ant datacenter? :)
Yeah, it was the companies pilot site, and everything about it is tiny.
But it very quickly became the best place in town for carrier interconnection. So every carrier wanted in.
Even when bigger local DC's went in, a lot of what they were doing was just landing virtual cross connects to the tiny one, because thats where everyone was.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#529Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…
> is neither fair nor sustainable
That's half what I pay in Italy, I'm sure the richest country in the world will do fine.
Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems
#530Earlier quoted context omitted.
I work in the datacenter space. The power consumption of a data center is the "canonical" way to describe their size. Almost every component in a datacenter is upgradeable—in fact, the compute itself only has a lifespan of ~5 years—but the power requirements are basically locked-in. A 200MW data center will always be a 200MW data center, even though the flops it computes will increase. The fact that we use this unit…
A 200MW data center will always be a 200MW data center, even though the flops it computes will increase. This here underscores how important TSMC's upcoming N2 node is. It only increases chip density by ~1.15x (very small relative to previous nodes advancements) but it uses 36% less energy at the same speed as N3 or 18% faster than N3 at the same energy. It's coming at the right time for AI chips used by consumers an…
> N2 is shaping up to be TSMC's most important node since N7
Is it?
N2, from an energy & perf improvement seems on par with any generation node update.
N2:N3 N3:N5 N5:N7
Power ~30% ~30% ~30%
Perf ~15% ~15% ~15%