Live data from Hacker News

OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

openai.com

381–390 of 668 posts

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#381
post #119

Earlier quoted context omitted.

They would build their own power lines / grid if they could.

No thanks, I'll just take subsidies to my bill.

Well, I suggest you go into politics and do something about it rather than be pointlessly smug on the internet.

If you're actually interested, the reason it's important to build out the grid even more instead of "subsidizing" is because the current grid can't handle renewables well which we need to improve if we want to use sustainable energy.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#382
post #194

If I had shovels to sell, I'd definitely announce a strategic partnership to have a huge quarry dug by hand. Seriously, is there anyone in the media keeping unbiased tabs on how much we're spending on summarizing emails and making creatives starve a little more?

Ed Zitron is an AI skeptic from the market perspective, highly recommend his stuff. It’s definitely not comforting to read, but he’s doing the math behind these headlines and it’s not adding up at all[0] 0: https://www.wheresyoured.at/

Yeah, I pretty much agree with what he's been doing. But he's not what the average person would call 'media,' so his reach is severely limited.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#383
post #305

Earlier quoted context omitted.

They're doing about a billion per month in revenue by running proprietary models on GPUs like these. Unless they're selling inference with zero/negative margin, it seems like a business model that could be made profitable very easily.

Revenue != profit, and you don't need to become net negative margin to be net unprofitable. Expensive researchers, expensive engineers, expensive capex, etc. Inference has extremely different unit economics from a typical SaaS like Salesforce or adtech like google or facebook.

> Revenue != profit

Indeed. And even if that revenue is net profitable right now (and analysts differ sharply on whether it really is), is there a sustainable moat that'll keep fast-followers from replicating most of OpenAI's product value at lower cost? History is littered with first-movers who planted the crop only to see new competitors feast on the fruit.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#384

Earlier quoted context omitted.

Wtf, and this is from 1 company How many atrophic,xAi,google,Microsoft would be???? having around 5% entire country infrastructure on AI hardware seems excessive no???

Around 5% in the next 5 years for AI alone sounds pretty in-line with projections I've seen.

Isn't this pretty bad for the climate? I don't dare to ask ChatGPT now /S

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#385
post #4

For someone who doesn't know what a gigawat worth of Nvidia systems is, how many high-end H100 or whatever does this get you? My estimates along with some poor-grade GPT research leads me to think it could be nearly 10 million? That does seem insane.

You could think of it as "as much power as is used by NYC and Chicago combined". Which is fucking insanely wasteful.

Do you think the existence of NYC and Chicago is insanely wasteful?

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#386

Earlier quoted context omitted.

[flagged]

100 square miles is small in the American southwest. And a solar farm would disrupt the ecosystem much less than many other land uses. Adding shade and cover will benefit many species.

A few nuclear power plants have a much smaller environmental impact.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#387
Where does this fit in with the $300 billion partnership between OpenAI and Oracle? You know, the one that also hasn't happened yet and catapulted Oracle's stock price through the stratosphere last week? Is that also getting built or is OpenAI partnering with Nvidia to get access to the GPUs that neither they nor Oracle currently own?

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#389

Framing it in gigawatts is very interesting given the controversy about skyrocketing electric prices for residential and small business users as a result of datacenters over the past three years, primarily driven by AI growth. If, as another commenter notes, this 10GW is how much Chicago and NYC use combined , then we need to have a serious discussion about where this power is going to come from given the dismal stat…

I actually don’t like this measurement, as it’s vague and dilutes the announcement. Each product has a different efficiency of watts.

Imagine Ford announced “a strategic partnership with FedEx to deploy 10 giga-gallons of ICE vehicles”

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#390
post #375

Stating compute scale in terms of power consumption is such a backwards metric to me, assuming that you're trying to portray is as something positive. It's like selling steel by the average fractional number of mining deaths that went into producing it. Sure, at a given moment there will be some ratio between average deaths and steel, but that's a number that you want to be as low as possible.

Stating compute scale in terms of power consumption is exactly how one looks at data centers or capacity planning right now though. It's the major constraint.

It's just a different abstraction level.

Post reply on HN