Live data from Hacker News

OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

openai.com

211–220 of 668 posts

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#211

For scale: The 1960's era US Navy submarine I served on had a 78MW reactor, so 10GW is 128 nuclear submarines

For a better sense of scale: it's about 2% of the average US electricity consumption, and about the same as the average electricity consumption of the Netherlands (18 million people)

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#212
post #158

Earlier quoted context omitted.

Some more context, Nuclear power stations can be up to 2GW, offshore windfarms are seemingly hitting a plateau at ~1.5GW, individual turbines in operations now are 15MW. Grids are already strained, 525kV DC systems can transmit ~2GW of power per cable bundle… Adding 10GW of offtake to any grid is going to cause significant problems and likely require CAPEX intensive upgrades (try buy 525kV dc cable from an establishe…

Yeah the path forward here is going to be Apple-like vertical supply chain integration. There is absolutely no spare capacity in the infra side of electrical right now, at least in the US.

I don’t think that’s possible with large scale power infrastructure, and specifically grid infrastructure is so tightly regulated. Closest that I’m aware of was TSMC buying the output of an entire offshore windfarm for 25yrs (largest power purchase contract ever - TSMC / Ørsted)… maybe Microsoft re starting nuclear power plants, or Google reporting offshore wind sites come out of contract (but nothing at the 10GW scale).

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#214
post #108

This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…

Does this mean they pay for it through consumer GPU sales?

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#215
post #108

This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…

Does anyone in the finance business know how legal this all it? I am hearing terms like "round tripping" being thrown around. A practice where a company sells and buys back its own product to artificially inflate revenue.

I'm asking because its not just OpenAI that they are apparently doing this with, instead its with multiple other major GPU providers, like Coreweave.

And its just being done all out in the open? How?

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#216
post #108

This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…

My thought is think of all the really cheap compute that will be available to researchers. Sure, it will crash but at the end of the day there will be a huge glut of gpus that datacenters will be trying to rent out near cost.

I (as a uninformed rando) think that there are a lot of research ideas that have not been fully explored because doing a small training run takes 100k. If that drops to 1000, then there is a lot more opportunities to try new techniques.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#217

Earlier quoted context omitted.

Almost every model trained by the majors has paid for itself with inference fees. I’m not saying there isn’t a bubble, but I am saying if the researchers and strategists absolutely closest to the “metal” of realtime frontier models are correct that AGI is in reach, then this isn’t a bubble, it’s a highly rational race. One that large players seem to be winning right now.

> Almost every model trained by the majors has paid for itself with inference fees. Even if we assume this is true, the downstream customers paying for that inference also need it to pay for itself on average in order for the upstream model training to be sustainable, otherwise the demand for inference will dry up when the music stops. There won't always be a parade of over-funded AI startups burning $10 worth of tok…

My employer spends $100k/month or more on OpenAI fees. Money well spent, in both product features and developer process. This is just one fairly small random startup. Thousands of companies are spending this money and making more money because of it.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#218

Waiting patiently for the Ed Zitron article on this...

He single-handedly cost people more than anyone with his bearish takes lol

Or he saved them more than anyone by limiting their losses when it does finally crash

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#219
post #168

In accounting terms, this is a shady business practice known as "round tripping" where you invest in a company for the sole purpose of them buying your product. It allows you to count your revenue multiple times.

I don't really understand how it is round tripping. In the end, Nvidia will have OpenAI shares, which are valuable, and OpenAI will have GPUs, which are also valuable. It is not fake revenue, the GPUs will be made, sold at market price, and used, they are not intended to be bought back and sold to another customer. And hopefully, these GPUs will be put to good use by OpenAI so that they can make a profit, which will…

If OpenAI doesn't pan out than Nvidia has worthless OpenAI stock and OpenAI has a pile of mostly useless GPUs.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#220

Earlier quoted context omitted.

Your question is weird. Solar does compete economically with methane already, and it's only going to improve even more.

If true, why aren't we mass scaling it all over the American West? We have railways running from West -> East, why not include power lines that can take power from energy farms in the West -> East? No major project in AZ, TX, or CA to give a city free power? etc

> We have railways running from West -> East, why not include power lines that can take power from energy farms in the West -> East?

Firstly, there is no such thing as an infinitely scaling system.

Secondly, because power transmission isn't moving freight. The infrastructure to move electricity long distances is extremely complicated. Even moving past basic challenges like transmission line resistance and voltage drop, power grids have to be synchronized in both phase and frequency. Phase instability is a real problem for transmission within hundreds of miles, let alone thousands upon thousands.

Also that infrastructure is quite a bit more expensive to build than rail or even roads, and it's very maintenance hungry. An express built piece of power transmission that goes direct from a desert solar farm to one of the coasts is just fragile centralization. You have a long chain of high-maintenance infrastructure, a single point of failure makes the whole thing useless. So instead you go through the national grid, and end up with nothing, because all of that power is getting sucked up by everyone between you and the solar farm. It probably doesn't even make it out of the state it's being generated in.

BTW the vast majority of the cost of electricity is in the infrastructure, not its generation. Even a nuclear reactor is cheap compared to a large grid. New York city's collection of transmission lines, transformers, etc. (not even any energy generation infrastructure, just transmission) ballparks a couple hundred billion dollars. Maintenance is complex and extremely dangerous, which means the labor is $$$$. That's what you're paying for. That's why as we continue to move towards renewables price/watt will continue to go up, even though we're not paying for the expensive fuel anymore. The actual ~$60 million worth of fuel an average natural gas plant burns in a year pales in comparison to the billions a city spends making sure the electrons are happy.

Post reply on HN