Live data from Hacker News

OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

openai.com

261–270 of 668 posts

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#261

Earlier quoted context omitted.

You could think of it as "as much power as is used by NYC and Chicago combined". Which is fucking insanely wasteful.

I mean if 10GW of GPUs gets us AGI and we cure cancer than that's cool, but I do get the feeling we're just getting uncannier chatbots and fully automated tiktok influencers

Current llms are just like farms. Instead of tomatoes by the pound you buy tokens by the pound. So it depends on the customers.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#263
post #108

This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…

But real GPUs are being built, installed and used. It's not paper money, it's just buying goods and services partly with stock. Which is a very solid and time honored tradition which happens to align incentives very well.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#264
post #242

To put this into perspective this datacenter would have the land area of Monaco (740 acres) given assumptions of a 80kW/rack per case.

Monaco is so tiny it fits into Berlin's Tempelhofer Feld (a circular park inside the city).

I mean, you're not wrong, but Tempelhofer is also a former airport, so had to be quite big. And since Brexit, Berlin is the biggest city in the EU.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#265

Earlier quoted context omitted.

> Almost every model trained by the majors has paid for itself with inference fees. Even if we assume this is true, the downstream customers paying for that inference also need it to pay for itself on average in order for the upstream model training to be sustainable, otherwise the demand for inference will dry up when the music stops. There won't always be a parade of over-funded AI startups burning $10 worth of tok…

My employer spends $100k/month or more on OpenAI fees. Money well spent, in both product features and developer process. This is just one fairly small random startup. Thousands of companies are spending this money and making more money because of it.

Curious what makes you think the money is well spent.

I can maybe digest the fact that it helped prototype and ship a bit more code in a shorter time frame... but does that warrant in enough new customers or a higher value product that would justify $100k a month?!

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#266
post #192

Earlier quoted context omitted.

Power generation is not a monolithic enterprise. If more supply is built than needed, certain suppliers will go bankrupt.

They may, but that doesn’t mean that the capacity disappears. It may require some assumptions about USG willingness to backstop an acquisition but it’s not a significant leap to think that the generation capacity remains in (more capable?) hands.

Speaking of capacity, what happened to all the "dark fiber" that was supposedly built for Internet 2 or whatever? The fiber doesn't go away just because a bubble burst, right?

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#267
post #108

This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…

Well I hope it crashes so we can get back to normalized GPU prices.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#268
post #108

This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…

I agree that it is a bubble.

But the "round tripping" kind of makes sense. OpenAI is not listed, but if it was, some of the AI investment money would flow to it. So now, if you are an AI believer, NVidia is allocating some of that money for you.

Re: OpenAI and Nvidia announce partnership to deploy 10GW of Nvidia systems

#269
post #108

This is throwing more cards on the house of cards. Nvidia is “investing” in OpenAI so OpenAI can buy GPUs from NVidia. Textbook “round tripping.” I generally like what’s been happening with AI but man this is gonna crash hard when reality sets in. We’re reaching the scary stage of a bubble where folks are forced to throw more and more cash on the fire to keep it going with no clear path to ever get that cash back. If…

Going to leave this link here: https://www.hussmanfunds.com/comment/mc250814/

By many different measures, we are at record valuations (though must be said, not P/E however). Tends not to end well. And housing prices are based on when mortgages were at 3% and have not reset accordingly. We are in everything bubble territory and have been.

Post reply on HN