Live data from Hacker News

Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

tomshardware.com

151–160 of 182 posts

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#151
post #144
post #135

Earlier quoted context omitted.

Does that come with the model weights? Not really relevant then to their announced products is it?

What model weights is the Google's A3 supercomputer supposed to come with? It's an announcement of new hardware available in GCP.

Sorry got mixed up with a conversation in a different thread more specifically about the wait-lists around palm.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#152
post #122

Earlier quoted context omitted.

It is unknown how much pricing power NVDA has. Can they 3x the price of everything And still sell out?

Why not? They seem to be a lot of leeway before any specific company will find it cheaper to design their own chips, or even to move to AMD (ROCm is not as well supported). Perhaps someone like OpenAI has both the expertise and incentive to do so, but not many others.

So if you think that maybe OpenAI has other options if NVDA increases their prices why do you think that one of the other big names ( MSFT,GOOG,IBM,TSLA,AMD,INTC,Facebook ) also cannot do the same thing?

I'm not saying you are wrong or right, btw

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#153

Earlier quoted context omitted.

I wish that humanity gets to harvest static energy one day, so that everyone is able to run the experiments required in large-scale deep learning research, not only a handful of deep pocketed organizations.

You likely would not want to live in a future where every individual could each 'harvest' several gigajoules of 'static energy'.

Cue calls to reclassify balloons as assault weapons. /s

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#154
post #121

Earlier quoted context omitted.

A significant part of the 2021 peak may be explained by the crypto craze from which Nvidia benefited greatly and which has almost completely vanished since. Thinking about it, it’s hard to believe how fast the hype cycle moved on from crypto. Only 1-2 years ago every media person, influencer, YouTuber, tweeter etc. were talking about/selling/shilling some kind of crypto, and now all of it seems to have moved on to AG…

Cryptocurrencies still had high barriers for entry for the public at large - not really a means of payment, and high risk as an investment. Generative AI is used by millions, has very low barrier for entry (it's even free!) and most importantly does not require a network effect so can be valuable immediately.

> …and high risk as an investment.

Surprisingly, they left that out of their sales pitch.

With LLMs everyone+dog is coming out of the woodwork to let people know that it will lead to the extinction of the species.

Not that I don’t think generative AI is a lot more useful than crypto and deserves (some of) the hype. The problem is the hucksters jumping on the hypetrain to continue their $new_hotness grift.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#155
post #97

Earlier quoted context omitted.

It's more than just that: for the money, their consumer GPUs don't compete in compute tasks (especially inference/training) and their Linux compute drivers are a pile of steaming garbage on consumer hardware. It's really interesting/depressing to watch as they've done a nice job of supplying good open source graphics drivers. They really seem to be lacking something at a leadership level in terms of understanding GPU…

I'd think their leadership is aware. Likely they are just picking their battles to be in strategic areas where they'll capture the most revenue to resource-investment. AMD has a lot of catching up to do and they cannot compete on all fronts at once.

You'd think so, but they're not acting like it.

Usually when I see this, it symptomatic of major organizational dysfunction of some type. One time, I was in a firm where 100% of the energy was spent on quarterly objectives for some executive bonus pay structure. No one cared if the organization lived or died, since there were always other jobs.

Nothing AMD is doing in the GPU space is aligned with long-term survival or competitiveness.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#156

Earlier quoted context omitted.

Gaming is a huge chunk of their revenue, around $2B in recent quarters, with datacenter around $3.5B. Despite the AI hype, Nvidia’s datacenter revenue was down QoQ and only up 10% YoY. It remains to be seen if the growth trajectory has changed meaningfully over the last quarter, because the stock is priced for massive earnings growth while their revenue and earnings have been actually shrinking. We’ll find out on the…

>Gaming is a huge chunk of their revenue, around $2B in recent quarters, with datacenter around $3.5B. Is it? I remember hearing they didn't make much money from their consumer GPU products a few years back. This was one of the reasons why they tried to clamp down so aggressively on people using desktop GPUs for computing. They had made a number of driver changes which restricted the capabilities of anything but the…

IIRC they did that because the crypto miners were buying them all up and they wanted normal folks to be able to buy them too.

Not that big of a deal these days and I doubt they’d make it so someone couldn’t take an off the shelf GPU and play around with llamas.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#157
post #87
post #56

Earlier quoted context omitted.

The word TPU isn't even mentioned here. A sentence that reads "I am going to eat nothing but vegetables from now on" doesn't mention meat, but you can infer that I won't eat meat again from the sentence. A sentence that says Google are going all in on nVidea GPUs for AI doesn't need to mention TPUs to convey information about their future either.

Sure. That's why I mentioned multiple ways in which the article could have been relevant to TPUs, which you chose not to quote. But it didn't have any of those either. The sentence you're offering up as a demonstration is just something you made up that does not appear in the article. If anything, this just reinforces the point I was making. There is nothing at all in the article supporting this narrative. So, where…

The comment quoted you, then made an analogy. Where is the fabrication?

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#158
post #81

Earlier quoted context omitted.

After the big hype of it yes. And the models are not really available, they've got a little playground for some unspecified model.

There are models available in GCP under Vertex AI category, I'm using the API to access them.

Palm 2 is available?

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#159
post #26
post #9

Kinda feels like the main thing google launches is waiting lists.

And my main worry is: are they just going to cancel the new thing that my company invested six months and $250,000 of engineering time integrating with…

No, not for GCP stuff.

I don't know of a single GCP product that's been shut down, although I could be missing something. But their track record for GCP is, I think, what you would want a cloud provider's record to be.

(I should mention that I work for GCP. But this is just based on my own memory.)

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#160
post #104

Earlier quoted context omitted.

Whereas NVIDIA is basically just “we’re an AI company now”.

No, they've become a general compute company selling pickaxes for whatever the current goldrush tends to be. Now it's AI, yesterday it was crypo-currencies, the day before is was PC games and video editing. They've been trying to push their GPUs as CPU alternatives everywhere especially in the datacenters where their presence grew since the acquisition of Mellanox. They also tried to acquire ARM, to squeeze both Inte…

I mean their public messaging is pure AI now, but I also think they have been very smart about running the right direction since Alexnet came out and showed what you could do with a GPU.
Post reply on HN