Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

tomshardware.com

Post reply on HN
Print view View original

171–180 of 182 posts

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#171

Post by EVa5I7bHFq9mnYK »

UncleEntity wrote: post #154
noogle wrote: post #121

Earlier quoted context omitted.

Cryptocurrencies still had high barriers for entry for the public at large - not really a means of payment, and high risk as an investment. Generative AI is used by millions, has very low barrier for entry (it's even free!) and most importantly does not require a network effect so can be valuable immediately.

> …and high risk as an investment. Surprisingly, they left that out of their sales pitch. With LLMs everyone+dog is coming out of the woodwork to let people know that it will lead to the extinction of the species. Not that I don’t think generative AI is a lot more useful than crypto and deserves (some of) the hype. The problem is the hucksters jumping on the hypetrain to continue their $new_hotness grift.

>> that it will lead to the extinction of the species

Interesting, the more they warn about it, the more people are eager to invest in it. Kind of a Streisand effect.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#172

Post by sfds »

roenxi wrote: post #141
blihp wrote: post #97

Earlier quoted context omitted.

It's more than just that: for the money, their consumer GPUs don't compete in compute tasks (especially inference/training) and their Linux compute drivers are a pile of steaming garbage on consumer hardware. It's really interesting/depressing to watch as they've done a nice job of supplying good open source graphics drivers. They really seem to be lacking something at a leadership level in terms of understanding GPU…

I think that is underselling the big, slow push of their heterogeneous compute architecture. I don't understand the things, but as far as I can read it they've got 3.6GFLOP [0] GPU on those things as of 2022. Nvidia are effortlessly crushing AMD right now and as far as I can tell it is because they implemented a bunch of BLAS functions on the GPU (it is weirdly difficult to get a good tutorial on how to do matrix mul…

> (it is weirdly difficult to get a good tutorial on how to do matrix multiplication on an AMD GPU; every so often I look for one and have I think literally never found an example).

There's some blogs on GPUOpen: MFMA on MI100/200 https://gpuopen.com/learn/amd-lab-notes/amd-lab-notes-matrix...

WMMA on Navi3 https://gpuopen.com/learn/wmma_on_rdna3/

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#173

Post by noogle »

faeriechangling wrote: post #126
noogle wrote: post #77

Should we buy Nvidia stock then? The greatest technological advancement in recent years critically depends on the hardware from a single company with no competition. yet Nvidia stock is still below its 2021 peak. How so?

Because making decisions on account of an asset's price being higher 2 years ago is just falling victim to price anchoring? Would Nvidia not be worth buying in 2020 because its price was much lower in 2018 and thus must be overvalued in 2020? Investments should be based on the actual value of the company relative to its price, as well as relative to other investment oppertunities. Trying to making a profit by trading…

That's a broader question, but in general: it doesn't matter what I think about Nvidia's business. I could be correct all the way, but if other people disagree with me, they won't pay me for the shares.

It's also not necessarily about the 2021 peak but why isn't Nvidia bigger? allegedly it's a necessary component to a technology that can replace hundreds of millions of people (worth trillions in economic output). And unlike OpenAI, Nvidia wins no matter which company wins the model competition.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#174

Post by noogle »

gitfan86 wrote: post #152
noogle wrote: post #122

Earlier quoted context omitted.

Why not? They seem to be a lot of leeway before any specific company will find it cheaper to design their own chips, or even to move to AMD (ROCm is not as well supported). Perhaps someone like OpenAI has both the expertise and incentive to do so, but not many others.

So if you think that maybe OpenAI has other options if NVDA increases their prices why do you think that one of the other big names ( MSFT,GOOG,IBM,TSLA,AMD,INTC,Facebook ) also cannot do the same thing? I'm not saying you are wrong or right, btw

I guess for the same reason most of them keep buying from Intel - their market position allows them to pass on the cost to their customers, so it's not worth the distraction.

OpenAI is more of a "one-(very impressive)-trick-pony", so they have a stronger incentive.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#175

Post by verdverm »

ralusek wrote: post #158
verdverm wrote: post #110

Earlier quoted context omitted.

There are models available in GCP under Vertex AI category, I'm using the API to access them.

Palm 2 is available?

yes, it's powering Bard and available as chat-bison@001 in GCP

It comes in 4 sizes, I've only seen two so far

https://console.cloud.google.com/vertex-ai/model-garden

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#178

Post by plumeria »

m00dy wrote: post #129
plumeria wrote: post #117

Earlier quoted context omitted.

I wish that humanity gets to harvest static energy one day, so that everyone is able to run the experiments required in large-scale deep learning research, not only a handful of deep pocketed organizations.

don't worry, smartest people I know are working on this problem.

On the other hand, liquid networks [0] seem promising in not requiring huge amounts of energy (by not requiring huge numbers of parameters).

[0] https://www.youtube.com/watch?v=p1NpGC8K-vs

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#179

Post by 29athrowaway »

nullsense wrote: post #147
29athrowaway wrote: post #138

It is interesting how the definition of a supercomputer changes over time. Compared to decades ago now everyone carries a supercomputer.

Apparently RTX4090 with FP8 is equivalent to worlds fastest supercomputer from 2007. So, in some sense I have a supercomputer on my desk:)

That is worth a HN post.

Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs

#180

Post by ipsum2 »

zamnos wrote: post #142
ipsum2 wrote: post #125

Earlier quoted context omitted.

So it's not a super-computer, its a single server with 8 GPUs. Hilarious branding.

26 exaFlops sounds pretty super to me! My laptop only has 2.6 TFLOPs.

Those are made-up numbers by Nvidia. Obtaining anywhere close to that in reality is basically impossible. Better to compare benchmarks instead.
Post reply on HN