Nvidia Hopper GPU Architecture and H100 Accelerator

Post by throwawaygh » Wed, Mar 23, 2022, 1:55 AM UTC

fancyfredbot wrote: post #150

The Tensor cores will be great for machine learning and the FP32/FP64 fantastic for HPC, but I'd be surprised if there were a lot of applications using both of these features at once. I wonder if there's room for a competitor to come in and sell another huge accelerator but with only one of these two features either at a lower price or with more performance? Perhaps the power density would be too high if everything w…

Post by [deleted] » Wed, Mar 23, 2022, 3:48 AM UTC

Uehreka wrote: post #38

neogodless wrote: post #35

Earlier quoted context omitted.

You just blew my mind. That did not occur to me, but it is obvious in retrospect.

Sure, but the way Nvidia names generations is far from obvious. It seems to be “names of famous scientists, progressing in alphabetical order, we skip some letters if we can’t find a well known scientist with a matching last name and are excited about a scientist 2 letters from now, we wrap around to the beginning of the alphabet when we get to the end, and we just skipped from A to H, so expect another wraparound in…

Post by polynomial » Wed, Mar 23, 2022, 3:57 AM UTC

Uehreka wrote: post #38

neogodless wrote: post #35

Earlier quoted context omitted.

You just blew my mind. That did not occur to me, but it is obvious in retrospect.

Sure, but the way Nvidia names generations is far from obvious. It seems to be “names of famous scientists, progressing in alphabetical order, we skip some letters if we can’t find a well known scientist with a matching last name and are excited about a scientist 2 letters from now, we wrap around to the beginning of the alphabet when we get to the end, and we just skipped from A to H, so expect another wraparound in…

Post by shaklee3 » Wed, Mar 23, 2022, 5:18 AM UTC

Symmetry wrote: post #107

NVidia and AMD datacenter GPUs continue to diverge between focusing on deep learning and traditional scientific computing respectively.

Post by yread » Wed, Mar 23, 2022, 7:50 AM UTC

jsheard wrote: post #44

ksec wrote: post #39

Earlier quoted context omitted.

Isn't this the norm? Only AMD started the trend of naming the uArch with Numbers as Zen 4 or RDNA 3 fairly recently. With Intel it is Haswell > Broadwell > ..... Whatever Lake.

Usually the architecture name isn't the only distinguishing feature of the product name, you don't need to remember Intel codenames because a Core 12700 is obviously newer than a Core 11700 Nvidia's accelerators are just called 100 every time so if you don't remember the order of the letters it's not obvious They could have just named them P100, V200, A300 and H400 instead