Live data from Hacker News

Nvidia Hopper GPU Architecture and H100 Accelerator

anandtech.com

81–90 of 183 posts

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#81
post #37

Earlier quoted context omitted.

You can buy A100s in a server today, a number of integrators will happily sell it to you.

As someone who've tried for some weeks, it really seems like it's out-of-stock literally everywhere. The demand seems to be a lot higher than the supply at the moment, so much that I'm considering buying one myself instead of renting servers with it.

Did you check Lambda or Exxact?

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#83
post #57

Off topic but I can't stand when corporations use actual people's names for their marketing who never gave them the permission to do so. For something like Shakespeare or Cicero I'm OK with it but Grace Hopper was alive in my lifetime, and even Tesla feels a little weird. What gives you the right to use that person's reputation to shill your product?

> What gives you the right to use that person's reputation to shill your product? Practically speaking you have the right to do anything unless someone complains about it. A lot of popular figures, even those long dead, have estates and organizations that manage their likeliness and other related copyright and IP. IDK what the situation is in this case, but Nvidia may very well have paid for the name.

No post body was provided.

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#84
post #65

Earlier quoted context omitted.

TF32 = FP32 range + FP16 precision

Why not call it TF19 then.

Because it's 32-bits wide in memory.

The effective mantissa is like FP16 but it's padded out to be the same size as FP32.

In other words, there's 1 sign bit, 8 exponent bits, 10 mantissa bits that are USED, and 13 mantissa bits that are IGNORED.

1 + 8 + 10 + 13 = 32

The 13 ignored mantissa bits are part of the memory image: they pad the number out to 32-bit alignment.

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#85
post #32

Earlier quoted context omitted.

Isn't it based on the architecture name? https://en.wikipedia.org/wiki/Category:Nvidia_microarchitect...

Yeah it is, but unless you've memorised the history of Nvidia architectures it doesn't tell you which is the newer one Fermi -> Kepler -> Maxwell -> Pascal -> Volta (HPC only) -> Turing -> Ampere -> Hopper (HPC only?) -> Lovelace?

Someone should make a game like "Pokemon or Big Data" [1] except you have to choose which of two GPU names is faster. Even the consumer naming is bonkers so there's plenty of material there!

[1] http://pixelastic.github.io/pokemonorbigdata/

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#86
post #57

Off topic but I can't stand when corporations use actual people's names for their marketing who never gave them the permission to do so. For something like Shakespeare or Cicero I'm OK with it but Grace Hopper was alive in my lifetime, and even Tesla feels a little weird. What gives you the right to use that person's reputation to shill your product?

> What gives you the right to use that person's reputation to shill your product? Practically speaking you have the right to do anything unless someone complains about it. A lot of popular figures, even those long dead, have estates and organizations that manage their likeliness and other related copyright and IP. IDK what the situation is in this case, but Nvidia may very well have paid for the name.

I don’t think my kids have any more right to use my name than a corporation, unless I specifically grant them that right (like Walt Disney did by naming it the Walt Disney company). Another sickening one is the Ed Lee Club in SF, who endorses political candidates under the name of a much-loved dead SF mayor.

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#87
post #44
post #39

Earlier quoted context omitted.

Isn't this the norm? Only AMD started the trend of naming the uArch with Numbers as Zen 4 or RDNA 3 fairly recently. With Intel it is Haswell > Broadwell > ..... Whatever Lake.

Usually the architecture name isn't the only distinguishing feature of the product name, you don't need to remember Intel codenames because a Core 12700 is obviously newer than a Core 11700 Nvidia's accelerators are just called 100 every time so if you don't remember the order of the letters it's not obvious They could have just named them P100, V200, A300 and H400 instead

>you don't need to remember Intel codenames because a Core 12700 is obviously newer than a Core 11700

J3710, 7th Gen J3060, 8th Gen

J4205, 8th Gen J4125, 9th Gen

i3-5005U, 5th Gen N5095, 10th Gen

i7-3770, 3rd Gen 3865U, 7th Gen N3060, 8th Gen

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#88
post #78

So the product naming for Nvidia's server-GPUs by compute power now goes: P100 -> V100 -> A100 -> H100 This is not confusing at all.

I mean, I'd already internalized P100 Schedule me on an H100 and I promise I won't mind the "confusing" naming.

Also, the naming drives devs towards the architecture papers, which are important if you want to get within sight of theoretical perf. When NVidia changes the letter, it's like saying "hey, pay attention, at least skim the new whitepaper." Over the last decade, I feel like this convention has respected my time, so in turn it has earned my own respect. I'll read the Hopper whitepaper tonight, or whenever it pops up.

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#89
post #44
post #39

Earlier quoted context omitted.

Isn't this the norm? Only AMD started the trend of naming the uArch with Numbers as Zen 4 or RDNA 3 fairly recently. With Intel it is Haswell > Broadwell > ..... Whatever Lake.

Usually the architecture name isn't the only distinguishing feature of the product name, you don't need to remember Intel codenames because a Core 12700 is obviously newer than a Core 11700 Nvidia's accelerators are just called 100 every time so if you don't remember the order of the letters it's not obvious They could have just named them P100, V200, A300 and H400 instead

Intel was using Core i[3,5,7] names for multiple generations. A Core i7 could be faster or slower than a Core i5 depending on which generation each existed in.

It is nice when products have a naming scheme where natural ordering of the name maps to performance.

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#90
post #81

Earlier quoted context omitted.

As someone who've tried for some weeks, it really seems like it's out-of-stock literally everywhere. The demand seems to be a lot higher than the supply at the moment, so much that I'm considering buying one myself instead of renting servers with it.

Did you check Lambda or Exxact?

Yes, nor Lambda Labs or Exxact Corporation have them available last time I checked (last week). Both citing high demand as the reason for it being unavailable.
Post reply on HN