Earlier quoted context omitted.
You can buy A100s in a server today, a number of integrators will happily sell it to you.
As someone who've tried for some weeks, it really seems like it's out-of-stock literally everywhere. The demand seems to be a lot higher than the supply at the moment, so much that I'm considering buying one myself instead of renting servers with it.
Nvidia Hopper GPU Architecture and H100 Accelerator
81–90 of 183 posts
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#82This would be cool if they had decent drivers for Linux.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#83Off topic but I can't stand when corporations use actual people's names for their marketing who never gave them the permission to do so. For something like Shakespeare or Cicero I'm OK with it but Grace Hopper was alive in my lifetime, and even Tesla feels a little weird. What gives you the right to use that person's reputation to shill your product?
> What gives you the right to use that person's reputation to shill your product? Practically speaking you have the right to do anything unless someone complains about it. A lot of popular figures, even those long dead, have estates and organizations that manage their likeliness and other related copyright and IP. IDK what the situation is in this case, but Nvidia may very well have paid for the name.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#84Earlier quoted context omitted.
TF32 = FP32 range + FP16 precision
Why not call it TF19 then.
The effective mantissa is like FP16 but it's padded out to be the same size as FP32.
In other words, there's 1 sign bit, 8 exponent bits, 10 mantissa bits that are USED, and 13 mantissa bits that are IGNORED.
1 + 8 + 10 + 13 = 32
The 13 ignored mantissa bits are part of the memory image: they pad the number out to 32-bit alignment.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#85Earlier quoted context omitted.
Isn't it based on the architecture name? https://en.wikipedia.org/wiki/Category:Nvidia_microarchitect...
Yeah it is, but unless you've memorised the history of Nvidia architectures it doesn't tell you which is the newer one Fermi -> Kepler -> Maxwell -> Pascal -> Volta (HPC only) -> Turing -> Ampere -> Hopper (HPC only?) -> Lovelace?
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#86Off topic but I can't stand when corporations use actual people's names for their marketing who never gave them the permission to do so. For something like Shakespeare or Cicero I'm OK with it but Grace Hopper was alive in my lifetime, and even Tesla feels a little weird. What gives you the right to use that person's reputation to shill your product?
> What gives you the right to use that person's reputation to shill your product? Practically speaking you have the right to do anything unless someone complains about it. A lot of popular figures, even those long dead, have estates and organizations that manage their likeliness and other related copyright and IP. IDK what the situation is in this case, but Nvidia may very well have paid for the name.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#87Earlier quoted context omitted.
Isn't this the norm? Only AMD started the trend of naming the uArch with Numbers as Zen 4 or RDNA 3 fairly recently. With Intel it is Haswell > Broadwell > ..... Whatever Lake.
Usually the architecture name isn't the only distinguishing feature of the product name, you don't need to remember Intel codenames because a Core 12700 is obviously newer than a Core 11700 Nvidia's accelerators are just called 100 every time so if you don't remember the order of the letters it's not obvious They could have just named them P100, V200, A300 and H400 instead
J3710, 7th Gen J3060, 8th Gen
J4205, 8th Gen J4125, 9th Gen
i3-5005U, 5th Gen N5095, 10th Gen
i7-3770, 3rd Gen 3865U, 7th Gen N3060, 8th Gen
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#88So the product naming for Nvidia's server-GPUs by compute power now goes: P100 -> V100 -> A100 -> H100 This is not confusing at all.
I mean, I'd already internalized P100 Schedule me on an H100 and I promise I won't mind the "confusing" naming.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#89Earlier quoted context omitted.
Isn't this the norm? Only AMD started the trend of naming the uArch with Numbers as Zen 4 or RDNA 3 fairly recently. With Intel it is Haswell > Broadwell > ..... Whatever Lake.
Usually the architecture name isn't the only distinguishing feature of the product name, you don't need to remember Intel codenames because a Core 12700 is obviously newer than a Core 11700 Nvidia's accelerators are just called 100 every time so if you don't remember the order of the letters it's not obvious They could have just named them P100, V200, A300 and H400 instead
It is nice when products have a naming scheme where natural ordering of the name maps to performance.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#90Earlier quoted context omitted.
As someone who've tried for some weeks, it really seems like it's out-of-stock literally everywhere. The demand seems to be a lot higher than the supply at the moment, so much that I'm considering buying one myself instead of renting servers with it.
Did you check Lambda or Exxact?