31–40 of 183 posts
So the product naming for Nvidia's server-GPUs by compute power now goes: P100 -> V100 -> A100 -> H100 This is not confusing at all.
Isn't it based on the architecture name? https://en.wikipedia.org/wiki/Category:Nvidia_microarchitect...
Fermi -> Kepler -> Maxwell -> Pascal -> Volta (HPC only) -> Turing -> Ampere -> Hopper (HPC only?) -> Lovelace?
Earlier quoted context omitted.
Given that it's Nvidia, no Linux support. That's the catch.
That's a strange statement. The vast vast majority of these cards will be in systems running Linux.
Only the ppas from graphics-drivers work properly
My experience on windows is much more automatic and it never breaks anything. But I'd rather pay the price (installing on Linux) to avoid windows at all costs
Sounds like we need some new training methods. If training could take place locally and asynchronously instead of globally through backpropagation, the amount of energy could probably be significantly reduced.
So the product naming for Nvidia's server-GPUs by compute power now goes: P100 -> V100 -> A100 -> H100 This is not confusing at all.
Isn't it based on the architecture name? https://en.wikipedia.org/wiki/Category:Nvidia_microarchitect...
This seems fast... TF32 ....... 1,000 TFLOPS (tensor core) FP64/FP32 ... 60 TFLOPS I am more interested in the 144-core Grace CPU Superchip. nVidia is getting into the CPU business...
From the nvidia page, > 80 billion transistors > Hopper H100 .. generational leap > 9x at-scale training performance over A100 > 30x LLM inference throughput > Transformer Engine .. speed .. 6x without losing accuracy So another monster chip - same size of the Apple M1-max thingy .. I guess it comes down to pricing. The A100 is already ridiculously expensive at $10K. They can this one at $50K and it would sell out?
Earlier quoted context omitted.
Isn't it based on the architecture name? https://en.wikipedia.org/wiki/Category:Nvidia_microarchitect...
You just blew my mind. That did not occur to me, but it is obvious in retrospect.
Earlier quoted context omitted.
Isn't it based on the architecture name? https://en.wikipedia.org/wiki/Category:Nvidia_microarchitect...
Yeah it is, but unless you've memorised the history of Nvidia architectures it doesn't tell you which is the newer one Fermi -> Kepler -> Maxwell -> Pascal -> Volta (HPC only) -> Turing -> Ampere -> Hopper (HPC only?) -> Lovelace?
Earlier quoted context omitted.
Nvidia provides Linux drivers for their server chips.
Don't they provide them for their consumer cards too, just that it's a closed source binary blob?