Nvidia Hopper GPU Architecture and H100 Accelerator
anandtech.com
Nvidia Hopper GPU Architecture and H100 Accelerator
1–10 of 183 posts
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#2This seems fast...
TF32 ....... 1,000 TFLOPS (tensor core)
FP64/FP32 ... 60 TFLOPS
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#3Sounds like we need some new training methods. If training could take place locally and asynchronously instead of globally through backpropagation, the amount of energy could probably be significantly reduced.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#4[deleted]
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#5No post body was provided.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#6Sounds like we need some new training methods. If training could take place locally and asynchronously instead of globally through backpropagation, the amount of energy could probably be significantly reduced.
The principled way of doing this is via ensemble learning, combining the predictions of multiple separately-trained models. But perhaps there are ways of improving that by including "global" training as well, where the "separate" models are allowed to interact while limiting overall training costs.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#71000 TFLOPS so i can run my GPT3 in under 100 ms locally :D
If 1000 TFLOPS is possible to do in inference time then im speechless
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#81 petaflop on a chip?? What is the catch?
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#91 petaflop on a chip?? What is the catch?
Tensor petaflops are useful in only very few circumstances. One of which is the highly lucrative deep learning community though.
Re: Nvidia Hopper GPU Architecture and H100 Accelerator
#101000 TFLOPS so i can run my GPT3 in under 100 ms locally :D If 1000 TFLOPS is possible to do in inference time then im speechless
At what costs I wonder?