Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
1–10 of 66 posts
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#2"For Stable Diffusion 3, we measured the training throughput for the 2B Multimodal Diffusion Transformer (MMDiT) architecture model. Gaudi 2 trained images 1.5x faster than the H100-80GB, and 3x faster than A100-80GB GPU’s when scaled up to 32 nodes. "
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#3"For Stable Diffusion 3, we measured the training throughput for the 2B Multimodal Diffusion Transformer (MMDiT) architecture model. Gaudi 2 trained images 1.5x faster than the H100-80GB, and 3x faster than A100-80GB GPU’s when scaled up to 32 nodes. "
I can feel the NVDA stock slipping as we speak…
It has been amazing watching the groupthink at work on that stock when we just saw the same group do it on TSLA to disastrous effect. A similar no moat situation where they simply can’t imagine competitors ever existing.
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#4Interesting! this was already the case with TPUs easily beating A100s. We sell Stable Diffusion finetuning on TPUs (dreamlook.ai), people are amazed how fast and cheap we can offer it - but there's no big secret, we just use hardware that's strictly faster and cheaper per unit of work.
I expect a new wave of "your task, but on superior hardware" services to crop up with these chips!
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#5I found this Intel website [1] more informative regarding architecture and capabilities of Gaudi2:
[1] https://www.intel.com/content/www/us/en/developer/articles/t...
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#6"For Stable Diffusion 3, we measured the training throughput for the 2B Multimodal Diffusion Transformer (MMDiT) architecture model. Gaudi 2 trained images 1.5x faster than the H100-80GB, and 3x faster than A100-80GB GPU’s when scaled up to 32 nodes. "
I can feel the NVDA stock slipping as we speak… It has been amazing watching the groupthink at work on that stock when we just saw the same group do it on TSLA to disastrous effect. A similar no moat situation where they simply can’t imagine competitors ever existing.
Typically stocks fall once I buy them and go up after I sell them. I am not planning on buying NVDA for now, so likely it will keep going up.
* just to be clear - this is a joke
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#7Hasn't H100 been shipping in volume for about a year already? Is Gaudi2 even available at comparable scale yet? I wouldn't count Nvidia out until they start slipping on similar timescales, i.e. if B100 doesn't have a clear lead over competing parts that become available at roughly the same time.
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#8Frankly, this may be good to level out the market a bit. While it's been fun to see Nvidia rise up through this insanity, it would only be healthy to have others catch up here and there eventually.
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#9"For Stable Diffusion 3, we measured the training throughput for the 2B Multimodal Diffusion Transformer (MMDiT) architecture model. Gaudi 2 trained images 1.5x faster than the H100-80GB, and 3x faster than A100-80GB GPU’s when scaled up to 32 nodes. "
[deleted]
Re: Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
#10[deleted]