Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
servethehome.com
Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
1–10 of 188 posts
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#2[deleted]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#3[deleted]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#4The "in the wild" part of the title is misleading. These chips are being presented in a very controlled environment.
An interesting aspect of Intel's design is they use Ethernet for connectivity. If they can get the performance on par with NVLink, that by itself could be a win because everybody knows how to manage Ethernet. Very few people know how to manage an NVLink network.
To be clear, this is data center hardware. The lower power versions of these cards consume like 600W, and no mention in the article on pricing.
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#5So, where can I use instances of Gaudi 3 and what is the hourly price for these instances?
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#6About time. NVIDIA needs some serious competition.
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#7The "in the wild" part of the title is misleading. These chips are being presented in a very controlled environment. An interesting aspect of Intel's design is they use Ethernet for connectivity. If they can get the performance on par with NVLink, that by itself could be a win because everybody knows how to manage Ethernet. Very few people know how to manage an NVLink network. To be clear, this is data center hardwar…
I agree that it’s misleading to act like this is a product in market, we don’t really even know if the yield will happen.
But it’s a serious thing if it happens.
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#8About time. NVIDIA needs some serious competition.
pokes OpenCL's corpse with a stick
C'mon, do something...
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#9About time. NVIDIA needs some serious competition.
pokes OpenCL's corpse with a stick C'mon, do something...
Ironically, Transformers are relatively simple architectures - all you really need is a high performance matmul. So OpenCL could "do something" at this point, if it were alive.
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#10The "in the wild" part of the title is misleading. These chips are being presented in a very controlled environment. An interesting aspect of Intel's design is they use Ethernet for connectivity. If they can get the performance on par with NVLink, that by itself could be a win because everybody knows how to manage Ethernet. Very few people know how to manage an NVLink network. To be clear, this is data center hardwar…
Very few people actually know how to provision and manage a lossless Ethernet fabric and I’d wager someone who had literally never touched infiniband would have an easier time accomplishing it from zero with IB than with Ethernet on real vendor gear.
Ethernet has so, so many gotchas. Maybe if it was a layer 3 only network it would work. Maybe.