[dead]
Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
101–110 of 188 posts
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#102[dead]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#103[dead]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#104So, where can I use instances of Gaudi 3 and what is the hourly price for these instances?
This is something I'd like to offer via my business (Hot Aisle) at some point in the near future. Right now, we are just getting started and focused on MI300x, but the long term goal is to offer any type of high end compute that people are willing to rent.
What USP are you aiming for, to differentiate from the many companies who have tried and failed to offer some form of HPCaaS over the last 10-15 years?
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#105[dead]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#106[dead]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#107[dead]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#108The "in the wild" part of the title is misleading. These chips are being presented in a very controlled environment. An interesting aspect of Intel's design is they use Ethernet for connectivity. If they can get the performance on par with NVLink, that by itself could be a win because everybody knows how to manage Ethernet. Very few people know how to manage an NVLink network. To be clear, this is data center hardwar…
RoCE is an IETF standard for this: https://en.wikipedia.org/wiki/RDMA_over_Converged_Ethernet In my understanding one of the big advantages of the protocol (v2, that is) is that it is routed over IP and can work with existing switches ($$) instead of needing specialized ones ($$$$)
RoCE never required expensive switches but getting the PFC configuration right can be tricky.
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#109[dead]
Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild
#110[dead]