Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild • Hacker News Board

FuriouslyAdrift wrote: post #14

1024core wrote: post #6

About time. NVIDIA needs some serious competition.

AMD is doing several billion in ai processor sales already and the new chip is selling as fast as they can make them. At least with AMD, a customer can actually get them now as opposed to the nearly 1 year lead time from nVidia.

Now, if they could also do the performant, unified, software and driver part..

Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild

#95

Post by conradev » Mon, Apr 22, 2024, 9:47 PM UTC

loudmax wrote: post #4

The "in the wild" part of the title is misleading. These chips are being presented in a very controlled environment. An interesting aspect of Intel's design is they use Ethernet for connectivity. If they can get the performance on par with NVLink, that by itself could be a win because everybody knows how to manage Ethernet. Very few people know how to manage an NVLink network. To be clear, this is data center hardwar…

RoCE is an IETF standard for this: https://en.wikipedia.org/wiki/RDMA_over_Converged_Ethernet

In my understanding one of the big advantages of the protocol (v2, that is) is that it is routed over IP and can work with existing switches ($$) instead of needing specialized ones ($$$$)