Earlier quoted context omitted.
Habana was an acquisition and their use of TSMC predates the acquisition.
Yeah, but if Intel can't even get internal customers to adopt their foundry services it seems to bode poorly for the future of the company.
Intel Gaudi 3 AI Accelerator
241–250 of 260 posts
Re: Intel Gaudi 3 AI Accelerator
#242Earlier quoted context omitted.
Habana was an acquisition and their use of TSMC predates the acquisition.
Yeah, but if Intel can't even get internal customers to adopt their foundry services it seems to bode poorly for the future of the company.
Re: Intel Gaudi 3 AI Accelerator
#243Earlier quoted context omitted.
Isn't it much better to get a Mac Studio with an M2 Max and 192gb of Ram and 31 terraflops for $6599 and run llama.cpp?
Macs don't support CUDA which means all that wonderful hardware will be useless when trying to do anything with AI for at least a few years. There's Metal but it has its own set of problems, biggest one being it isn't a drop in CUDA replacement.
Re: Intel Gaudi 3 AI Accelerator
#244Earlier quoted context omitted.
Only "most of the time" ? :( You'd hope at $15,000+ per unit, you wouldn't have to reset it at all...
It's $1000 per, no? This is one of the gaming cards.
At which price point to be honest, it still shouldn't be needed.
AMD are lucky everyone expects this nowadays, or people might consider sueing.
Re: Intel Gaudi 3 AI Accelerator
#245Earlier quoted context omitted.
I'm not familiar with the particulars of OneAPI, but it's just a matter of rewriting CUDA kernels into OneAPI. This is pretty trivial for the vast majority of small (<5 LoC) kernels. Unlike AMD, it looks like they're serious about dogfooding their own chips, and they have a much better reputation for their driver quality.
(reply to Zoomer from further down, moving up because I ended up writing a lot) This experience is largely a misalignment between what AMD thinks their product is and what the Linux world thinks software is. My pet theory is it's a holdover from the GPU being primarily a games console product as that's what kept the company alive through the recent dark times. There's money now but some of the best practices are stic…
Re: Intel Gaudi 3 AI Accelerator
#246Earlier quoted context omitted.
Upon further review... I think any actual base board schematics / pinouts touching the Nvidia hardware directly is indeed kept behind some sort of NDA or OEM license agreement and is specifically kept out of any of those documents for the Open Compute project JBOG rigs. I think this is literally the impetus for their OAM spec which makes the pinout open and shareable. Up until that, they had to keep the actual design…
Hmm interesting, I was linked to an OCP dropbox with a version that did have the connector pinouts. Maybe something someone shouldn’t have posted then…
Re: Intel Gaudi 3 AI Accelerator
#247Earlier quoted context omitted.
Itanium only stuck around as long as it did because they were obligated to support HP.
Itanium only failed because AMD was allowed to come up with AMD64, Intel would have managed to push Itanium no matter what, if there were no alternatives to a 64bit compatible x86 CPU.
Modern CPUs have moved towards becoming simpler and more flexible in their execution with specialized hardware (GPUs, etc) for the more parallel and repetitive tasks that Itanium excelled at.
Re: Intel Gaudi 3 AI Accelerator
#248Earlier quoted context omitted.
Did you run on the blessed Ubuntu version with the blessed kernel version and the blessed driver version? As otherwise you really are in a development branch. If you can point me to a repro I'll add it to my todo list. You can probably tag me in the github issue if that's where you reported it.
> blessed Ubuntu version with the blessed kernel version To an SRE, this is a nightmare to read. Cuda is bad in this regard (can often prevent major kernel version updates), but this is worse.
Re: Intel Gaudi 3 AI Accelerator
#249> Twenty-four 200 gigabit (Gb) Ethernet ports are integrated into every Intel Gaudi 3 accelerator How much does a single 200Gbit active (or inactive) fiber cable cost? Probably thousands of dollars.. making even the cabling for each card Very Expensive. Nevermind the network switches themselves.. Simultaneously impressive and disappointing.
What do you mean by active vs inactive fiber cable? I tried to Google about this distinction, but I couldn't find anything helpful.
If you search for "AOC Fiber", lots of resources will pop up. FS.com is one helpful resource.
https://community.fs.com/article/active-optical-cable-aoc-ri...
> Active optical cable (AOC) can be defined as an optical fiber jumper cable terminated with optical transceivers on both ends. It uses electrical-to-optical conversion on the cable ends to improve speed and distance performance of the cable without sacrificing compatibility with standard electrical interfaces.
Re: Intel Gaudi 3 AI Accelerator
#250Earlier quoted context omitted.
Well, lets not forget, AMD is AMD because they reverse-engineered Intel chips....
IBM didn't want to rely solely on Intel when introducing PCs so it forced Intel to share its arch with another manufacturer that turned out to be AMD. It's not like AMD stole it. Math coprocessor was in turn invented by AMD (Am9511, Am9512) and licensed by Intel (8231, 8232).