Earlier quoted context omitted.
Hey that’s not fair, the X5690 is VERY efficient… at heating a home in the winter time.
Easier said than done. I've got a dual X5690 at home in Kiev, Ukraine and I just couldn't find anything to run on it 24x7. And it doesn't produce much heat idling. I mean at all.
Intel Gaudi 3 AI Accelerator
231–240 of 260 posts
Re: Intel Gaudi 3 AI Accelerator
#232Earlier quoted context omitted.
Easier said than done. I've got a dual X5690 at home in Kiev, Ukraine and I just couldn't find anything to run on it 24x7. And it doesn't produce much heat idling. I mean at all.
Run BOINC maybe? [0] [0]: https://boinc.berkeley.edu/
Re: Intel Gaudi 3 AI Accelerator
#233Earlier quoted context omitted.
Easier said than done. I've got a dual X5690 at home in Kiev, Ukraine and I just couldn't find anything to run on it 24x7. And it doesn't produce much heat idling. I mean at all.
All the sane and rational people are rooting for you here in the U.S. I’m sorry our government is garbage and aid hasn’t been coming through as expected. Hopefully Ukraine can stick it to that chicken-fucker in the Kremlin and retake Crimea too. I didn’t have an X5690 because the TDP was too high for my server’s heatsinks, but I had 90W variants of the same generation. To me, two at idle produced noticeable heat, tho…
It looks pathetic indeed. Makes many people question: if THAT'S democracy, then maybe it's not worth fighting for.
> All the sane and rational people are rooting for you here in the U.S.
The same could be said about russian people (sane and rational ones). But what do both people have in common? The answer is: currently both nations are helpless to change what their government does.
> are rooting for you here in the U.S.
I know. We all truly know and greatly appreciate that. There would be no Ukraine if not American weapons and help.
> There’s always Folding@Home
Makes little sense power-wise.
Re: Intel Gaudi 3 AI Accelerator
#234Earlier quoted context omitted.
Itanium only stuck around as long as it did because they were obligated to support HP.
Itanium only failed because AMD was allowed to come up with AMD64, Intel would have managed to push Itanium no matter what, if there were no alternatives to a 64bit compatible x86 CPU.
Re: Intel Gaudi 3 AI Accelerator
#235> Twenty-four 200 gigabit (Gb) Ethernet ports are integrated into every Intel Gaudi 3 accelerator WHAT‽ It's basically got the equivalent of a 24-port, 200-gigabit switch built into it. How does that make sense? Can you imaging stringing 24 Cat 8 cables between servers in a single rack? Wait: How do you even decide where those cables go? Do you buy 24 Gaudi 3 accelerators and run cables directly between every single…
Infiniband I've heard as incredibly annoying to deal with procuring as well as some other aspects of it, so lots of folks very happy to get RoCE (ethernet) working instead, even if it is a bit cumbersome.
Re: Intel Gaudi 3 AI Accelerator
#236Re: Intel Gaudi 3 AI Accelerator
#237Earlier quoted context omitted.
https://www.fs.com/de-en/products/115636.html 2 meters seems to be about 100$, which isn't unreasonable. If you're going fiber instead of twinax it's another order of magnitude and a bit for trancievers, but cables are pretty cheap still. You seem to be loading negative energy into this release from the get-go
You're going to need a lot more than 2 meters... It's probably AOC (Active-Optical Fiber Cable), they're pricey even for 40Gbit, at DC lengths.
Now, connecting the leaf switches to the spine is a different story...
Re: Intel Gaudi 3 AI Accelerator
#238Earlier quoted context omitted.
Upon further review... I think any actual base board schematics / pinouts touching the Nvidia hardware directly is indeed kept behind some sort of NDA or OEM license agreement and is specifically kept out of any of those documents for the Open Compute project JBOG rigs. I think this is literally the impetus for their OAM spec which makes the pinout open and shareable. Up until that, they had to keep the actual design…
Hmm interesting, I was linked to an OCP dropbox with a version that did have the connector pinouts. Maybe something someone shouldn’t have posted then…
Re: Intel Gaudi 3 AI Accelerator
#239Earlier quoted context omitted.
it's so true it hurts
Hey man have seen you around here, very knowledgeable, thanks for your input! What's your take on projects like https://github.com/corundum/corundum I'm trying to get better at FPGA design, perhaps learn PCIe and some such but Vivado is intimidating (as opposed to Yosys/nextpnr which you seem to hate) should I just get involved with a project like this to acclimatise somewhat?
i never said i hated yosys/nextpnr? i said somewhere that yosys makes the uber strange decision to use C++ as effectively a scripting language ie gluing and scheduling "passes" together - like they seemed to make the firm decision to diverge from tcl but diverged into absurd territory. i wish yosys were great because it's open source and then i could solve my own problems as they occurred. but it's not great and i doubt it ever will be because building logic synthesis, techmapping, timing analysis, place and route, etc. is just too many extremely hard problems for OSS.
all the vendor tools suck. it's just a fact that both big fpga manufacturers have completely shit software devs working on those tools. the only tools that i've heard are decent are the very expensive suites from cadence/siemenns/synopsis but i have yet to be in a place that has licenses (neither school nor day job - at least not in my team). and mind you, you will still need to feed the RTL or netlist or whatever that those tools generate into vivado (so you're still fucked).
so i don't have advice for you on RTL - i moved one level up (ISA, compilers, etc.) primarily because i could not effectively learn by myself i.e., without going to "apprentice" under someone that just has enough experience to navigate around the potholes (because fundamentally if that's what it takes to learn then you're basically working on ineluctably entrenched tech).
Re: Intel Gaudi 3 AI Accelerator
#240Earlier quoted context omitted.
Probably not. An 40GB Nvidia A100 is arguably reasonable for a workstation at $6000. Depending on your definition an 80GB A100 for $16000 is still reasonable. I don't see this being cheaper than an 80GB A100. Probably a good bit more expensive, seeing as it has more RAM, compares itself favorably to the H100, and has enough compelling features that it probably doesn't have to (strongly) compete on price.
I think you're right on the price, but just to give some false hope. I think newish hbm (and this is hbm2e which is a little older) is around $15/gb so for 128 gb thats $1920. There are some other cogs, but in theory they could sell this for like $3-4k and make some gross profit while getting some hobbyist mindshare/research code written for it. I doubt they will though, it might eat too much into profits from the no…
This figure is old and I dont think $15 cuts it anymore. My guess would be $20 if not exceeds it.