Out of curiosity, what are you training with these cards?
I am primarily experimenting on post training stack. As of now working on training a model that is natively RLM https://github.com/alexzhang13/rlm
4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
31–40 of 55 posts
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#32Pass the generated text through some kind of quality prompt. It’s got too much filler right now.
The story is interesting but it’s hard to read because it’s hard to tell which parts are meaningful and which parts are filler.
E.g. “we pulled the card cold - straight from the rig to the workbench”. Okay, but why would going straight from the rig to the workbench make it cold? If anything it would be warm. But it turns out the temperature is meaningful in your story.
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#33> 4× RTX PRO 6000 Blackwell Workstation (GB202, 96 GB GDDR7, 600 W)
Those are SM120 so no tmem/tcgen05 and lack of support in main libraries (it's like everybody is focusing on B300/SM100).
For that money I'd buy a single B300, similar total AI TOPS, similar GPU bandwidth aggregated, and only 25% less total memory (probably saved in less implementation complexity), half the energy consumption...
Also by having all SMs local they have the special L1-level interconnect. SMs can collaborate on the same GEMM. And a bunch of other nice features.
Or, you know, rent it.
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#34Pass the generated text through some kind of quality prompt. It’s got too much filler right now. The story is interesting but it’s hard to read because it’s hard to tell which parts are meaningful and which parts are filler. E.g. “we pulled the card cold - straight from the rig to the workbench”. Okay, but why would going straight from the rig to the workbench make it cold? If anything it would be warm. But it turns…
Appreciate the feedback. I have improved the article.
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#35Not that this really takes away from the substance of the article, but the first two paragraphs are giving heavy Claude smell. Semicolons, em dashes, "That sequencing matters"... I guess I'm just a little surprised that anyone could be arsed to take on a hardware project like this but can't be arsed to write their own introduction.
Appreciate the feedback. I have improved the article.
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#36> 4× RTX PRO 6000 Blackwell Workstation (GB202, 96 GB GDDR7, 600 W) Those are SM120 so no tmem/tcgen05 and lack of support in main libraries (it's like everybody is focusing on B300/SM100). For that money I'd buy a single B300, similar total AI TOPS, similar GPU bandwidth aggregated, and only 25% less total memory (probably saved in less implementation complexity), half the energy consumption... Also by having all SM…
Yes this has been on my mind as well. But this was built one at a time but still overall very happy with them
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#37You can tell this is AI slop by the horrible soldering descriptions - anyone with experience can look at that VRM and go "Oh, the solder is still in its stencil-applied state and has not flowed across the contacts at all, on either component or board. This is a reflow-in-oven issue from the manufacturer." This wasn't a cracking joint this was a poorly-done joint.
Signed, IPC-610 certified tech.
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#38Ok, how are people powering these things? 2.4kW is well beyond a standard circuit in the US. Are people having 240V/30A circuits installed? Are they hijacking the dryer plugs? EV charger plugs? Hottub circuits?
When I dipped my toes into vaguely-serious eth mining with GPUs 5 or 6 years ago, I just installed a dedicated 240v, 30a circuit in the basement. The run of cabling was short, the basement was unfinished utility space, and the parts didn't cost very much. It went together quickly.
The business of protecting individual power cords was handled by an Eaton PDU that had a 30a twist-lock plug on one side and a couple of rows of current-limited IEC C13 sockets on the other side.
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#39> Don’t RMA it, and don’t solder it yourself. A local phone-repair chain with a microsolder tech can put a 3 mm SMD part back on a GPU PCB in twenty minutes for the price of dinner. The skill is in your city. You just have to look.
The trouble with this though is, what if that is not the only issue with the card? That’s normally my thought process on reaching for RMA. The unit could be an all-round lemon that should not have passed QA etc. (and as noted in the post itself, working for a week on various tasks is not enough to prove it good)
Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave
#40What a time to be alive, I remember 10 years ago as a poor student waiting to buy a ATI Radeon X1600 Pro with 256mb, yes 256mb of RAM. It cost about £190 in 2006. Now we have GPUs that are in tens of thousands of pounds with insane performance, but what would their price be without the AI and Datacentre squeeze?
I remember buying the Radeon PCI with 32MB RAM for $650AUD…
I remember buying 128mb that was added on top of 64mb what brought me to the unbalanced 192 mb setup.
Diablo 2 stopped lagging when a necromancer joined the game and summoned all the skeletons...
On an unrelated note Path of exile 1 still lags even on a 5090