Live data from Hacker News

4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

sabareesh.com

11–20 of 55 posts

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#11

Is that little computer training LLMs from scratch all by itself? That must take years to get any kind of progress, given the scale of training other providers do. Where do you get the training data from?

You can train TinyStories in a few hours on retail hardware, and this is a highly illuminating experience that I can recommend for everyone.

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#12

Complete side note, but I can’t work out how the author managed to mistype “at” as “Δt”. Edit: reading fail on my part, nothing to see here.

huh? the only Δt in the article is used correctly. > With 18× 140 mm of surface, the fans run quietly and the coolant Δt across the rads stays small

Hah, wow, I completely misread it. Delta-t makes sense when you get the context right, thanks.

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#13
post #5

Cool post. FYI you might be better off getting one big fan for your "radiator" instead of lots of little fans. Big fans don't need to spin as fast as small fans to push the same amount of air. So they run a lot quieter.

Sure 140mm fans you may call little but it does need enough static pressure for the radiators. This setup is already several times quieter than stock setup

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#14

Is that little computer training LLMs from scratch all by itself? That must take years to get any kind of progress, given the scale of training other providers do. Where do you get the training data from?

Most of the training i am working on is with post training. You can do so much with a system that is running 24/7

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#15
post #6

I wonder whether those cards ran the model that wrote the nonsense about the forces involved. Hint: when you have a piece of metal stuck with thermal goop to a lot of components, the force doesn’t “concentrate” on one of them. You need to detach it from each one with however much force is needed to detach it from that component .

Not sure what really happened but some force or bad solder caused it.

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#16
What a time to be alive, I remember 10 years ago as a poor student waiting to buy a ATI Radeon X1600 Pro with 256mb, yes 256mb of RAM.

It cost about £190 in 2006.

Now we have GPUs that are in tens of thousands of pounds with insane performance, but what would their price be without the AI and Datacentre squeeze?

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#19

Ok, how are people powering these things? 2.4kW is well beyond a standard circuit in the US. Are people having 240V/30A circuits installed? Are they hijacking the dryer plugs? EV charger plugs? Hottub circuits?

exactly, I had a 220v 30a circuit installed to run a multi-GPU server in my basement.

I'm air cooling so I set -pl 450 so I'm not running them all at the full 600w

Re: 4× RTX Pro 6000 Blackwell on Water, and the One Card That Wouldn't Behave

#20

Ok, how are people powering these things? 2.4kW is well beyond a standard circuit in the US. Are people having 240V/30A circuits installed? Are they hijacking the dryer plugs? EV charger plugs? Hottub circuits?

Chaining two PSUs on separate circuits is also an option. If they're using the MaxQ versions though, the total GPU power draw is only ~1200W. The bigger question to me is how are they cooling it? Sticking an AC in that room just doubles the power draw issues.
Post reply on HN