41–50 of 55 posts
Out of curiosity, what are you training with these cards?
I am primarily experimenting on post training stack. As of now working on training a model that is natively RLM https://github.com/alexzhang13/rlm
Ok, how are people powering these things? 2.4kW is well beyond a standard circuit in the US. Are people having 240V/30A circuits installed? Are they hijacking the dryer plugs? EV charger plugs? Hottub circuits?
Chaining two PSUs on separate circuits is also an option. If they're using the MaxQ versions though, the total GPU power draw is only ~1200W. The bigger question to me is how are they cooling it? Sticking an AC in that room just doubles the power draw issues.
If you're gonna get rewired you may as well install a 240v circuit, and some 120v 20a sockets while you're at it.
Ditch the tiny DC fans. Build a shroud and switch to a single ac-powered industrial blower / duct fan.
Why does this post sound like it's an AI story based on the inputs from the engineer? The phrasing is very claude like: "That cracked joint is the whole story. The card had passed initial bring-up and ran fine at light loads for a week." "That sequencing matters — it’s why we have a story to tell. The pilot card failed, taught us a lesson, and the lesson is the reason the other three went on without incident." "Drive…
Stuff like "it's the whole story," "this part matters," and "it's not X" (when X wasn't ever under discussion to begin with).
They're like a bot characterizing to itself what is important, what is unimportant, or sometimes even arguing with itself. Their presentation seems like bits of the internal thinking mechanism leaking into the output queue.
Ok, how are people powering these things? 2.4kW is well beyond a standard circuit in the US. Are people having 240V/30A circuits installed? Are they hijacking the dryer plugs? EV charger plugs? Hottub circuits?
240V-20A circuits will handle 3.8kW continuous. It’s probably a 240V-20A circuit, as that is what the power supplies typically want. Also, easy to convert an outlet to 240V, if the breaker is dedicated to that outlet. Just requires swapping the breaker and the outlet, not the wires.
Certainly on my panel the only "single outlet" breakers are hot water, AC, oven/stove, dryer.
Earlier quoted context omitted.
240V-20A circuits will handle 3.8kW continuous. It’s probably a 240V-20A circuit, as that is what the power supplies typically want. Also, easy to convert an outlet to 240V, if the breaker is dedicated to that outlet. Just requires swapping the breaker and the outlet, not the wires.
I don't think that's exactly common other than for outlets that are already wired for those specialized purposes, no? Certainly on my panel the only "single outlet" breakers are hot water, AC, oven/stove, dryer.
Also, another place where you might already have this outlet: some older houses that use window AC units that were larger had 240V 20A outlets. Not common these days, but you can still buy these types of window AC units.
What a time to be alive, I remember 10 years ago as a poor student waiting to buy a ATI Radeon X1600 Pro with 256mb, yes 256mb of RAM. It cost about £190 in 2006. Now we have GPUs that are in tens of thousands of pounds with insane performance, but what would their price be without the AI and Datacentre squeeze?
2006 is 20 years ago
Thanks for making me feel older now
Earlier quoted context omitted.
Chaining two PSUs on separate circuits is also an option. If they're using the MaxQ versions though, the total GPU power draw is only ~1200W. The bigger question to me is how are they cooling it? Sticking an AC in that room just doubles the power draw issues.
If I wanted to use two circuits without running extension cords, every place I've lived would mean getting electrical rewired. If you're gonna get rewired you may as well install a 240v circuit, and some 120v 20a sockets while you're at it.
I'm very close to just running a cord over or devising a way to put my machine closer to a second circuit because my rental is horribly setup and both my bedroom AC and living room desktop (that also doubles as a ML training box) end up on the same circuit.
Earlier quoted context omitted.
Chaining two PSUs on separate circuits is also an option. If they're using the MaxQ versions though, the total GPU power draw is only ~1200W. The bigger question to me is how are they cooling it? Sticking an AC in that room just doubles the power draw issues.
If I wanted to use two circuits without running extension cords, every place I've lived would mean getting electrical rewired. If you're gonna get rewired you may as well install a 240v circuit, and some 120v 20a sockets while you're at it.
It would require an additional run of 14/2G romex (12/2G for 20A) and a single-pole breaker, but allows you to skip cutting in an old work box to add a 2nd duplex receptacle.
You could possibly replace the existing 14/2G with 14/4G which has enough conductors for both circuits.
Earlier quoted context omitted.
If I wanted to use two circuits without running extension cords, every place I've lived would mean getting electrical rewired. If you're gonna get rewired you may as well install a 240v circuit, and some 120v 20a sockets while you're at it.
You can break the tabs on a 15A or 20A duplex receptacle to have (2) single 15A or 20A dedicated circuits on a single duplex receptacle. It would require an additional run of 14/2G romex (12/2G for 20A) and a single-pole breaker, but allows you to skip cutting in an old work box to add a 2nd duplex receptacle. You could possibly replace the existing 14/2G with 14/4G which has enough conductors for both circuits.
The receptacle is the easy part, running the new circuit is the hard part.
Or you know, install a new 240V receptacle.
If I have to:
1) Run wire
2) Get a bigger breaker box
3) To do it legally, hire an electrician and maybe get a permit
Replacing the receptacle is like, <1% of what's involved there.