121–130 of 134 posts
Earlier quoted context omitted.
which engine? cause there are dozens already, and some are quite fast.
none of them are Nvidia GPU FAST
Earlier quoted context omitted.
I would rather take this option than a single H100: > 96 GB Dual NVIDIA RTX PRO 5000 w/ 1000W PSU (non-refundable) +$19,169 Though I don't think there's anything stopping you from trying to stuff an H100 into this machine if you want to BYO.
For that price you get the H100. The machine is overpriced, and I'd personally rather go for a second-hand workstation with server-grade components.
I find it hard to believe any enterprise willing to drop over $40k on a workstation PC would choose `Pop!_OS 24.04 LTS with the COSMIC Desktop Environment` over Ubuntu.
[1]https://system76.com/support/difference-between-pop-ubuntu
Anyone know why they chose a consumer grade CPU on this? I’m a little surprised to see a 9950X as the top option. There’s not enough PCIe lanes available to run everything without bifurcation. I imagine the GPUs probably aren’t too bothered generally… but the NVMe drives are likely to slow down as a result. A Threadripper ain’t cheap, but if you’re spending $45k on a workstation it seems like a weird place to skimp.…
Someone can work around this by including a PCIe 5.0 switch like the Broadcom PEX89048. That switch can be used to, for instance, have the two GPUs talk to each other at full PCIe 5.0 16x speeds, while talking to the motherboard at say PCIe 4.0 16x, or even 8x. As an end user, cards using that switch seem to be an AliExpress only item, but I assume an OEM like System76 could get their hands on it to place directly on the motherboard. I imagine the price of adding that to a motherboard could be less than the price of switching to a Threadripper or Xeon 600 platform.
However, I can't find any evidence that System76 has added a switch, and in fact they refer to x8/x8 multi-GPU support, making me think they didn't add a switch. To my mind, this isn't a very satisfactory setup.
Earlier quoted context omitted.
Kind of feels like if you spend $40K on your GPU setup, you don't want to cheap out on the PSU. Still, you're right, I have a 1200W PSU for a single RTX Pro 6000, cost ~500 something, so still the PSU shouldn't be that large part of the total budget.
Funny thing is, you don't really want to just plug that into a wall socket. You want an uninterruptible power supply that can keep the machine running for the 5 to 8 minutes you need to get to it and shut it down safely during a power cut. But you'll find most household power sockets aren't actually rated for the kind of power these things draw at peak. If you go for a dual GPU you're going to want to sustain a highe…
Earlier quoted context omitted.
For that price you get the H100. The machine is overpriced, and I'd personally rather go for a second-hand workstation with server-grade components.
I would assume an H100 selling for less than $30k is a scam. I see one for 11,329€, and one for $25k but most are over $30k and I don't know how to judge these random storefronts. You've bought an H100 for $20k that was in working order recently?
Earlier quoted context omitted.
Funny thing is, you don't really want to just plug that into a wall socket. You want an uninterruptible power supply that can keep the machine running for the 5 to 8 minutes you need to get to it and shut it down safely during a power cut. But you'll find most household power sockets aren't actually rated for the kind of power these things draw at peak. If you go for a dual GPU you're going to want to sustain a highe…
Kind of feels like if you're noticing $1K here and $500 there, maybe $42K is too much to start with :)
So you're right. If the $42K price tag didn't make you blink, the additional $2700 in tax, and the $2K to $3K for the work in your house are going to financial hiccups. But it means the cost to start is $50K, not just the price tag.
Earlier quoted context omitted.
Kind of feels like if you spend $40K on your GPU setup, you don't want to cheap out on the PSU. Still, you're right, I have a 1200W PSU for a single RTX Pro 6000, cost ~500 something, so still the PSU shouldn't be that large part of the total budget.
Funny thing is, you don't really want to just plug that into a wall socket. You want an uninterruptible power supply that can keep the machine running for the 5 to 8 minutes you need to get to it and shut it down safely during a power cut. But you'll find most household power sockets aren't actually rated for the kind of power these things draw at peak. If you go for a dual GPU you're going to want to sustain a highe…