81–90 of 134 posts
Earlier quoted context omitted.
Yeah, I bought a Thelio Major three years ago. I'm kicking myself for not going dual-4090s for a mere $10K back then.
Hopefully it will come down to that price point or cheaper again in the next 3-4 years?
As that’s unified memory à la Apple and I think up to 128gb
Earlier quoted context omitted.
You need far more absurdly expensive RAM (RDIMM/ECC?) for a threadripper. Like 4x more expensive.
Aye but at $45k you’re so deep already is that really worth the savings? It’s so much easier to manage a single system, and the performance will be in absolute terms better. Truly, I get your point, but $45k is obscene for a workstation (because of the RAM shortage). I can’t fathom it being a reasonable decision[1] unless you’re able to churn an immense profit from it. And… if you can, it’s an expense that saves time…
So they offer both options.
wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies
If running models then Apple is fine, if training or tuning or large number of users then Nvidia is king
Configure Thelio Mira with up to:
16-core AMD Ryzen 9000 Series CPU
192 GB DDR5 RAM
Dual NVIDIA RTX Pro 6000 GPU
192 GB GPU memory
dual RTX6000 price is : $40,538.00
Earlier quoted context omitted.
Prompt processing on Macs is VERY slow...
which engine? cause there are dozens already, and some are quite fast.
Earlier quoted context omitted.
Graphics: (...) +$18,399 192 GB Dual NVIDIA RTX PRO 6000 w/ 1000W + 750W PSUs (non-refundable) +$37,239 Memory: (...) 192 GB DDR5 3600 MHz (4x48) +$1,874 yup, 87.8% of $42,412 is just two GPUs and a PSU. Even RAM is less than 5%.
Really just the GPUs. PSUs aren’t that expensive maybe 100-200 for a good 750W-1000W one
Still, you're right, I have a 1200W PSU for a single RTX Pro 6000, cost ~500 something, so still the PSU shouldn't be that large part of the total budget.
Earlier quoted context omitted.
I would rather take this option than a single H100: > 96 GB Dual NVIDIA RTX PRO 5000 w/ 1000W PSU (non-refundable) +$19,169 Though I don't think there's anything stopping you from trying to stuff an H100 into this machine if you want to BYO.
For that price you get the H100. The machine is overpriced, and I'd personally rather go for a second-hand workstation with server-grade components.
Depending on your use case, you might prefer native FP4 and FP6 low-precision support and 5th-generation Tensor Cores rather than what Hopper offers.
I think for training Hopper makes sense as it's generally a bit cheaper and the difference isn't that big, but for inference the difference widens a bunch makes a lot more sense to go with Blackwell.