101–110 of 134 posts
Can't wait for in 10 years time to find one of these workstations on eBay selling for £100-150 Then I will do a video of me playing Crysis on it
Earlier quoted context omitted.
which engine? cause there are dozens already, and some are quite fast.
Which one is the fastest and how fast is it? Even the "fast" ones doesn't seem to even reach close to consumer NVIDIA GPUs released years ago when it comes to prompt processing.
I'd really like to just buy some collective shares of a GB300 NVL72 in a datacenter somewhere and have a daily token quota on a shared DeepSeek model or whatever was hot that week. I would just need to find ~100 like-minded folks at this $40k per share price to get started haha.
$37,000 in GPUs. Man, I never expected another PC manufacturer to make Apple's top configuration look cheap by comparison.
Calculate what performance you get per $ spent, and Apple again looks the most expensive out of probably anything else you could buy.
This dual NVIDIA RTX PRO 6000 setup has 192GB of VRAM at 1.8 TB/s, versus the 5-stack of Macs that collectively have 1.25 TB at 1.2 TB/second... I'm not convinced that equation comes out in Nvidia's favour.
Earlier quoted context omitted.
$42k and a toy CPU at that. Threadripper or EPIC if it must be AMD camp, although I'd rather it weren't (_always_ some random issues on linux). TBH, if I were buying workstation at such prices, I'd probably first take a look at what HP has (since their cooling and immunity to dust is unprecedented), and then probably BOXX and Puget. For DIY there's always supermicro at such levels.
That's what I don't understand, they're shipping RTX 6000s that are PCI lane-starved. Buying a Maserati and driving it around in 3rd gear.
Earlier quoted context omitted.
Calculate what performance you get per $ spent, and Apple again looks the most expensive out of probably anything else you could buy.
Are you sure about that? For the price of the top configuration here you can buy a 5-stack of 256GB Mac Studio M5 Ultras. This dual NVIDIA RTX PRO 6000 setup has 192GB of VRAM at 1.8 TB/s, versus the 5-stack of Macs that collectively have 1.25 TB at 1.2 TB/second... I'm not convinced that equation comes out in Nvidia's favour.
Earlier quoted context omitted.
Are you sure about that? For the price of the top configuration here you can buy a 5-stack of 256GB Mac Studio M5 Ultras. This dual NVIDIA RTX PRO 6000 setup has 192GB of VRAM at 1.8 TB/s, versus the 5-stack of Macs that collectively have 1.25 TB at 1.2 TB/second... I'm not convinced that equation comes out in Nvidia's favour.
Right, performance is more than just the aggregated memory speed of the hardware you have. I'm fairly sure, at least last time I looked, maybe Apple launched something new in the last 2-3 months that has completely changed the picture?
In other fields, sure, but for big LLMs it's a very significant part of the performance picture. That stack of Macs also is going to be able to natively run models 4-5x larger than the dual Blackwells can hold in memory - any model over about 128GB of weights isn't going to fit on the GPUs, and is going to be heavily performance constrained by moving data across the PCIE bus.
> maybe Apple launched something new in the last 2-3 months that has completely changed the picture
Indeed. The M5 Ultra (currently up for pre-order) has 50% higher memory bandwidth than its predecessor, and a claimed 4x improvement in prompt prefill.
Earlier quoted context omitted.
For that price you get the H100. The machine is overpriced, and I'd personally rather go for a second-hand workstation with server-grade components.
Hopper is ~4 years old at this point though, compared to Blackwell which is ~2 years old, the difference isn't nil. Depending on your use case, you might prefer native FP4 and FP6 low-precision support and 5th-generation Tensor Cores rather than what Hopper offers. I think for training Hopper makes sense as it's generally a bit cheaper and the difference isn't that big, but for inference the difference widens a bunch…