361–370 of 672 posts
I bet there’s gonna be a banger of a Mac Studio announced in June. Apple really stumbled into making the perfect hardware for home inference machines. Does any hardware company come close to Apple in terms of unified memory and single machines for high throughput inference workloads? Or even any DIY build? When it comes to the previous “pro workloads,” like video rendering or software compilation, you’ve always been…
Earlier quoted context omitted.
DGX workstations, expensive but allow PCI cards as well. https://marketplace.nvidia.com/en-us/enterprise/personal-ai-...
It's hilarious that not a single one of these has pricing listed anywhere public. I don't think they expect anyone to actually buy these. Most companies looking to buy these for developers would ideally have multiple people share one machine and that sort of an arrangement works much more naturally with a managed cloud machine instead of the tower format presented here. Confirming my hypothesis, this category of devi…
Earlier quoted context omitted.
> But inference is unique because its performance scales with high memory throughput, and you can’t assemble that by wiring together off the shelf parts in a consumer form factor. Nvidia outperforms Mac significantly on diffusion inference and many other forms. It’s not as simple as the current Mac chips are entirely better for this.
Nvidia isn't selling one-off home computers afaik. But yes in terms of datacenter cloud usage Nvidia performs.
I never understood the point of the Mac Pro for the last decade or so - especially after the Mac Studio was released, Apple should have worked out what professionals actually want - basically a Mac Studio but with three or four PCIe slots and a few SSD slots. That’s literally all it should be! The Mac Pro was at the same time bizarrely over the top while also weirdly limited in some ways - while also being way to exp…
I bet there’s gonna be a banger of a Mac Studio announced in June. Apple really stumbled into making the perfect hardware for home inference machines. Does any hardware company come close to Apple in terms of unified memory and single machines for high throughput inference workloads? Or even any DIY build? When it comes to the previous “pro workloads,” like video rendering or software compilation, you’ve always been…
Earlier quoted context omitted.
I have a sit/stand desk so mine's on top, it makes organising the cables much easier. Nothing as swish looking as a Mac Pro though, it's a plain black Lian Li behemoth from the late 00s.
I also have a standing desk, and my desktop computer is still on the floor. That way I can just route all the cables to the back and then under the desk to my PC. Looks very clean as well.