311–320 of 672 posts
Earlier quoted context omitted.
It's certainly beefier than a Mini - 6 TB5 ports (which can drive 6 PCIe 5.0 x4 slots in an enclosure if you want), M3 Ultra, up to 256GB RAM.
The detail you are missing is that one has to buy an additional enclosure and the set of PCI cards is actually limited, hardly workstation class. This is a workstation, https://www.dell.com/en-us/shop/desktop-computers/precision-...
Earlier quoted context omitted.
As someone who worked on the M2 Mac Pro and has a real soft spot for it, I get it. It’s horrendously expensive and doesn’t offer much benefit over a Mac Studio and a thunderbolt pci chassis. My personal dream is that vms would support pci pass through and so you can just spin up a Linux vm and let it drive the gpus. But at that point, why are you buying a Mac? Opinions are my own obvs.
> Opinions are my own obvs. Whose else would they be?
> Whose else would they be?
takes a look at the user profile
Oh, they are a journalist/writer for a big name outfit
I bet there’s gonna be a banger of a Mac Studio announced in June. Apple really stumbled into making the perfect hardware for home inference machines. Does any hardware company come close to Apple in terms of unified memory and single machines for high throughput inference workloads? Or even any DIY build? When it comes to the previous “pro workloads,” like video rendering or software compilation, you’ve always been…
For LLMs. For inference with other kinds of models where the amount of compute needed relative to the amount of data transfer needed is higher, Apple is less ideal and systems worh lower memory bandwidth but more FLOPS shine. And if things like Google’s TurboQuant work out for efficient kv-cache quantization, Apple could lose a lot of that edge for LLM inference, too, since that would reduce the amount of data shuffling relative to compute for LLM inference.
Earlier quoted context omitted.
Framework offers the AI Ryzen Max with ̶1̶9̶6̶G̶B̶ 128GB of unified RAM for 2,699$ That's a pretty good deal I would think https://frame.work/de/de/products/desktop-diy-amd-aimax300/c...
128GB*
I bet there’s gonna be a banger of a Mac Studio announced in June. Apple really stumbled into making the perfect hardware for home inference machines. Does any hardware company come close to Apple in terms of unified memory and single machines for high throughput inference workloads? Or even any DIY build? When it comes to the previous “pro workloads,” like video rendering or software compilation, you’ve always been…
> But inference is unique because its performance scales with high memory throughput, and you can’t assemble that by wiring together off the shelf parts in a consumer form factor. Nvidia outperforms Mac significantly on diffusion inference and many other forms. It’s not as simple as the current Mac chips are entirely better for this.
The Ultra variants of the M series chips had previously consisted of two of the Max chips bonded together. The M5 generation Pro and Max chips have moved to a chiplet based architecture, with all the CPU cores on one chiplet, and all the GPU cores on another. https://www.wikipedia.org/wiki/Apple_M5 So what will the M5 Ultra look like? If you integrate two CPU chiplets and two GPU chiplets, you're looking at 36 CPU co…
Earlier quoted context omitted.
lowest is probably an apple trade in if available, but i can't imagine how bad of a price hit it will be.
I checked, it's terrible. They don't take into account the size of the RAM in the machine, so you get the base-model trade-in value (£1280). Yeah, no.
I bet there’s gonna be a banger of a Mac Studio announced in June. Apple really stumbled into making the perfect hardware for home inference machines. Does any hardware company come close to Apple in terms of unified memory and single machines for high throughput inference workloads? Or even any DIY build? When it comes to the previous “pro workloads,” like video rendering or software compilation, you’ve always been…
> But inference is unique because its performance scales with high memory throughput, and you can’t assemble that by wiring together off the shelf parts in a consumer form factor. Nvidia outperforms Mac significantly on diffusion inference and many other forms. It’s not as simple as the current Mac chips are entirely better for this.
Earlier quoted context omitted.
Just out of curiosity, where do you think is the best place to sell a machine like that with the lowest risk of being scammed, while still getting the best possible price? Wish you a speedy recovery for your back!
> Just out of curiosity, where do you think is the best place to sell a machine like that with the lowest risk of being scammed, while still getting the best possible price? There are none currently on eBay.co.uk, so I'm going to try there. I'll also try some of the reddit UK-specific groups. As far as not being scammed - it's a really high value one-off sale, so it'll either be local pickup (and cash / bank-transfer…
I do know that Escrow.com is one of the most reputable escrow platforms, on a more personal note, I would love to know a escrow service where I can just sell the spare domains I have (I have got some .com/.net domains for 1$ back during a deal for a provider), is there any particular escrow service which might not charge a lot and I can get a few dollars from selling them as some of those domains aren't being used by me.
> Thank you :) It is a little better today. Sitting down is now tolerable for short periods... :)
I am wishing you speedy recovery as well. A cowboy gotta have a strong back :-)