Live data from Hacker News

New Mac Studio with M5 Max and M5 Ultra

apple.com

51–60 of 570 posts

Re: New Mac Studio with M5 Max and M5 Ultra

#52
post #12

10 grand for 256GB memory. Likely double that for 512GB, but won't be available or finalized until October. Thunderbolt 5 is highest bandwidth external IO available at 120Gb/s. 1.2TB/s claimed max internal memory bandwidth. Not exactly "future proof" for >1T parameter models but good for targeting specific lower-parameter models, or if you can rely on pipeline parallelism and run a cluster.

> 10 grand for 256GB memory. A NVIDIA RTX 6000, 96 GB at 1.7 TB/s, is 13 grand. This 256 GB at 1.2 TB/s Mac is extremely competitive, it will be sold out everywhere.

How's the compute side now, I wonder? Because while the Ultras have impressive memory bandwidth for inference, processing prompts still takes a dog's age on my M3 Ultra. I heard the M5 makes some strides forward in this area, though, and the M7 in particular promises to go a lot further.

Re: New Mac Studio with M5 Max and M5 Ultra

#53
post #38
post #24

Earlier quoted context omitted.

It's fast by computer standards and excellent for entry level chip. The Pro/Max/Ultra chips are always faster. Compared to something like VRAM it's slow.

It's actually quite fast, more bandwidth than NVIDIA RTX 4090 at 1.0 TB/s according to https://www.digitalocean.com/community/tutorials/gpu-memory-... Compute power will still be different, though.

The thread you're replying to is asking about the 170GB/sec memory bandwidth of the base M6, not the faster spec of the Ultra chips.

Re: New Mac Studio with M5 Max and M5 Ultra

#54

Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.

I've been holding out, because I think my next purchase will be a Studio with an Ultra Chip in it. I'm wanting it to be a "forever" server, so I'm holding out while I can.

Then you'll always be waiting, there's always something new the industry tries to tempt you with.

Re: New Mac Studio with M5 Max and M5 Ultra

#55

Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.

I had the same thought, I grabbed a studio two years ago for this reason and it’s been great. 99% of the time lack of portability isn’t a concern. Every now and then (e.g. travel) I notice the limitation, but it’s not much of an inconvenience to just not do some work for a bit.

Plus remote work is getting easier and easier. There are so few instances when I'm not able to get online. If we lived in a world where hardware were getting cheaper, it might make sense to splurge. In this environment I think the Neo is perfect.

Re: New Mac Studio with M5 Max and M5 Ultra

#56

Earlier quoted context omitted.

So weird, launching M6 so silently.

Allegedly, they aren't making a big deal out of the M6 which won't have Pro, Max or Ultra configs at all, instead waiting for the M7: https://9to5mac.com/2026/08/08/apple-m7-chip-heres-why-it-ma...

Interesting, thanks for sharing.

Re: New Mac Studio with M5 Max and M5 Ultra

#57

Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.

Laptops can't do agentic engineering. They get hot as hell and battery drains instantly. I think this will promote a switch to desktops for the next couple of years, until we have new mobile chips.

Re: New Mac Studio with M5 Max and M5 Ultra

#58
post #13

I wish they were offering 1TB of Unified Memory for the M5 Ultra. I already have an M5 Max MBP w/ 128GB of RAM for running local models, and while there's a /few/ models that I can run in 512GB that I can't run in 128GB that are interesting, where things really shift is at 1TB of memory which allows you run >1T parameter models w/ 4 bit quants reliably. 512GB is just on the edge of "enough", which is maybe the point…

1tb would likely be ~$20k - given the current >$10k price tag of 256gb. Would you still be considering it at that price?

I would probably spend up to $30k if I could get 1TB of Unified Memory, because it would allow me a guarantee to run pretty much any local model I want, including >1T parameter models with reasonable quants. I wouldn't be surprised if 512GB is close to $20k when it becomes orderable in October. The justification is less about absolute price and more about price to what it enables. 512GB really doesn't enable much over 128GB for me, but 1TB would massively change things.

I have a bit of paranoia/anxiety about AI, but it's not what most people are concerned with. I understand the limits of these tools very well, and still find them extremely useful. What concerns me is that it's going to become difficult to impossible in the future to run local models which have near-SOTA capabilities in a way in which you can exercise full control of the model. I see the writing on the wall, and its more than worth it for me to invest early to ensure my own capabilities. I am very much not a fan of our "you'll own nothing and be happy" directionality for the world, and I am (at least currently) privileged to have the means to slow that decline for my own self.

Post reply on HN