M6 (base) in Mac Mini too:
New Mac Studio with M5 Max and M5 Ultra
11–20 of 570 posts
Re: New Mac Studio with M5 Max and M5 Ultra
#1210 grand for 256GB memory. Likely double that for 512GB, but won't be available or finalized until October. Thunderbolt 5 is highest bandwidth external IO available at 120Gb/s. 1.2TB/s claimed max internal memory bandwidth.
Not exactly "future proof" for >1T parameter models but good for targeting specific lower-parameter models, or if you can rely on pipeline parallelism and run a cluster.
Re: New Mac Studio with M5 Max and M5 Ultra
#13I wish they were offering 1TB of Unified Memory for the M5 Ultra. I already have an M5 Max MBP w/ 128GB of RAM for running local models, and while there's a /few/ models that I can run in 512GB that I can't run in 128GB that are interesting, where things really shift is at 1TB of memory which allows you run >1T parameter models w/ 4 bit quants reliably. 512GB is just on the edge of "enough", which is maybe the point of maximum frustration considering current memory prices.
Personally, I can't justify dropping the dosh for a 512GB M5 Ultra, but I would be able to justify it to myself if I could get 1TB of memory, because it'd guarantee the flexibility with local models I currently am missing. Seems a huge miss to not offer this... for a price.
Re: New Mac Studio with M5 Max and M5 Ultra
#14Re: New Mac Studio with M5 Max and M5 Ultra
#15Mac Studio with M5 Max starts at $2,499 (U.S.) and $2,299 (U.S.) for education. Additional configure-to-order options are available at apple.com/mac-studio. Mac Studio with M5 Ultra starts at $5,499 (U.S.) and $5,099 (U.S.). I am in Europe, and the Mac Studio M5 Ultra GPU 64 cores with 96GB RAM is up to 6.649,00 €. Ouch.
[deleted]
Re: New Mac Studio with M5 Max and M5 Ultra
#16> M6 supports up to 32GB of unified memory to multitask across demanding apps and run LLMs on device for secure and private agentic tasks. It also provides up to 170GB/s of unified memory bandwidth — a 10 percent increase over M5 and a 2.5x increase over M1. Isn't 170GB/s slow for bandwidth?
It is. That's the mac mini. For local LLMs you would want the Mac Studio, which tops out at 1.2TB/s.
Re: New Mac Studio with M5 Max and M5 Ultra
#17M6 (base) in Mac Mini too: https://www.apple.com/mac-mini/
So weird, launching M6 so silently.
Re: New Mac Studio with M5 Max and M5 Ultra
#18Bizarre there isn’t a 1TB RAM option hidden away for the excessively frivolous or VC funded.
Same reason they cut the big options on the existing models, this way they can sell more devices. The additional cost for the additional 512GB would have to make up for the loss of another sold device otherwise. No idea if there would really be that many people buying this then while on the other hand AI stuff makes people do crazy stuff, so...yeah :)
Re: New Mac Studio with M5 Max and M5 Ultra
#19512GB unified memory option coming available in October.
The 256GB option is +$4,000 - the overall price for 512GB setup would probably be $20k!
Re: New Mac Studio with M5 Max and M5 Ultra
#20> M6 supports up to 32GB of unified memory to multitask across demanding apps and run LLMs on device for secure and private agentic tasks. It also provides up to 170GB/s of unified memory bandwidth — a 10 percent increase over M5 and a 2.5x increase over M1. Isn't 170GB/s slow for bandwidth?
Kinda. Strix Halo does 256GB/s of memory bandwidth, and is significantly slower than an M5 Max (614GB/s). Feels like intentional market segmentation?