[flagged]
New Mac Studio with M5 Max and M5 Ultra
221–230 of 571 posts
Re: New Mac Studio with M5 Max and M5 Ultra
#222It’d be great when they start releasing these machines with the local models ready for use!
They already do: https://developer.apple.com/documentation/foundationmodels/s...
Also see: https://apfel.franzai.com
Re: New Mac Studio with M5 Max and M5 Ultra
#223Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I've been thinking about this a fair bit recently. We make a lot of price/performance compromises for having an attached screen and keyboard on our computer. That was what got me started. Then I remembered the days of having to go to a special corner of the house to use a computer, vs now when I have a computer with me all the time. In my bag, on the sofa, on the train. Hell, I'm writing this on the work MBP while wa…
To me the idea of working on (non-docked) laptop always seemed like an idea that you would do only if there is no other possible way.
Screen is small and is only one. Ergonomics is entirely messed up. Either your screen is too low, or your keyboard is too high. Keyboards are non-ergonomic and have to be made with compromises due to height limits. Touchpad instead of mouse/trackball is compromise for many - and also stuck at one position.
And yet they have somehow spread despite number of people going on business trips not really increasing.
Re: New Mac Studio with M5 Max and M5 Ultra
#224I wish they were offering 1TB of Unified Memory for the M5 Ultra. I already have an M5 Max MBP w/ 128GB of RAM for running local models, and while there's a /few/ models that I can run in 512GB that I can't run in 128GB that are interesting, where things really shift is at 1TB of memory which allows you run >1T parameter models w/ 4 bit quants reliably. 512GB is just on the edge of "enough", which is maybe the point…
chaining an option?
They say you can cluster up to four with a shared memory pool, and get three times the inference performance of a single machine.
Re: New Mac Studio with M5 Max and M5 Ultra
#225Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
>I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Having owned 3 MacBook Pros since 2008, the decision to make my next computer be a Mac Studio came down to (1) MacBook thermal throttling that slows down CPUs when it starts to overheat and (2) easier upgrade of Mac Studio SSD with after-market storage module whereas the MacBook requires more complicated disassembly a…
You don't want a computer that does thermal throttling but also do not like it when the fans turn on?
Re: New Mac Studio with M5 Max and M5 Ultra
#22610 grand for 256GB memory. Likely double that for 512GB, but won't be available or finalized until October. Thunderbolt 5 is highest bandwidth external IO available at 120Gb/s. 1.2TB/s claimed max internal memory bandwidth. Not exactly "future proof" for >1T parameter models but good for targeting specific lower-parameter models, or if you can rely on pipeline parallelism and run a cluster.
That's in the same ballpark as two 128GB AI machines like the Asus GX10 or DGX Spark or Strix Halo. And, it seems very likely to perform better than either of those for inference. And, 256GB brings some pretty good models into play.
But, that doesn't make it a good deal. It just means the Apple tax doesn't apply when stacked up against AI machines and with memory prices being so out of whack. I'm still planning to wait until the RAMpocalypse ends before I buy any more hardware.
Re: New Mac Studio with M5 Max and M5 Ultra
#227Why doesn't Apple make a tower PC with a standard ATX motherboard, power supply, extension cards, etc, like in the old days? That's immensely more upgradable, easier to cool, and I don't believe most people expect their desktops PCs to be tiny.
The reason the mini & studio work as well as they do for the use cases that have made them popular again is because the architecture puts memory, cpu, and gpu/npu on the same die, and puts storage right next to it, which is why you get the storage & memory bandwidth you do. The separability of those components would break that, which is why the Mac Pro didn’t survive past one generation in the Apple Silicon era.
Re: New Mac Studio with M5 Max and M5 Ultra
#228Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
Oh yeah. Throw it behind tailscale. Herdr multiplexer in terminal is cool, it’ll remember your session if you open it in ssh from the neo
Re: New Mac Studio with M5 Max and M5 Ultra
#229The thing that intrigues me the most is this: "Storage performance is up to twice as fast, with a next-generation SSD architecture built on PCIe Gen 6..." This is the first personal computer I've noticed that has PCIe Gen 6 storage. I've only seen enterprise PCIe Gen 6 SSDs up until now. Gen 5 SSDs in consumer devices already have high temperatures and thermal throttling, so I'm worried about how Apple's implementati…
Im curious, how often is SSD / storage speed performance really useful? I feel like for many people it's akin to gigabyte wifi in that its nice to have, but not really particularly necessary
It's very important. Every time you launch an app or open a file it's critical for performance. Also when memory runs out and the OS swaps to disk it makes a huge difference.
Re: New Mac Studio with M5 Max and M5 Ultra
#230Insta-leased. I’ve ran over 1 million prompts on ollama to determine “is X website”. I’m ready to use use bigger models locally to do more thinking now. I have zero desire to give Dario anymore than $20 a month after his “you all are gonna be mass unemployed” spiel.