Incredible that LMStudio, an open and ever evolving (unstable) project, is cited as a speed reference.
New Mac Studio with M5 Max and M5 Ultra
321–330 of 571 posts
Re: New Mac Studio with M5 Max and M5 Ultra
#322Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I’ve wanted the idea of a home server or even home “mainframe” and some terminals for me and family forever but the idea never takes off….
Re: New Mac Studio with M5 Max and M5 Ultra
#323Re: New Mac Studio with M5 Max and M5 Ultra
#324unfortunately it does not run linux
Re: New Mac Studio with M5 Max and M5 Ultra
#325Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I've been using the free version of TailScale to use macOS's built-in screen sharing app to use my home Mac mini from my work MacBook Pro. Works great! That combined with ChatGPT/Codex's "remote" feature is an amazing combination. I think you'd be totally fine with a Mac Studio + Neo.
Re: New Mac Studio with M5 Max and M5 Ultra
#326Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I've been running a desktop Mac in addition to MacBook and iPad for the past decade (currently a first gen Studio still holding quite strong). It's primarily a focus thing, secondarily it's a way to keep work happening locally while I'm elsewhere, and never have the frustrations of docking and screen geometries all re-arranging, etc. The iPad is at the opposite extreme, it's for recreation, burn out management. The MacBook exists for when I actually need to do "real work" outside of the house.
Re: New Mac Studio with M5 Max and M5 Ultra
#327Earlier quoted context omitted.
What if you have some battery system working? Then technically, you could travel with it
At that point you lose too much convenience. Maybe if someone built a mini UPS with at least 10000Ah capacity, USB-C 4 pass-through and the right form factor to permanently attach it on top of the mini.
Re: New Mac Studio with M5 Max and M5 Ultra
#328Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I've been using the free version of TailScale to use macOS's built-in screen sharing app to use my home Mac mini from my work MacBook Pro. Works great! That combined with ChatGPT/Codex's "remote" feature is an amazing combination. I think you'd be totally fine with a Mac Studio + Neo.
I have been considering this.
I bought a Macbook Air in the interm waiting to see what the Macbook Ultra looks like, but honestly—it's the best form factor ever. I love it! Even though it's only like a pound heavier, the Pro feels like a monster.
Thinking about getting a Mini or Studio with more horsepower to stay at home.
Any other apps or suggestions? I'm still not exactly sure what working this way looks like.
Re: New Mac Studio with M5 Max and M5 Ultra
#32910 grand for 256GB memory. Likely double that for 512GB, but won't be available or finalized until October. Thunderbolt 5 is highest bandwidth external IO available at 120Gb/s. 1.2TB/s claimed max internal memory bandwidth. Not exactly "future proof" for >1T parameter models but good for targeting specific lower-parameter models, or if you can rely on pipeline parallelism and run a cluster.
> Not exactly "future proof" Computers are never "future proof".
They do however last a much longer time now.
A 8 years old graphics card can still play modern games. Ten years ago playing a modern game on hardware that old would've been unthinkable.
And with how the market is right now, we'll be stuck on the current "reference level" of hardware for a while longer.
Re: New Mac Studio with M5 Max and M5 Ultra
#330Earlier quoted context omitted.
I thought the question was low-end MacBook + mini vs high-end MacBook. The low-end one has all those nice things. I wouldn't sacrifice that. If it has to be MacBook + super old used mini as home server, so be it.
Except for LLM inference speed, macs suck as a server and are pretty expensive, why wouldn't you get a Linux box?
Buying a Mac specifically for serving is misguided in nearly all use cases, but as an all-in-one solution they make sense. Personally I feel like the number of boxes I need to manage has an inverse correlation to my happiness.
Macs are totally “fine” for light server duty… as is just about any computer of the last decade+. The CPUs are beasts, the disks are screaming fast.
The operating system itself may not be ideal at serving but you can just run Docker/Orbstack if you need to do something especially Linux-y.
I’d put the question back on you — what are scenarios where an Apple Silicon Mac wouldn’t cut it as a light server for one person or a handful of people? About the only scenario that comes to mind is scenarios where you expect to utilize it so heavily that the fans are running for many hours a day. At some point those are either gonna wear out or just ingest so much dust that the machine runs hotter and needs a deep clean. But even that is largely mitigated by just pointing an external fan at it.