unfortunately it does not run linux
I’m running an Ubuntu VM via Lima on my m4 Mac mini. Works great.
New Mac Studio with M5 Max and M5 Ultra
531–540 of 571 posts
Re: New Mac Studio with M5 Max and M5 Ultra
#532The thing that intrigues me the most is this: "Storage performance is up to twice as fast, with a next-generation SSD architecture built on PCIe Gen 6..." This is the first personal computer I've noticed that has PCIe Gen 6 storage. I've only seen enterprise PCIe Gen 6 SSDs up until now. Gen 5 SSDs in consumer devices already have high temperatures and thermal throttling, so I'm worried about how Apple's implementati…
I think this is wrong - it will likely be PCIe gen 5. Apple doesn't say PCIe gen 6 anywhere and this doubling would be from the previous Mac Studio, which probably had PCIe gen 4. So this would match what happened on macbooks recently - upgrade to PCIe gen 5.
I think someone made incorrect conclusions and everyone just copied them.
Re: New Mac Studio with M5 Max and M5 Ultra
#533Earlier quoted context omitted.
I've been thinking about this a fair bit recently. We make a lot of price/performance compromises for having an attached screen and keyboard on our computer. That was what got me started. Then I remembered the days of having to go to a special corner of the house to use a computer, vs now when I have a computer with me all the time. In my bag, on the sofa, on the train. Hell, I'm writing this on the work MBP while wa…
To me the idea of working on (non-docked) laptop always seemed like an idea that you would do only if there is no other possible way. Screen is small and is only one. Ergonomics is entirely messed up. Either your screen is too low, or your keyboard is too high. Keyboards are non-ergonomic and have to be made with compromises due to height limits. Touchpad instead of mouse/trackball is compromise for many - and also s…
I have been using docking stations since 2006, and apparently if I want to buy a serious desktop that doesn't look like car tuning in a box, I have to build it myself, given the available configurations on ready to go desktops.
Re: New Mac Studio with M5 Max and M5 Ultra
#534Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I would not use Neo, Air with 24 GB ram should be your minimum because you will want to do some work locally even when you're running a VPN/SSH thin client setup. I'm currently SSH-ing into my workstation from my M4 Air with 24 gb ram and it's ideal for this flow. Slack/editors/clients/browsers/etc. easily gobble up over 16 GB. I have no more dev tools/compilers/source on my client machines, everything is dockered up…
I'm sorry but that's a bit ridiculous. I'm still using an M1 Pro with 16GB of RAM and I have quite heavy usage - docker, other heavy native apps, a bunch of VS.Codes and coding agents, things running in the terminal, background processes. It's just a big exaggeration that general regular productivity apps "easily gobble up over 16GB"
(Edit: saying this as someone who just paid for a new 128GB M5 Pro Studio -- but that's for LLM's, not regular work)
Re: New Mac Studio with M5 Max and M5 Ultra
#535Earlier quoted context omitted.
I've been thinking about this a fair bit recently. We make a lot of price/performance compromises for having an attached screen and keyboard on our computer. That was what got me started. Then I remembered the days of having to go to a special corner of the house to use a computer, vs now when I have a computer with me all the time. In my bag, on the sofa, on the train. Hell, I'm writing this on the work MBP while wa…
I've done that, but I chose a Framework Desktop instead. The latest Fedora is closer to Snow Leopard than anything Apple has to offer. Downside is that I still have my MBP because of the lock-in and occasionally pick it up to do computer stuff in weird places.
[deleted]
Re: New Mac Studio with M5 Max and M5 Ultra
#536Earlier quoted context omitted.
You made claims about performance per watt and other metrics which were completely unsubstantiated and aren't backed up by the line you quoted. That's what I was asking for citations about.
What other metrics?
Do I need to quote your own statement to you, verbatim, again?
> Mac studio wins in memory capacity, price, perf/watt and value.
Re: New Mac Studio with M5 Max and M5 Ultra
#537Re: New Mac Studio with M5 Max and M5 Ultra
#538Earlier quoted context omitted.
I’ve run the numbers on this, and an optimized nVidia build can meet or beat Apple platforms in terms of tokens per watt, which is the most important efficiency metric if what you care about is using the least amount of energy to generate a given response. Yes, the Mac might get lukewarm, but it will take 2-3+ times longer to do the same task.
Yes I agree that at full speed with parallel workloads, the tokens per watt are better using Nvidia GPU servers. Also while the pre fill performance sucks, the Mac isn’t that slow and can use much better model compared to a similarly priced Nvidia workstation so it’s not really taking much longer in practice. It’s taking longer than in the cloud for sure. At least a local computer uses the local energy grid that is p…
Okay, so you said “Energy efficiency is in another league with the Mac Studio”; I assume you meant that it was more efficient than an nVidia GPU setup. But when pressed, you agreed that’s not actually the case. So it’s not actually that much different in terms of energy efficiency.
> Also while the pre fill performance sucks, the Mac isn’t that slow and can use much better model compared to a similarly priced Nvidia workstation so it’s not really taking much longer in practice.
This is exactly backwards; assuming you mean that the Mac has more RAM so you can use a larger model, the mac is going to be _even slower_ since the fastest Mac isn’t as fast as the average nVidia setup.
My point is that comparing apples to apples (no pun intended), an nVidia setup is both faster and (possibly with some tweaking) more efficient than a Mac.
Re: New Mac Studio with M5 Max and M5 Ultra
#539Earlier quoted context omitted.
Do I need to quote your own statement to you, verbatim, again? > Mac studio wins in memory capacity, price, perf/watt and value.
Mac Studio winning in memory capacity is just a fact. That's why I'm confused.
Yes, I agree. What about the other metrics, including performance per watt which I’ve now mentioned four times and you’ve ignored the previous three times?
Re: New Mac Studio with M5 Max and M5 Ultra
#5401.2 TB/s bandwidth of M5 Ultra comes from two dies of M5 Max (each 614 GB/s) connected together using 4.4 TB/s inter-die fabric. For a non-quantized Deepseek V4 flash on an ultra, I would estimate about 1000+ tokens per second prefill and 50+ tokens per second on generation. This is actually quite usable and near parity to cloud. They mention "adds the GPU Neural Accelerators." which, if exploitable for LLM loads, wo…
How much would is the cost for that machine though, I'm pretty sure I could just buy tokens from a provider and never run out of money for 10 years, and get far better quality output because inference is being served by professionals on far better hardware and this machine would be obsolete long before that as well. Hosting local seems like a possibly the dumbest thing you could possibly do from an economics perspect…
Why is the privacy argument invalid?
There is definitely classes of data that you legally can't share over "fucking gmail, whatsapp and instagram" and you can't send to commodity token providers either.
Taking liberties to save money at the expense of regulatory duties is a good way to get hit with a massive fine if you work in financial or health services.
This is a product aimed at niche professionals doing paid work. If you don't need that just move on to something else.