181–190 of 1001 posts
> M6 supports up to 32GB of unified memory Is this a joke? > Additionally, M5 Ultra features a massive amount of high-bandwidth unified memory, up to 512GB Now we're talking. But at what cost?
256 memory gets you to like 11k. So like 15-20k.
Earlier quoted context omitted.
As someone who works in AI now, I have found it pretty amazing that Apple basically didn't do much with AI software, and focused more on the hardware side. I think this is what the future of AI is going to look like, local models run on your mac for your workflow. It's possible that they're working on their own LLM that's going to work very well on their chips, and possibly outperform anything out there when they do…
|It's possible that they're working on their own LLM Yep, Siri AI; they’re doing it in public.
will be great fun if one M5 Ultra with 512GB memory at 1.2T bandwidth capable of doing 3x smallish local model inferencing each at Opus 4.5 level of intelligence.
The problem I'm having now is that no models are targeting RAM of that size. Everything is either much smaller, targeting laptops, or much larger, targeting hardware well out of reach of enthusiasts.
Please, AI people, start making models targeting 128GB machines again. The last interesting one was Qwen 3.5 122B.
Apple still has the best hardware so I moved to it for the last few years, but the closed software ecosystem is terrible for taking advantage of it. I wasn't able to debug network errors (restartin my Mac worked), Metal was missing low level disassembly / debugging tools (there is some hard to use UI), but the worst thing was the inflexible windowing system. Even getting all the window handles on all screens/desktops…
On what hardware you running Omarchy?
I ordered an ASUS Zephyrus G16 with 5090 NVIDIA card + 1.9kg (quite an overkill, and I know that I will have to limit power output), but hasn't arrived yet.
But what's fun is that I love QML+QuickShell with its hot reloading, Hyprland with its Lua support.
With AI nowdays it's just so easy to do deep UI changes that wasn't possible a year ago.
The 512GB Ultra is amazing, sure. But who is it for exactly? VC funded big spender founders? In that case why would they need local AI? The ultra rich enthusiast? But there can't be too many of those. So who actually buys these?
Earlier quoted context omitted.
Is there anything comparable that runs Linux, doesn't necessarily look as good, but is perhaps (a lot) cheaper/fixable? Or is this really pretty optimal? I mean this is not nvidia based right? It's all custom? So we can use it under Asahi perhaps? I want to get something for my company to run local models, wondering what would be a good option.
Asahi was stuck at M3 last time I checked it out.
Apple Studio with maxed out M5 Ultra, 256GB RAM and 16TB storage is 18,299$. The 512GB RAM version apparently is coming in October, considering that the difference between 96GB and 256GB is priced at 4000$, the 512GB upgrade must be eye watering. So, on the mini the RAM upgrade runs at 25$ per GB on all tiers, the same as the Studio therefore the upgrade to 512 will probably cost 6400$. The fully maxed out Apple Stud…
512GB late october sounds lame. and 512GB is so 2025. Give us 1TB version. Where is the competitive spirit?
To be fair, where is the competitor at this form factor?