If I were to get one of these, realistically what is the most advanced AI model I could run locally?
GLM 5.3 in ~q4 quantiziation with 4bits
New Mac Studio with M5 Max and M5 Ultra
101–110 of 567 posts
Re: New Mac Studio with M5 Max and M5 Ultra
#102The article's headline contains an em dash. I wonder if it's AI-generated
Re: New Mac Studio with M5 Max and M5 Ultra
#103The article's headline contains an em dash. I wonder if it's AI-generated
To me it seems like a cheeky way to preface the AI part of the title.
Re: New Mac Studio with M5 Max and M5 Ultra
#104Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I'd never go x86 again after owning an m1. I'd have replaced an x86 laptop 2 or 3 times by now (2020 m1). My last $3500 dell xps 13z before buying the m1 was absolutely horrible.
Re: New Mac Studio with M5 Max and M5 Ultra
#105The article's headline contains an em dash. I wonder if it's AI-generated
My sarcasm detector just made a small cloud of smoke. What does that mean, a buffer over or underflow??
Re: New Mac Studio with M5 Max and M5 Ultra
#106Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
I can't wait for an actual competitor to the M chips from apple. It's frustrating.
Re: New Mac Studio with M5 Max and M5 Ultra
#107Boy, oh boy Apple is the new shovel seller during AI gold rush.
Most people at Apple have already realized that their processors are already too powerful for regular users - heck, as a developer my M2 Pro with 32 GB RAM is more than enough for me.
Regular users don’t care about local AI either. So, they will probably extract as much money as possible during AI gold rush, but then we will most likely see Apple
a. Making their software worse (god forbid, forced updates)
b. Making their hardware impossible to repair (as they almost accomplished this already) and easier to break.
Re: New Mac Studio with M5 Max and M5 Ultra
#108Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
For a desktop you may find yourself better on a Linux or Windows machine price/performance wise.
I personally own an M3 ultra, an M1 max as laptops, but my desktop is a Ryzen desktop I built in 2022 and it was a third in price of the ultra for more power.
Re: New Mac Studio with M5 Max and M5 Ultra
#109Bizarre there isn’t a 1TB RAM option hidden away for the excessively frivolous or VC funded.
Same reason they cut the big options on the existing models, this way they can sell more devices. The additional cost for the additional 512GB would have to make up for the loss of another sold device otherwise. No idea if there would really be that many people buying this then while on the other hand AI stuff makes people do crazy stuff, so...yeah :)
Considering Apple pricing it actually might.
256GB model is $10k and the 512GB version will probably be double
Re: New Mac Studio with M5 Max and M5 Ultra
#110The new mac minis and mac studios are going to be in shortage for at least first 6 months from 9.22