31–40 of 1001 posts
Previous model of M2 Ultra had max memory of 192GB. Or 128GB for Pro and some other M3 model, which I think is plenty for even 99.9% of professional task. They now bump it to 512GB . Along with insane price tag of $9499 for 512GB Mac Studio. I am pretty sure this is some AI Gold rush.
> support for more than half a terabyte of unified memory Soldered?
> support for more than half a terabyte of unified memory Soldered?
The issue is availability of chips and most likely you have to know which components to change so the new memory is recognised. For instance that could be changing a resistor to different value or bridging certain pads.
what's the point of 512GB RAM for LLMs on this Mac Studio if the speed is painfully slow?
it's as if Apple doesn't want to compete with Nvidia... this is really disappointing in a Mac Studio. FYI: M2 Ultra already has 800GB/s bandwidth
Why? They have too many M3 chips on stock?
People who know more than me: they’re talking a lot about RAM and not much about GPU. Do you expect this will be able to handle AI workloads well? All I’ve heard for the past two years is how important a beefy GPU is. Curious if that holds true here too.
VRAM is what takes a model from "can not run at all" to "can run" (even if slowly), hence the emphasis.
Call me a unit fundamentalist but calling 512Gb "over half a terabyte memory" irks me to no end.
It's over half a _tera_byte; exactly half of _tebi_byte if you wanna be a fundamentalist.
SI has no business in memory size nomenclature as it is not derived from fundamental physical units. The whole klownbyte change was pushed through by hard drive marketers in 1990s.