Live data from Hacker News

Apple M3 Ultra

apple.com

41–50 of 1001 posts

Re: Apple M3 Ultra

#41
post #2

> support for more than half a terabyte of unified memory Soldered?

Soldered? Figure out a way to make it unified without also soldering it, and you'll be a billionaire. Or are you just grinding a tired, 20-year-old axe.

Like all intel/amd integrated graphics that use the systems ram as vram?

Re: Apple M3 Ultra

#42
post #22

Previous model of M2 Ultra had max memory of 192GB. Or 128GB for Pro and some other M3 model, which I think is plenty for even 99.9% of professional task. They now bump it to 512GB . Along with insane price tag of $9499 for 512GB Mac Studio. I am pretty sure this is some AI Gold rush.

Maybe .1% of tasks need this RAM, why are they charging so much?

The narrower the niche, the more you can charge.

Re: Apple M3 Ultra

#43
Too bad it lacks even the streaming mode SVE2 found in M4 cores. If only Apple would provide a full SVE2 implementation to put pressure on ARM to make it non-optional so AArch64 isn't effectively restricted to NEON for SIMD.

Re: Apple M3 Ultra

#44

Earlier quoted context omitted.

Is there a single Apple SoC where they’ve provided removable ram? Not that I can recall.

Is there even an existing replaceable memory standard that would meet the current needs of Apple's "Unified Memory" architecture? I'm not an expert but I'd suspect probably not. The bus probably looks a lot more like VRAM on GPUs, and I've never seen a GPU with replaceable RAM.

It's really unfortunate that GPUs aren't fully customizable daughterboards, isn't it.

Re: Apple M3 Ultra

#45
post #8

512GB unified memory is absolutely wild for AI stuff! Compared to how many NVIDIA GPUs you would need, the pricing looks almost reasonable.

A server with 512GB of high-bandwidth GPU addressable RAM in a server is probably a six figure expenditure. If memory is your constrain, this is absolutely the server for you.

(sorry, should have specified that the NPU and GPU cores need to access that ram and have reasonable performance). I specified it above, but people didn't read that :-)

Re: Apple M3 Ultra

#46
They update the Studio to M3 Ultra now, so M4 Ultra can presumably go directly into the Mac Pro at WWDC? Interesting timing. Maybe they'll change the form factor of the Mac Pro, too?

Additionally, I would assume this is a very low-volume product, so it being on N3B isn't a dealbreaker. At the same time, these chips must be very expensive to make, so tying them with luxury-priced RAM makes some kind of sense.

Re: Apple M3 Ultra

#47

Whoa. M3 instead of M4. I wonder if this was basically binning, but I thought that I had read somewhere that the interposer that enabled this for the M1 chips where not available. That Said, 512GB of unified ram with access to the NPU is absolutely a game changer. My guess is that Apple developed this chip for their internal AI efforts, and are now at the point where they are releasing it publicly for others to use.…

>I had read somewhere that the interposer that enabled this for the M1 chips where not available.

With all my love and respect for "Apple rumors" writers; this was always "I read five blogposts about CPU design and now I'm an expert!" territory.

The speculation was based on the M3 Maxes die shots not having the interposer visible, which... implies basically nothing whether that _could have_ been supported in an M3 Ultra configuration; as evidenced by the announcement today.

Re: Apple M3 Ultra

#48
post #22

Previous model of M2 Ultra had max memory of 192GB. Or 128GB for Pro and some other M3 model, which I think is plenty for even 99.9% of professional task. They now bump it to 512GB . Along with insane price tag of $9499 for 512GB Mac Studio. I am pretty sure this is some AI Gold rush.

Maybe .1% of tasks need this RAM, why are they charging so much?

because that's how much its worth

Re: Apple M3 Ultra

#49
post #16
post #6

Ultra disappointing, they waited 2 years just to push out a single gen bump, even my last year's iPad Pro runs M4.

For AI workflows that's quite a lot cheaper than the alternative in GPUs.

Yeah VRAM option is good (if it performs well), just sad we'd have to drop 10K to access it tied to a prev gen M3 when they'll likely have M5 by the end of the year.

Hard to drop that much cash on an outdated chip.

Re: Apple M3 Ultra

#50

Earlier quoted context omitted.

Is there a single Apple SoC where they’ve provided removable ram? Not that I can recall.

Is there even an existing replaceable memory standard that would meet the current needs of Apple's "Unified Memory" architecture? I'm not an expert but I'd suspect probably not. The bus probably looks a lot more like VRAM on GPUs, and I've never seen a GPU with replaceable RAM.

I thought so too when they launched the M1, but I soon got corrected.

The memory bus is the same as for modules, it's just very short. The higher end SoCs have more memory bandwidth because the bus is wider (i.e. more modules in parallel).

You could blame DDR5 (who thought having a speed negotiation that can go over a minute at boot is a good idea?), but I blame the obsession with thin and the ability to overcharge your customers.

> I've never seen a GPU with replaceable RAM

I still have one :) It's an ISA Trident TVGA 8900 that I personally upgraded from 512k VRAM to one full megabyte!!!

Post reply on HN