Live data from Hacker News

Apple M3 Ultra

apple.com

121–130 of 1001 posts

Re: Apple M3 Ultra

#121
post #82

When would Apple silicons made natively support for OSes such as Linux? Apple seemlingly reluctant to release detailed technical reference manual for M-series SoCs, which makes running Linux natively on Apple silicon challenging.

Probably never. We don't have official Linux support for the iPhone or iPad, I would't hold out hope for Apple to change their tune.

That makes sense to me though. If you don’t run iOS, you don’t have App Store and that means a loss of revenue.

Re: Apple M3 Ultra

#122
The memory amount is fantastic, memory bandwidth is half decent(~800 GB/s), and the compute capabilities are terrible(36 TOPS).

For comparison, a single consumer card like the RTX 5090 is only 32 GB of memory, has 1792 GB/s memory and 3593 TOPS of compute.

The use cases will be limited. While you can't run a 600B model directly like Apple says(cause you need more memory for that), you can run a quantized version, but it will be very slow unless its a MoE architecture.

Re: Apple M3 Ultra

#123
post #43

Too bad it lacks even the streaming mode SVE2 found in M4 cores. If only Apple would provide a full SVE2 implementation to put pressure on ARM to make it non-optional so AArch64 isn't effectively restricted to NEON for SIMD.

This is for AI which is going to benefit more from use of metal / NPU than SIMD.

Sure, but larger models that fit in that 512gb memory are going to take a long time to tokenize/detokenize without hardware-accelerated BLAS.

Re: Apple M3 Ultra

#125
post #69
post #65

> support for more than half a terabyte of unified memory — the most ever in a personal computer AMD Ryzen Threadripper PRO 3995WX released over four years ago and supports 2TB (64c/128t) > Take your workstation's performance to the next level with the AMD Ryzen Threadripper PRO 3995WX 2.7 GHz 64-Core sWRX8 Processor. Built using the 7nm Zen Core architecture with the sWRX8 socket, this processor is designed to deliv…

> unified memory So unified memory means that the memory is accessible to the GPU and the CPU in a shared pool. AMD does not have that.

What about AMD Instinct accelerators like the MI300A[1]? Doesn't that use a single memory pool for both CPU and GPU cores?

[1] https://www.amd.com/en/products/accelerators/instinct/mi300/...

Re: Apple M3 Ultra

#126
Apart from enabling an 120h update to the XDR Pro, does TB5 offer a viable pathway for eGPUs on Apple Silicon macbooks?

This is a cool computer, but not something I'd want to lug around.

Re: Apple M3 Ultra

#128
post #60
post #46

They update the Studio to M3 Ultra now, so M4 Ultra can presumably go directly into the Mac Pro at WWDC? Interesting timing. Maybe they'll change the form factor of the Mac Pro, too? Additionally, I would assume this is a very low-volume product, so it being on N3B isn't a dealbreaker. At the same time, these chips must be very expensive to make, so tying them with luxury-priced RAM makes some kind of sense.

> Maybe they'll change the form factor of the Mac Pro, too? Either that or kill the Mac Pro altogether, the current iteration is such a half-assed design and blatantly terrible value compared to the Studio that it feels like an end-of-the-road product just meant to tide PCIe users over until they can migrate everything to Thunderbolt. They recycled a design meant to accommodate multiple beefy GPUs even though GPUs ar…

Agree with this, and it doesn't seem like it's a priority for Apple to bring the kind of expandability back any time soon.

Maybe they can bring back the trash can.

Re: Apple M3 Ultra

#129
post #74
post #39

Earlier quoted context omitted.

It is exactly the opposite. Every computer architecture in production addresses memory in the powers of two. SI has no business in memory size nomenclature as it is not derived from fundamental physical units. The whole klownbyte change was pushed through by hard drive marketers in 1990s.

Do SSD companies do the same thing? We ought to go back to referring to storage capacity in powers of two.

SSDs have added weirdness like 3-bit TLC cells and overprovisioning. Usable storage size of an SSD is typically not an exact power of 10 or 2.

Re: Apple M3 Ultra

#130
post #82

When would Apple silicons made natively support for OSes such as Linux? Apple seemlingly reluctant to release detailed technical reference manual for M-series SoCs, which makes running Linux natively on Apple silicon challenging.

That’s what’s weird to me too. It’s not like they would lose sales of macOS as it is given away with the hardware. So if someone wants to buy Apple hardware to run Linux, it does not have a negative affect to AAPL

Except the linux users won't be buying Apple software, from the app store or elsewhere. They won't subscribe to iCloud.
Post reply on HN