macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
developer.apple.com
macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
1–10 of 304 posts
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#2Can we get proper HDR support first in macOS? If I enable HDR on my LG OLED monitor it looks completely washed out and blacks are grey. Windows 11 HDR works fine.
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#3I follow the MLX team on Twitter and they sometimes post about using MLX on two or more joined together Macs to run models that need more than 512GB of RAM.
A couple of examples:
Kimi K2 Thinking (1 trillion parameters): https://x.com/awnihannun/status/1986601104130646266
DeepSeek R1 (671B): https://x.com/awnihannun/status/1881915166922863045 - that one came with setup instructions in a Gist: https://gist.github.com/awni/ec071fd27940698edd14a4191855bba...
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#4I imagine that M5 Ultra with Thunderbolt 5 could be a decent contender for building plug and play AI clusters. Not cheap, but neither is Nvidia.
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#5I imagine that M5 Ultra with Thunderbolt 5 could be a decent contender for building plug and play AI clusters. Not cheap, but neither is Nvidia.
nvidia is absolutely cheaper per flop
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#6Can we get proper HDR support first in macOS? If I enable HDR on my LG OLED monitor it looks completely washed out and blacks are grey. Windows 11 HDR works fine.
Really? I thought it's always been that HDR was notorious on Windows, hopeless on Linux, and only really worked in a plug-and-play manner on Mac, unless your display has an incorrect profile or something/
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#7Very cool. It requires a fully-connected mesh so the scaling limit here would seem to be 6 Mac Studio M3 Ultra, up to 3TB of unified memory to work with.
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#8Now we need some hardware that is rackmount friendly, an OS that is not fidly as hell to manage in a data center or headless server and we are off to the races! And no, custom racks are not 'rackmount friendly'.
Re: macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
#9It would be incredibly ironic if, with Apple's relatively stable supply chain relative to the chaos of the RAM market these days (projected to last for years), Apple compute became known as a cost-effective way to build medium-sized clusters for inference.