I'm not contesting that AI will become worthwhile on local hardware at some point. With software optimization and hardware costs falling over time, that's pretty much a given.
But I'm arguing that it's not going to be worthwhile doing on Apple hardware.
GPU sharding is already a thing for PCs, and you don't need to stupidly buy multiple full computers for it to work.
Apple has put themselves into a corner with their Apple Silicon strategy. It's good for efficiency and thus quite nice for mobile usage, but it makes no sense for desktops that do not need to be power/space constrained.
Their GPUs are still weak, and their strategy of gluing 2 together gives poor results in general workloads. They are limited by the die size and the RAM bandwidth they can allocate to the whole thing because of physics.
If Apple manages to get good results by aggregating multiple computers, PCs will get even better results by using multiple GPUs in the same box, interconnected by the PCIe bus, which will always be faster than Thunderbolt no matter what, because of physics.
In fact, they could even come up with a new interconnect if need be.
There is just no realistic way for Apple to become a dominant player in AI. They cannot compete properly on the hardware side because they won't get the cash flow/key players NVidia and AMD are getting, and they cannot compete properly on software because it will always be ports of stuff made to run on better/faster hardware. They'll lose AI basically for the same reason they have lost gaming: uncompetitive performance for the price. People who actually want to do stuff care less about how things look and a lot more about how good/fast they run.
And whenever datacenters start offloading older GPUs, their price will fall, making it the cheapest way to do local AI. Apple hardware keeps a stupidly high price even when it's completely obsolete because of the status it confers; it will never be cost competitive.
It's basically a replay of their PPC mistake, where they thought they could compete by going at it alone but in the end fell pretty hard because they couldn't compete against the volume PCs were getting.
Now Apple has money but cannot attract enough talent because they have no vision, and the management style is basically mean girls running the show.
You are arguing about purchasing a solution that would cover 8 years of top-tier AI subscription. Seriously, who in their right mind would do that?
Apple hardware for AI makes no sense; either you have prosumer-level needs that are going to be served just fine with cheaper hardware (like, for example, Ryzen AI) or you have large needs, and investing in a real AI solution is going to be better because it's going to be much faster. Being able to fit large models is useless if they run too slow.