The 128GB M5 Max MBP I ordered at launch was $7049 and is now $9849 for the same configuration, that's nearly a 30% price increase and more than $2000 bump. During the same time from launch to now, I have seen local LLMs get significantly better, to the point that I wish more people had hardware like this to be able to localize their workloads. I can't help but think society is moving in the wrong direction with this…
There are two things that would prevent people from using local models - pricing and regulations. And we're seeing moves from both of those fronts lately.