> I think the long term trend is typically the high end technology of today will be the mid to low tier technology of the future.
The trend doesn't look like that. The PCI bus from 1992 had 124 pins. PCIe 5.0 x16 has 164 pins; x8 has even fewer pins than the slots from decades ago. Guess how many pins Thunderbolt has. DDR1 DIMMs from the year 2000 had 184 pins; DDR5 has 288. The number of pins goes up very slowly if at all, because it's one of the most expensive ways to increase performance, despite being effective.
Which is why the enterprise hardware has always done it and the consumer hardware hasn't.
> Apple and other companies are gradually working towards moving AI models to be more local which means memory bandwidth has a real killer app use case right now.
The real problem is that ordinary consumers don't want to pay for 128GB of GDDR or HBM, and if they did then you would attach it to the GPU rather than the CPU anyway.
What they might want is the less expensive ordinary DRAM with a wider bus, which is what Apple does, but then you're not using 1024 pins and have no need to solder it instead of using CAMM.
> Witness Liquid AI and their partnership with Mercedes Benz to put 8B param LLM models into vehicles.
8B param models don't need exotic hardware, those run on existing consumer GPUs.
> Both Desktop PCs and the CPU are becoming less and less relevant as we move further in the decade to be honest...
Less relevant to what? Making up for the inefficiency of bad JavaScript with fast hardware? Running the less parallelizable parts of PC games? Databases and other branchy server workloads? They're as relevant as ever to the things they've always been relevant to.