Earlier quoted context omitted.
Thanks, yes, I meant even ordinary retail PCs, not specialized GPUs. At some point in time in history, SOTA closed models were at a level that compares to todays open models that can run on ordinary hardware.
Retail PCs will probably never catch up to even the open‑weight models (the full, non‑quantized versions). Unless there’s a breakthrough, they just don’t have enough parameters to hold all the information we expect SOTA models to contain. That’s the conventional view. I think there’s another angle: train a local model to act as an information agent. It could “realize” that, yeah, it’s a small model with limited knowl…
Re: Ask HN: Open Models are 9 months behind SOTA, how far behind are Local Models?
#11Maybe the industry adapts too and the future PC is AI-ready out-of-the-box. Because people demand that.