Live data from Hacker News

Ask HN: Open Models are 9 months behind SOTA, how far behind are Local Models?

news.ycombinator.com

11–13 of 13 posts

Re: Ask HN: Open Models are 9 months behind SOTA, how far behind are Local Models?

#11
post #8
post #6

Earlier quoted context omitted.

Thanks, yes, I meant even ordinary retail PCs, not specialized GPUs. At some point in time in history, SOTA closed models were at a level that compares to todays open models that can run on ordinary hardware.

Retail PCs will probably never catch up to even the open‑weight models (the full, non‑quantized versions). Unless there’s a breakthrough, they just don’t have enough parameters to hold all the information we expect SOTA models to contain. That’s the conventional view. I think there’s another angle: train a local model to act as an information agent. It could “realize” that, yeah, it’s a small model with limited knowl…

Maybe the industry adapts too and the future PC is AI-ready out-of-the-box. Because people demand that.

Re: Ask HN: Open Models are 9 months behind SOTA, how far behind are Local Models?

#12
Local models are not behind. There are many specialized local models on huggingface that can do things that none of the closed/commercial models can do. The only way to get that edge is to run locally. When I say many, I mean in the thousands.

Re: Ask HN: Open Models are 9 months behind SOTA, how far behind are Local Models?

#13

Local models are not behind. There are many specialized local models on huggingface that can do things that none of the closed/commercial models can do. The only way to get that edge is to run locally. When I say many, I mean in the thousands.

Yes, fair point. I was trying to use the same comparison we are currently having between closed weights and open weights and their time gap. If there might be a similar time gap to what is possible with ordinary equipment.
Post reply on HN