"I am not sure how many people will run AI models locally. It still seems like a niche application to me. However, it will make decent machines to play video games." I don't know who will be the winner but with some of the recent releases from gemma it seems more probable that you may run some models locally if only from a cost perspective, not even considering business security. Not sure how this type of architectur…
> you may run some models locally if only from a cost perspective I have a hard time believing running a model on a laptop will be cheaper than running it in a datacenter. Why wouldn't economies of scale apply here as with every other computation?
Nvidia is proposing a beast of a CPU system for Windows PCs
181–190 of 581 posts
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#182I am not sure how many people will run AI models locally. It still seems like a niche application to me. I'd say this relates directly to the cost of running AI models remotely. And we won't know what the actual cost will be until AI vendors recover the huge pile of cash they've dumped into development (plus interest).
I think it's niche now because getting the hardware to run it is expensive and the quantized models don't work as well. If those improve then it would be a no brainer to pay one off for the hardware instead of a fortune for API calls.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#183Earlier quoted context omitted.
128GB seems the sweet spot for local models. I can program and install most GitHub projects with opencode and QWEN 32b with mtp. anyone whose addicted to token theoughput is losing the operational knowledge and offline capabilities. if you arent moving to the AMD 395 or MACs then youre hitching aride on the expensive calory ride
If you could buy a 256GB you’d be claiming that 256GB is a sweet spot. But I agree with you. Crack-tokens are not the future.
But watching everyone flounder because claude goes down or forcing you on API costs.
I'm programming things that'd take me days with a PC that, without OpenAI's VRAM shenagans, would cost you $2k.
It's more than just 'this is what I could do' it's definitely about 'this is what anyone could do with a new PC purchase'.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#184Yeah when laptops are shipping 8Gb and Microsoft is suddenly interested in native apps, nope. Tech companies have strangled their own market.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#185Earlier quoted context omitted.
Microsoft is sleeping on Qualcomm with their lousy port of Windows to Arm processors…
10000000x this. They have been sleeping on Arm since windows phone. I just don’t see them ever having an original thought again. They could have had a 128core arm chip by now.
There's also the whole giant trillion dollar company doesn't want to invest and let small ideas grow. They only focus on things that move the needle, which isn't much at the size.
Had Microsoft executed and invested, they could have made a come back imo in both search, mobile & hardware. Unfortunately major lack of leadership or they just don't want those areas.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#186And who in 2026 is still anal-fixated on a "Windows" PC? It's just a personal computer. It normally runs multiple operating systems just fine. Windows PC sounds like people talking about tech who are either payed by M$, or embed pictures into Word documents to send them. Nobody has to kill the fun those OS agnostic machine allow, by artificially bind them to a shitty OS.
For normal people, there are three computer operating systems: Windows, Apple, and ChromeOS. Nvidia isn't going with ChromeOS and Apple hates their guts, so Windows is the only normal operating system they can market.
Their marketing makes clear that these devices aren't the piddly Chromebooks that ruined the desktop experience for so many people (expensive Chromebooks were nice, but rare in practice).
Qualcomm promised Linux support, failed to deliver, and now anybody burnt by their promise won't want to buy their hardware again. If they promise a Windows PC, people won't have reason to complain when Linux or FreeBSD or SerenityOS won't boot on there. Given Qualcomm's failures here, Nvidia is probably doing the right thing.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#187The Qualcomm Snapdragon X2 Elite Extreme trounces Nvidia's chip in single core CPU performance. It beats Intel and AMD's best, too. It has unified memory. It's the only CPU in the same league as Apple's M-series in both CPU performance and power efficiency. And it's available in laptops today, not later this year. People are sleeping on Qualcomm.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#188Are their enterprise orders slowing down? Why use precious maxed out fab capacity on consumer stuff when it could be an enterprise chip?
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#189The Qualcomm Snapdragon X2 Elite Extreme trounces Nvidia's chip in single core CPU performance. It beats Intel and AMD's best, too. It has unified memory. It's the only CPU in the same league as Apple's M-series in both CPU performance and power efficiency. And it's available in laptops today, not later this year. People are sleeping on Qualcomm.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#190"I am not sure how many people will run AI models locally. It still seems like a niche application to me. However, it will make decent machines to play video games." I don't know who will be the winner but with some of the recent releases from gemma it seems more probable that you may run some models locally if only from a cost perspective, not even considering business security. Not sure how this type of architectur…
Qwen 3.6 is far ahead of Gemma for most (but not all) things. I've deployed it out across a number of M5 MacBooks and it's genuinely useful for many tasks. It won't replace an Opus or current gen Sonnet sized model but it's still amazingly good for its size and probably as good as or just a bit before Sonnet 4 era. Far more reliable for tool calling, coding, agentic tasks and faster than the Gemma models especially w…
Very significant improvements may be viable for unattended inference via large-scale batches, which can reuse sparse experts and thereby mask some of the latency involved - this is quite unique to DeepSeek, again due to its efficient KV cache.