Nvidia is proposing a beast of a CPU system for Windows PCs
1–10 of 581 posts
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#2good to know, hope the price will be affordable, having a pc becoming a luxury :)
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#3128GB of unified memory is a dream come true for local LLMs. VRAM has been the ultimate bottleneck for developers.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#4I am not sure how many people will run AI models locally. It still seems like a niche application to me.
I'd say this relates directly to the cost of running AI models remotely.
And we won't know what the actual cost will be until AI vendors recover the huge pile of cash they've dumped into development (plus interest).
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#5128GB of unified memory is a dream come true for local LLMs. VRAM has been the ultimate bottleneck for developers.
[dead]
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#6nb: poster is Daniel Lemire (https://lemire.me), who is very skilled in getting performance out of compute hardware (e.g. via simd, cache usage etc)
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#7Are their enterprise orders slowing down? Why use precious maxed out fab capacity on consumer stuff when it could be an enterprise chip?
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#8Does this person know that this is the same GB chip in the DGX Spark? It isn't some proposed thing, it's a chip loads of people have on their desk right now, and there are endless benchmarks of it.
Decent single core (a long ways from Apple level, but decent), but it makes up for it in cores to provide M5 level performance, CPU wise. Memory bandwidth it is kind of starved, at 1/6th many GPUs.
They got Microsoft to customize Windows for the RTX Spark, and will likely have to brutally throttle it when running as a laptop (it's literally a 140W TDP chip), and that's neat. It's going to be a very expensive laptop.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#9good to know, hope the price will be affordable, having a pc becoming a luxury :)
Certainly not in the year of our lord, 2026. Maybe in a few years though.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#10128GB of unified memory is a dream come true for local LLMs. VRAM has been the ultimate bottleneck for developers.
It could help with exploding external LLM costs.
Interesting to see how the adaption will be, which will mainly depend on the price.