Is it really unified memory? AMD Strix Halo is "unified" but you still have to allocate memory separately for cpu vs gpu. Apple Silicon is true unified memory.
Nvidia is proposing a beast of a CPU system for Windows PCs
11–20 of 581 posts
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#12Does this person know that this is the same GB chip in the DGX Spark? It isn't some proposed thing, it's a chip loads of people have on their desk right now, and there are endless benchmarks of it. Decent single core (a long ways from Apple level, but decent), but it makes up for it in cores to provide M5 level performance, CPU wise. Memory bandwidth it is kind of starved, at 1/6th many GPUs. They got Microsoft to cu…
I heard the memory bandwidth is not just slower than on a GPU, as expected, but is significantly slower than Apple’s unified memory.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#13> I am not sure how many people will run AI models locally. It still seems like a niche application to me.
Bill Gates had a quote some years ago...
People have still not learned how fast we improve our tech and how much cheaper thing gets I guess :)
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#14I am not sure how many people will run AI models locally. It still seems like a niche application to me. I'd say this relates directly to the cost of running AI models remotely. And we won't know what the actual cost will be until AI vendors recover the huge pile of cash they've dumped into development (plus interest).
I think it's niche now because getting the hardware to run it is expensive and the quantized models don't work as well. If those improve then it would be a no brainer to pay one off for the hardware instead of a fortune for API calls.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#15"I am not sure how many people will run AI models locally. It still seems like a niche application to me. However, it will make decent machines to play video games."
I don't know who will be the winner but with some of the recent releases from gemma it seems more probable that you may run some models locally if only from a cost perspective, not even considering business security. Not sure how this type of architecture would make for good gaming though, puts into question the whole statement.
"Ranked in the top 2% of scientists globally (Stanford/Elsevier 2025) and among GitHub's top 1000 developers" - side note but this guy puts this everywhere, gives me probably the inverse of what he is marketing for.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#16nb: poster is Daniel Lemire ( https://lemire.me ), who is very skilled in getting performance out of compute hardware (e.g. via simd, cache usage etc)
As he likes to share often, "He ranks among the top 2% of scientists globally (Stanford/Elsevier 2025) and is one of GitHub's top 1000 most followed developers. "
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#17good to know, hope the price will be affordable, having a pc becoming a luxury :)
[deleted]
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#18Does this person know that this is the same GB chip in the DGX Spark? It isn't some proposed thing, it's a chip loads of people have on their desk right now, and there are endless benchmarks of it. Decent single core (a long ways from Apple level, but decent), but it makes up for it in cores to provide M5 level performance, CPU wise. Memory bandwidth it is kind of starved, at 1/6th many GPUs. They got Microsoft to cu…
Plus John Carmack has reviewed it, he was not amazed.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#19Is this essentially an Apple M-Series chip in concept?
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#20Are their enterprise orders slowing down? Why use precious maxed out fab capacity on consumer stuff when it could be an enterprise chip?
It uses LPDDR5X instead of VRAM and will still sell for a premium while pushing their presence even further in every side of the AI market. This was one area AMD was ahead in and now Nvidia is probably better off making this to compete on that front while still being better off than making a 5090.