"I am not sure how many people will run AI models locally. It still seems like a niche application to me. However, it will make decent machines to play video games." I don't know who will be the winner but with some of the recent releases from gemma it seems more probable that you may run some models locally if only from a cost perspective, not even considering business security. Not sure how this type of architectur…
The security aspect is the main driver why I’m seeing so many businesses investing in local hardware. They know the models aren’t as good (caveat that they also can’t run Chinese models) and that’s ok. Places that really care about security and data governance already aren’t on the bleeding edge. They wait for the nice stable lts version, they lock down dev machines in frustrating ways and have lots of IT admin layer…
Nvidia is proposing a beast of a CPU system for Windows PCs
161–170 of 581 posts
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#162Earlier quoted context omitted.
> "Ranked in the top 2% of scientists globally (Stanford/Elsevier 2025) and among GitHub's top 1000 developers" - side note but this guy puts this everywhere, gives me probably the inverse of what he is marketing for. Lol yeah seriously, that stinks "I ask AI to generate a huge amount of bullshit and upload it to pad irrelevant stats". Absolute loser.
I agree that it sends the wrong symbol, but actually Daniel is great. He cares tremendously about doing work that is actually real-world useful. I've co-written a few papers with him, and he's really hard working and open to outside suggestions. The danger is that if you send him comments, he'll eventually manage to rope you into writing a new and improved version. Seriously, if you are a non-academic computer scient…
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#163The Qualcomm Snapdragon X2 Elite Extreme trounces Nvidia's chip in single core CPU performance. It beats Intel and AMD's best, too. It has unified memory. It's the only CPU in the same league as Apple's M-series in both CPU performance and power efficiency. And it's available in laptops today, not later this year. People are sleeping on Qualcomm.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#164The Qualcomm Snapdragon X2 Elite Extreme trounces Nvidia's chip in single core CPU performance. It beats Intel and AMD's best, too. It has unified memory. It's the only CPU in the same league as Apple's M-series in both CPU performance and power efficiency. And it's available in laptops today, not later this year. People are sleeping on Qualcomm.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#165Earlier quoted context omitted.
and is Qualcomm is sleeping on Linux?
Seems like not? Judging based on https://github.com/qualcomm-linux something is happening, although I can't say how much. They definitively seem awake at least.
Some distros still need extracting Qualcomm firmware from Windows to get Linux to work properly. Audio remains a challenge, like x86 Linux decades ago. Apparently camera stuff works these days but produces images of subpar quality.
These issues also occur on normal Linux. My experience with my Lenovo+Intel laptop was that it took three months after release for the firmware to work properly (and the Nvidia drivers took much longer, but that's my fault for buying something containing Nvidia hardware). Intel managed to do what Qualcomm did in months rather than years.
I hope Qualcomm finally sorts this shit out, I really do, but with the prices of computers these days, I'm going to need to see quite the discount before I'll consider buying anything with a Snapdragon.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#166I've found it very useful for running big models, but it's not a screaming powerhouse in terms of raw compute.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#167It's effectively the same as the GB10 in the DGX Spark (Blackwell architecture, 6,144 CUDA cores, perf-wise comparable to an RTX 5070). I've found it very useful for running big models, but it's not a screaming powerhouse in terms of raw compute.
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#168Here is the press release for the actual machine: https://nvidianews.nvidia.com/news/nvidia-microsoft-windows-... I have been somewhat surprised at the lack of commentators observing that this is Microsoft and above all NVIDIA launching a device that is fundamentally at odds with the metered cloud model of AI. When you look at the other announcements and murmurings (better offline BYOK for Copilot, talk of an unmeter…
Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#169Re: Nvidia is proposing a beast of a CPU system for Windows PCs
#170Earlier quoted context omitted.
and is Qualcomm is sleeping on Linux?
Seems like not? Judging based on https://github.com/qualcomm-linux something is happening, although I can't say how much. They definitively seem awake at least.