31–40 of 437 posts
Some other relevant discussions and sources … NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI https://news.ycombinator.com/item?id=48352705 NVIDIA DGX Station for Windows Puts a Trillion-Parameter AI Supercomputer on Every Enterprise Desk https://news.ycombinator.com/item?id=48352691 Introducing Surface Laptop Ultra: Made for world makers https://news.ycombinator.com/item?id=48352627 Introducing…
Is this finally Macbook Chip Efficiency coming to Windows or will it just be shittier compatibility for slightly better battery life?
All I care about is if I can get one of these for significantly less than a dgx and get Linux on it for some cuda Blackwell kerneling.
competitor is already on the market and is x86: AMD AI 395+ bechmarks with DGX arnt spectacular for NVIDIAs software and CUDA lead. wouldnt count on this being a price/compute challenger. especially with overpriced VRAM.
Also I heard the tensor core instructions on the dgx are gimped and you’re better off with a rtx pro x000. Is that the same with these machines?
I really like this, but I think the reason Apple Silicon took off was that Apple sort of forced devs to support ARM. Not sure if Microsoft can do the same for Windows…
Earlier quoted context omitted.
Or like a m4 max? This thing has All those CUDA cores in the sparks but they're starved for memory bandwidth. I am still waiting for NVidia to release a system that legit beats 3090 maxxing for the home gamer...
Spark: OS: Windows/Ubuntu Mbw: 300GB/s Cuda cores: 6000 GPU accelerated containers: yes M5 max: OS: macOS Mbw: 600GB/s Cuda cores: 0 GPU accelerated containers: no
The sparks are good if your ultimate plan is to spend even more on NVidia hardware in future to run your dev setups at usable speeds. Or, you're developing for a work cluster.
If you mainly want to run local models at acceptable speeds portably, buy a mac with lots of RAM. If you’re happy with non-portable / racked, buy 3090s (dense) or mac studios (MoEs). Buy newer cards if you are restricted on power or slots. If you are rich, buy a6000 blackwells.
Earlier quoted context omitted.
That's what they're working on, in theory, with Windows K2.
I would never trust Microsoft. Their next drama is revoking Office 2019 perpetual licenses https://www.youtube.com/watch?v=KRnno9VIZx0 . It never ends with them because they know they have you by the balls.