Love seeing AMD forcing Novideo to catch up for once rather than the other way around.
Nvidia RTX Spark
241–250 of 437 posts
Re: Nvidia RTX Spark
#242can these do training or only inference? currently working on learning machine learning and I'd love to have a physical machine I could aim to build real workloads on in a few years.
Re: Nvidia RTX Spark
#243Earlier quoted context omitted.
DGX Spark comes with linux out of the box, it would be hard to imagine this device is not also compatible
Doesn't it come with Nvidia's blend of Ubuntu with a custom kernel? Do other distros work as well as "DGX OS" or are nvidia's kernel changes pretty important to have?
I've not noticed much in it that is NVIDIA specific.
But I would say that as an Ubuntu and Debian user for decades I have no incentive to use anything else on it and I'm just pleased to have a Linux on Aarch64 machine that is well supported for a change.
Re: Nvidia RTX Spark
#244can these do training or only inference? currently working on learning machine learning and I'd love to have a physical machine I could aim to build real workloads on in a few years.
I believe training is way more processor intensive than inference.
Re: Nvidia RTX Spark
#245can these do training or only inference? currently working on learning machine learning and I'd love to have a physical machine I could aim to build real workloads on in a few years.
They're Turing complete. What else do you need?
Re: Nvidia RTX Spark
#246This seems to be an attempt to compete with people running local models on Apple hardware—even though those local Mac Mini setups aren't really powerful. I expect we'll get there in a few years, so perhaps this is Nvidia taking an early step in that direction. In that case, this goes against Anthropic and OpenAI's business models. Which is a double whammy after Jensen Huang's recent comment about how agentic coding w…
Local AI was/is bound to happen, eventually. It'd be smart of Nvidia to get ahead of it.
Non-techy consumers may never do it, but at some point businesses are going to start asking when do they stop paying per token and start running models themselves. Right now the hardware is cost prohibitive, but I doubt that'll always be the case. Eventually the hardware will get cheaper and more available, and Nvidia seems to be betting on that.
They don't care where inference happens, so long as it happens on Nvidia hardware.
Re: Nvidia RTX Spark
#247can these do training or only inference? currently working on learning machine learning and I'd love to have a physical machine I could aim to build real workloads on in a few years.
not for llm full training, but can do some finetuning for sure.
Re: Nvidia RTX Spark
#248Earlier quoted context omitted.
Honestly this looks like Microsoft must have thrown a pile of money at them to not mention it, as it's just too obviously the main question. No one seriously cares about this running Windows. We want Steam and CUDA/Ollama, and Windows just gets in the way. nVidia are simply not that oblivious, but I have to admit in their position I'd have considered the Microsoft involvement more trouble than it's worth, which is am…
WSL is the answer in what most folks are concerned. Has Steam finally started to push for native Linux games instead of translating Windows ones?
Valve did that little more than a decade ago, the original Steam Machines. It didn't take, and despite the success of the Deck and current techy trends, Linux does not have the % to make the ROI worthwhile if it isn't simple for developers. Proton is a wedge in the door that will help Linux get there.
Re: Nvidia RTX Spark
#249Earlier quoted context omitted.
Honestly this looks like Microsoft must have thrown a pile of money at them to not mention it, as it's just too obviously the main question. No one seriously cares about this running Windows. We want Steam and CUDA/Ollama, and Windows just gets in the way. nVidia are simply not that oblivious, but I have to admit in their position I'd have considered the Microsoft involvement more trouble than it's worth, which is am…
WSL is the answer in what most folks are concerned. Has Steam finally started to push for native Linux games instead of translating Windows ones?
If it runs faster than the windows ones, who cares?
Re: Nvidia RTX Spark
#250Kinda underwhelming. I was hoping to see that they improved their memory bandwidth to move toward competing with the M5 Max. But this is more akin to the Strix Halo.