Earlier quoted context omitted.
Lots of machine learning workflows support Linux better than Windows, if they run on Windows at all. (e.g. https://docs.vllm.ai/en/latest/getting_started/quickstart/ ) DGX Spark runs Linux, and nobody is going to install Windows on that machine. This laptop got it backwards. If someone decides to run Ollama for local inference with this laptop, they fit perfectly into the "has too much money to waste" bracket, which…
WSL
Nvidia RTX Spark
151–160 of 437 posts
Re: Nvidia RTX Spark
#152Re: Nvidia RTX Spark
#153It all sounds good on paper. But I have trouble believing Windows can be a good platform for this. Microsoft has lost all trust after inserting ads into windows, slowly removing power user features, and exploiting every dark pattern they can. And for years, the ARM based Windows laptops have been useless due to app compatibility issues. Why would this change now? Is it priced to be a lot cheaper than Apple’s laptops?…
Re: Nvidia RTX Spark
#154competitor is already on the market and is x86: AMD AI 395+ bechmarks with DGX arnt spectacular for NVIDIAs software and CUDA lead. wouldnt count on this being a price/compute challenger. especially with overpriced VRAM.
Is CUDA really a lead for long? Aren’t all the latest competitive approaches avoiding all the standard software stacks and writing deeply customized software that is very directly tied to whatever hardware they use? And is it really a way to lock in people? With AI coding tools, isn’t it trivial to write software on top of CUDA and rewrite it to target some other hardware?
no.
Re: Nvidia RTX Spark
#155Re: Nvidia RTX Spark
#156Earlier quoted context omitted.
yes, same chip + Windows + Screen - ConnectX-7 Smart NIC
+ battery too. I've wondered if a mini pc with battery would make for a good form factor. I often move between places where I have a desk with a screen but still use a laptop because I want to just suspend and resume. If a mini pc had a small battery just to hold its RAM while suspended I could move between places and just plug in a single USB-C cable and have my full workstation up and running. The thermals could be…
Re: Nvidia RTX Spark
#157Will NVIDIA get a monopoly on providing laptops and desktops with a lot of RAM going forward?
No. You can get a PowerBook today with 128 GB ram. https://www.bhphotovideo.com/c/product/1957120-REG/apple_mbp...
Re: Nvidia RTX Spark
#158Earlier quoted context omitted.
M5 max is 3x stronger and 50% more power efficient. nice try though.
... but you'll be rewriting inference for any model that isn't a well-known LLM. Yourself.
Re: Nvidia RTX Spark
#159Re: Nvidia RTX Spark
#160This may finally be the chip family ARM on Windows has always needed. Qualcomm's chips have always been dogs with slow off-the-shelf ARM CPU cores that have pathetic single-threaded performance compared to x86 AMD/Intel or ARM Apple Silicon designs.
Qualcomm Snapdragon x1 and upcoming x2 use their Oryon core and have much faster single-thread performance than Intel/Amd and this nvidia soc that uses off-the-shelf arm cores
I was disappointed to see that the RTX Spark has the ARM cores from the DGX Spark. I was hoping it had their new in-house developed cores that Nvidia is starting to use on their latest gen server parts. They look really fast. That said, if RTX Spark has CPU performance like the DGX Spark, it will be almost as fast as the top AMD/Intel parts.