Would consider at a lower price of $500 USD, way too expensive for what it brings.
Nvidia's Project Digits is a 'personal AI supercomputer'
51–60 of 510 posts
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#52Earlier quoted context omitted.
"Linux API on top of Windows" is an interesting way to describe a virtual machine.
WSL2 is no longer a VM, afaik.
Other way around (1 wasn't, 2 runs in a managed HyperV VM) https://learn.microsoft.com/en-us/windows/wsl/compare-versio...
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#53I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!
This is somewhat similar to what GeForce was to gamers back in the days, but for AI enthusiasts. Sure, the price is much higher, but at least it's a completely integrated solution.
Yep that's what I'm thinking as well. I was going to buy a 5090 mainly to play around with LLM code generation, but this is a worthy option for roughly the same price as building a new PC with a 5090.
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#54I bought a Lamba Labs workstation with a 4090 last year. I guess I’m buying one of these things now because the Lambda workstation just became a relic…
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#55Finally a real ARM workstation from Nvidia! This will be much faster than Apple's offerings for AI work. And at $3000 it is much cheaper than any Mac with 128 GB RAM.
On the CPU size the Neoverse N2 doesn't compete particularly well with apple's M4, or the Zen5 for the matter. Bit bit hard to tell what's on offer on the GPU side, I wouldn't be surprised if it was RTX 4070 to 5070 in that range. If the price/perf is high enough $3k wouldn't be a bad deal, I suspect a Strix Halo (better CPU cores, 256GB/sec memory interface, likely slower GPU cores) will be better price/perf, same m…
AI work happens predominantly on the GPU, not the CPU. This GPU with CUDA will run rings around M4 with MLX. And with much more RAM than you can get in a Mac for $3k.
A lot of people have been justifying their Mac Studio or Mac Pro purchases by the potential for running large AI models locally. Project Digits will be much better at that for cheaper. Maybe it won't run compile Chromium as fast, but that's not what it's for.
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#56Would consider at a lower price of $500 USD, way too expensive for what it brings.
I think it's cheap at $3000. 128gb RAM, top of the line GPU capabilities, 4tb storage... it's much better than what a top shelf mbp can do and much cheaper
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#57Nvidia releases a Linux desktop supercomputer that's better price/performance wise than anything Wintel is doing and their whole new software stack will only run on WSL2. They aren't porting to Win32. Wow, it may actually be the year of Linux on the Desktop.
Not sure how to judge better price/perf. I wouldn't expect 20 Neoverse N2 cores to do particularly well vs 16 zen5 cores. The GPU side looks promising, but they aren't mentioning memory bandwidth, configuration, spec, or performance. Did see vague claims of "starting at $3k", max 4TB nvme, and max 128GB ram. I'd expect AMD Strix Halo (AI Max plus 395) to be reasonably competitive.
It’s actually “10 Arm Cortex-X925 and 10 Cortex-A725” [0]. These are much newer cores and have a reasonable chance of being competitive.
[0]: https://newsroom.arm.com/blog/arm-nvidia-project-digits-high...
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#58Finally a real ARM workstation from Nvidia! This will be much faster than Apple's offerings for AI work. And at $3000 it is much cheaper than any Mac with 128 GB RAM.
On the CPU size the Neoverse N2 doesn't compete particularly well with apple's M4, or the Zen5 for the matter. Bit bit hard to tell what's on offer on the GPU side, I wouldn't be surprised if it was RTX 4070 to 5070 in that range. If the price/perf is high enough $3k wouldn't be a bad deal, I suspect a Strix Halo (better CPU cores, 256GB/sec memory interface, likely slower GPU cores) will be better price/perf, same m…
It’s actually “10 Arm Cortex-X925 and 10 Cortex-A725” [0]. These are much newer cores and have a reasonable chance of being competitive.
[0]: https://newsroom.arm.com/blog/arm-nvidia-project-digits-high...
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#59Nvidia releases a Linux desktop supercomputer that's better price/performance wise than anything Wintel is doing and their whole new software stack will only run on WSL2. They aren't porting to Win32. Wow, it may actually be the year of Linux on the Desktop.
> Wow, it may actually be the year of Linux on the Desktop. ? Yeah starting at $3,000. Surely a cheap desktop computer to buy for someone who just wants to surf the web and send email /s. There is a reason why it is for "enthusiasts" and not for the general wider consumer or typical PC buyer.
The typical PC buyer is an enthusiast now.
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#60I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!
What slice?
Also, macOS devices are not very good inference solutions. They are just believed to be by diehards.
I don't think Digits will perform well either.
If NVIDIA wanted you to have good performance on a budget, it would ship NVLink on the 5090.