Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia's Project Digits is a 'personal AI supercomputer'

techcrunch.com

Post reply on HN
Print view View original

61–70 of 510 posts

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#61

Post by sliken »

skavi wrote: post #57
sliken wrote: post #36

Earlier quoted context omitted.

Not sure how to judge better price/perf. I wouldn't expect 20 Neoverse N2 cores to do particularly well vs 16 zen5 cores. The GPU side looks promising, but they aren't mentioning memory bandwidth, configuration, spec, or performance. Did see vague claims of "starting at $3k", max 4TB nvme, and max 128GB ram. I'd expect AMD Strix Halo (AI Max plus 395) to be reasonably competitive.

It’s actually “10 Arm Cortex-X925 and 10 Cortex-A725” [0]. These are much newer cores and have a reasonable chance of being competitive. [0]: https://newsroom.arm.com/blog/arm-nvidia-project-digits-high...

Good catch, they called it "Grace Blackwell". Changing the CPU cores completely and calling it Grace seems weird. Maybe it was just a mistake during the keynote.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#63

Post by sliken »

modeless wrote: post #55
sliken wrote: post #42

Earlier quoted context omitted.

On the CPU size the Neoverse N2 doesn't compete particularly well with apple's M4, or the Zen5 for the matter. Bit bit hard to tell what's on offer on the GPU side, I wouldn't be surprised if it was RTX 4070 to 5070 in that range. If the price/perf is high enough $3k wouldn't be a bad deal, I suspect a Strix Halo (better CPU cores, 256GB/sec memory interface, likely slower GPU cores) will be better price/perf, same m…

AI work happens predominantly on the GPU, not the CPU. This GPU with CUDA will run rings around M4 with MLX. And with much more RAM than you can get in a Mac for $3k. A lot of people have been justifying their Mac Studio or Mac Pro purchases by the potential for running large AI models locally. Project Digits will be much better at that for cheaper. Maybe it won't run compile Chromium as fast, but that's not what it'…

The quotes I've seen mention the maximum config (128GB ram and 4TB of storage) and the minimum price. Nothing saying $3k for 128GB ram and 4TB of storage. I hope I'm wrong, but I'm betting the max price is at least twice the minimum price.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#64

Post by YetAnotherNick »

doctorpangloss wrote: post #60
Karupan wrote: post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

What slice? Also, macOS devices are not very good inference solutions. They are just believed to be by diehards. I don't think Digits will perform well either. If NVIDIA wanted you to have good performance on a budget, it would ship NVLink on the 5090.

> Also, macOS devices are not very good inference solutions

They are good for single batch inference and have very good tok/sec/user. ollama works perfectly in mac.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#65

Post by Karupan »

doctorpangloss wrote: post #60
Karupan wrote: post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

What slice? Also, macOS devices are not very good inference solutions. They are just believed to be by diehards. I don't think Digits will perform well either. If NVIDIA wanted you to have good performance on a budget, it would ship NVLink on the 5090.

They are perfectly fine for certain people. I can run Qwen-2.5-coder 14B on my M2 Max MacBook Pro with 32gb at ~16 tok/sec. At least in my circle, people are budget conscious and would prefer using existing devices rather than pay for subscriptions where possible.

And we know why they won't ship NVLink anymore on prosumer GPUs: they control almost the entire segment and why give more away for free? Good for the company and investors, bad for us consumers.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#66

Post by bee_rider »

narrator wrote: post #10

Nvidia releases a Linux desktop supercomputer that's better price/performance wise than anything Wintel is doing and their whole new software stack will only run on WSL2. They aren't porting to Win32. Wow, it may actually be the year of Linux on the Desktop.

Seems more like a workstation. So, that’s just a continuation of the last could Decades of Unix on the Workstation, right?

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#67

Post by yjftsjthsd-h »

rvz wrote: post #18
narrator wrote: post #10

Nvidia releases a Linux desktop supercomputer that's better price/performance wise than anything Wintel is doing and their whole new software stack will only run on WSL2. They aren't porting to Win32. Wow, it may actually be the year of Linux on the Desktop.

> Wow, it may actually be the year of Linux on the Desktop. ? Yeah starting at $3,000. Surely a cheap desktop computer to buy for someone who just wants to surf the web and send email /s. There is a reason why it is for "enthusiasts" and not for the general wider consumer or typical PC buyer.

> Surely a cheap desktop computer to buy for someone who just wants to surf the web and send email /s.

That end of the market is occupied by Chromebooks... AKA a different GNU/Linux.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#68

Post by mrtksn »

Okay, so this is not a peripheral that you connect to your computer to run specialized tasks, this is a full computer running Linux.

It's a garden hermit. Imagine a future where everyone has one of those(not exactly this version but some future version), it lives with you it learns with you and unlike the cloud based SaaS AI you can teach it things immediately and diverge from the average to your advantage.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#70

Post by YetAnotherNick »

sabareesh wrote: post #24
giacomoforte wrote: post #22

It costs the equivalent of 2 years of cloud GPU H100s at current prices. Edit: Sorry fucked up my math. I wanted to do 40x52x4, $4/hr being the cloud compute price but that us actually $8300, so it is actually equivalent to about 4.5 months of cloud compute. 40 hours because I presume that this will only be used for prototyping and debugging, i.e during office hours.

what are current h100 price ? lowest i have seen is only 0.99 per hour

Where can you find 99c/hour? Cheapest I can find is double that.
Post reply on HN