Nvidia's Project Digits is a 'personal AI supercomputer'

Post by throw310822 » Tue, Jan 07, 2025, 9:26 AM UTC

bee_rider wrote: post #66

narrator wrote: post #10

Nvidia releases a Linux desktop supercomputer that's better price/performance wise than anything Wintel is doing and their whole new software stack will only run on WSL2. They aren't porting to Win32. Wow, it may actually be the year of Linux on the Desktop.

Seems more like a workstation. So, that’s just a continuation of the last could Decades of Unix on the Workstation, right?

Post by krasin » Tue, Jan 07, 2025, 9:29 AM UTC

KeplerBoy wrote: post #135

computably wrote: post #8

Earlier quoted context omitted.

From the size and pricing ($3000) alone, it's safe to conclude it has less raw FLOPs than a 5090. Since it uses LPDDR5X, almost certainly less memory bandwidth too (5090 @ 1.8 TB/s, M4 Max w/ 128GB LPDDR5X @ 546 GB/s). Basically the only advantage is how much VRAM it packs in a small form factor, and presumably greater power efficiency at its smaller scale. The only thing it really competes with is the Mac Studio for…

Of course. It has much less FLOPs than the 5090, after all this will have a TDP of ~50W and run off a regular USB-PD power supply. It's basically the successor to the AGX Orin and in line with its pricing (considering it comes with a fast NIC). The AGX Orin had RTX 3050 levels of performance.

Post by stuaxo » Tue, Jan 07, 2025, 9:36 AM UTC

Karupan wrote: post #29

dagmx wrote: post #7

Earlier quoted context omitted.

I think the enthusiast side of things is a negligible part of the market. That said, enthusiasts do help drive a lot of the improvements to the tech stack so if they start using this, it’ll entrench NVIDIA even more.

I’m not so sure it’s negligible. My anecdotal experience is that since Apple Silicon chips were found to be “ok” enough to run inference with MLX, more non-technical people in my circle have asked me how they can run LLMs on their macs. Surely a smaller market than gamers or datacenters for sure.

Post by rfoo » Tue, Jan 07, 2025, 9:37 AM UTC

sliken wrote: post #63

modeless wrote: post #55

Earlier quoted context omitted.

AI work happens predominantly on the GPU, not the CPU. This GPU with CUDA will run rings around M4 with MLX. And with much more RAM than you can get in a Mac for $3k. A lot of people have been justifying their Mac Studio or Mac Pro purchases by the potential for running large AI models locally. Project Digits will be much better at that for cheaper. Maybe it won't run compile Chromium as fast, but that's not what it'…

The quotes I've seen mention the maximum config (128GB ram and 4TB of storage) and the minimum price. Nothing saying $3k for 128GB ram and 4TB of storage. I hope I'm wrong, but I'm betting the max price is at least twice the minimum price.

Post by papichulo2023 » Tue, Jan 07, 2025, 9:38 AM UTC

poisonborz wrote: post #108

Welcome to tomorrow's "personal" computer, a single unmodifiable SoC with closed source software stack.