Live data from Hacker News

Nvidia's Project Digits is a 'personal AI supercomputer'

techcrunch.com

131–140 of 510 posts

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#131
post #87
post #61

Earlier quoted context omitted.

Good catch, they called it "Grace Blackwell". Changing the CPU cores completely and calling it Grace seems weird. Maybe it was just a mistake during the keynote.

I don't think it was a mistake; maybe they intend Grace to be a broader brand like Ryzen not one particular model.

it's an interesting idea. I mean grace hopper was an actual person but nvidia can have whatever arbitrary naming rules they'd like.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#132
Is there any effort in local cloud computing? I can't justify $3000 for a fun device. But if all devices (6 phone, 2 iPads, a desktop and 2 laptops) in my home can leverage that for fast LLM, gaming, and photo/video editing, now it makes so much more sense.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#134

Is there any effort in local cloud computing? I can't justify $3000 for a fun device. But if all devices (6 phone, 2 iPads, a desktop and 2 laptops) in my home can leverage that for fast LLM, gaming, and photo/video editing, now it makes so much more sense.

You can just setup your local openAI like API endpoints for LLMs. Most devices and apps won't be able to use them, because consumers don't run self-hosted apps, but for a simple chatGPT style app this is totally viable. Today.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#135

Not much was unveiled but it showed a Blackwell GPU with 1PFLOP of FP4 compute, 128GB unified DDR5X memory, 20 ARM cores, and ConnectX powering two QSFP slots so one can stack multiple of them. edit: While the title says "personal", Jensen did say this was aimed at startups and similar, so not your living room necessarily.

From the size and pricing ($3000) alone, it's safe to conclude it has less raw FLOPs than a 5090. Since it uses LPDDR5X, almost certainly less memory bandwidth too (5090 @ 1.8 TB/s, M4 Max w/ 128GB LPDDR5X @ 546 GB/s). Basically the only advantage is how much VRAM it packs in a small form factor, and presumably greater power efficiency at its smaller scale. The only thing it really competes with is the Mac Studio for…

Of course. It has much less FLOPs than the 5090, after all this will have a TDP of ~50W and run off a regular USB-PD power supply.

It's basically the successor to the AGX Orin and in line with its pricing (considering it comes with a fast NIC). The AGX Orin had RTX 3050 levels of performance.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#136
post #107
post #63

Earlier quoted context omitted.

The quotes I've seen mention the maximum config (128GB ram and 4TB of storage) and the minimum price. Nothing saying $3k for 128GB ram and 4TB of storage. I hope I'm wrong, but I'm betting the max price is at least twice the minimum price.

It's GB200 in desktop compatible enclosure, the RAM is fixed, the SSDs are not, the network ports are fixed too.

It's GB10 a much cut down version to fit the price point, and space, weight and power requirements.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#139

I highly doubt it's half or ever quarter of GB200, unless they have hidden water cooling or something outside. GB200 is 1200 Watts. Digits doesn't look like it would be above 200W, and cooling 200W would be impressive.

GB200 is ~USD 60,000/. So, it should be like 20th of that.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#140
I'm a bit surprised by the amount of comments comparing the cost to (often cheap) cloud solutions. Nvidia's value proposition is completely different in my opinion. Say I have a startup in the EU that handles personal data or some company secrets and wants to use an LLM to analyse it (like using RAG). Having that data never leave your basement sure can be worth more than $3000 if performance is not a bottleneck.
Post reply on HN