Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia's Project Digits is a 'personal AI supercomputer'

techcrunch.com

Post reply on HN
Print view View original

441–450 of 510 posts

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#441

Post by throwaway48476 »

moralestapia wrote: post #327
JohnBooty wrote: post #239

Earlier quoted context omitted.

They have, because until now Apple Silicon was the only practical way for many to work with larger models at home because they can be configured with 64-192GB of unified memory. Even the laptops can be configured with up to 128GB of unified memory. Performance is not amazing (roughly 4060 level, I think?) but in many ways it was the only game in town unless you were willing and able to build a multi-3090/4090 rig.

I would bet that people running LLMs on their Macs, today, is <0.1% of their user base.

All macs? Yes. But of 192GB mac configs? Probably >50%

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#442

Post by sliken »

kllrnohj wrote: post #323
adrian_b wrote: post #273

Earlier quoted context omitted.

That Altra may be a good choice for certain server applications, like a Web server, but when used as a workstation it will be sluggish, because it uses weak cores, with much lower single-threaded performance than the Arm cores used in NVIDIA Digits. For certain applications, e.g. for those with many array operations, the 20 cores of Digits might match 40 cores of Altra at equal clock frequency, but the cores of Digit…

I mean I can get a Snapdragon X Elite laptop for $1200 that'll have a faster CPU than the one in the Digits, too...

Sure, but less than half the memory bandwidth and inference is largely bandwidth bound.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#443

Post by aleden »

justin66 wrote: post #405
aleden wrote: post #391

Earlier quoted context omitted.

Are you aware that mainline linux runs on these Jetson devices? It's a bit of annoying work, but you can be running ArchLinuxARM. https://github.com/archlinuxarm/PKGBUILDs/pull/1580 Edit: It's been a while since I did this, but I had to manually build the kernel, overwrite a dtb file maybe (and Linux_for_Tegra/bootloader/l4t_initrd.img) and run something like this (for xavier) sudo ./flash.sh -N 128.30.84.100:/srv/ar…

How close does any of that get a person to having Ubuntu 24.04 running on their board? (I guess we can put aside the issue of Nvidia's closed source graphics drivers for the moment)

You could install Ubuntu 24.04 using debootstrap. That would just get you the user space, though, you'd still have to build your own kernel image.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#444

Post by sliken »

Havoc wrote: post #207

Can one game on it? If one can skip buying gaming rig with a 5090 with its likely absurd price then this 3k becomes a lot easier for dual use hobbyists to swallow Edit 5090 is 2k

I'm not sure it has a video out. There is a AI produced image of the digit and a monitor though.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#445

Post by sliken »

gigatexal wrote: post #285

What are the CPU specs? Idk about the GPU but a really fast ARM cpu and a ton of ram and it already runs Linux?!! If it’s competitive with the M chips from Apple this might be my next box.

10 cortex-x925 and 10 cortex-a725 I believe.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#446

Post by sliken »

stuaxo wrote: post #154

Of course no chance of this with x86 because of market segmentation.

This Nvidia is quite a bit like the AMD Strix Halo, which has the same 128GB max memory, x86, unified memory, and a 256 bit wide bus. I've seen much hopeful speculation that the nvidia is 512 bits wide, but I'm dubious.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#447

Post by verall »

nightski wrote: post #436
justin66 wrote: post #405

Earlier quoted context omitted.

How close does any of that get a person to having Ubuntu 24.04 running on their board? (I guess we can put aside the issue of Nvidia's closed source graphics drivers for the moment)

Isn't the Jetson line more of an embedded line and not a end-user desktop? Why would you run Ubuntu?

Jetson are embedded devices that run ubuntu. Ubuntu is the OS it ships with.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#448

Post by sliken »

YetAnotherNick wrote: post #69

I highly doubt it's half or ever quarter of GB200, unless they have hidden water cooling or something outside. GB200 is 1200 Watts. Digits doesn't look like it would be above 200W, and cooling 200W would be impressive.

I think it's 1/40th of the GB200, but I think that's the one with two blackwells, so 1/20th of a full blackwell.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#449

Post by lolinder »

godelski wrote: post #398
lolinder wrote: post #307

Earlier quoted context omitted.

It's possible. I haven't had a system completely destroyed by Nvidia in the last few years, but I've been assuming that's because I've gotten in the habit of just not touching it once I get it working...

I update drivers regularly. I've only had one display failure and was solved by a simple rollback. To be a bit fair (:/) it was specifically a combination of new beta driver and a newer kernel. It's definitely improved a ton since 10 years ago I just would not update them except very carefully.

I've bricked multiple systems just running apt install on the Nvidia drivers. I have no idea how, but I run the installation, everything works fine, and then when I reboot I can't even boot.

That was years ago, but it happened multiple times and I've been very cautious ever since.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#450

Post by amelie-iska »

nzach wrote: post #339
mycall wrote: post #245

Earlier quoted context omitted.

The bigger picture is that OpenAI o3/o4.. plus specialized models will blow open the doors to genome tagging and discovery, but that is still 1 to 3 years away for ASI to kick in.

While I kinda agree with you, I don't think we will ever find a meaningful way to throw genome sequencing data at LLMs. It's simple too much data. I've worked in a project some years ago where we were using data from genome sequencing of a bacteria. Every sequenced sample was around 3GB of data and sample size was pretty small with only about 100 samples to study. I think the real revolution will happen because code…

http://www.chat-protein.com/
Post reply on HN