Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia's Project Digits is a 'personal AI supercomputer'

techcrunch.com

Post reply on HN
Print view View original

171–180 of 510 posts

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#171

Post by fulafel »

moffkalast wrote: post #144
ryao wrote: post #81

This looks like a successor to the Nvidia Jetson AGX Orin 64GB Developer Kit: https://www.okdo.com/wp-content/uploads/2023/03/jetson-agx-o... I wonder what the specifications are in terms of memory bandwidth and computational capability.

The AGX Orin was only 64GB of LPDDR5 and priced at $5k so this does seem like a bargain in comparison with 128GB of presumably HBM. But Nvidia never lowers their prices, so there's a caveat somewhere.

The memory is LPDDR accordning to the specs graphic on the NV product page: https://www.nvidia.com/en-us/project-digits/

Anyone willing to guess how wide?

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#172

Post by dist-epoch »

llm_trw wrote: post #106
Karupan wrote: post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

From the people I talk to the enthusiast market is nvidia 4090/3090 saturated because people want to do their fine tunes also porn on their off time. The Venn diagram of users who post about diffusion models and llms running at home is pretty much a circle.

Not your weights, not your waifu

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#173

Post by oarsinsync »

acchow wrote: post #98
Karupan wrote: post #65

Earlier quoted context omitted.

They are perfectly fine for certain people. I can run Qwen-2.5-coder 14B on my M2 Max MacBook Pro with 32gb at ~16 tok/sec. At least in my circle, people are budget conscious and would prefer using existing devices rather than pay for subscriptions where possible. And we know why they won't ship NVLink anymore on prosumer GPUs: they control almost the entire segment and why give more away for free? Good for the compa…

> I can run Qwen-2.5-coder 14B on my M2 Max MacBook Pro with 32gb at ~16 tok/sec. At least in my circle, people are budget conscious Qwen 2.5 32B on openrouter is $0.16/million output tokens. At your 16 tokens per second, 1 million tokens is 17 continuous hours of output. Openrouter will charge you 16 cents for that. I think you may want to reevaluate which is the real budget choice here Edit: elaborating, that extra…

> Openrouter will charge you 16 cents for that

And log everything too?

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#176

Post by rfoo »

sliken wrote: post #167
rfoo wrote: post #157

Earlier quoted context omitted.

This is NVIDIA, not Apple. They don't charge you a RAM tax (at least for this product). There is only one config for RAM: 128GB.

It's been far from clear what config options are going to be available, and the $3,000 price is the "starting at" price. Not sure what the options will be, but people have collectively found statements that imply all configs will have 128GB ram. Sounds good, I hope it's true. Seems like the storage will have options, because it's "up to 4TB". Unsure if there will be differently binned CPUs (clock or number of cores).…

Doubt it. I don't remember NVIDIA ever doing binning and having different SKUs for their Jetson Developer Kit line, which is similar to this Project Digits thing.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#177

Post by tokai »

immibis wrote: post #34
narrator wrote: post #10

Nvidia releases a Linux desktop supercomputer that's better price/performance wise than anything Wintel is doing and their whole new software stack will only run on WSL2. They aren't porting to Win32. Wow, it may actually be the year of Linux on the Desktop.

Never underestimate the open source world's power to create a crappy desktop experience.

You're like 15 years out of date.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#178

Post by moffkalast »

fulafel wrote: post #171
moffkalast wrote: post #144

Earlier quoted context omitted.

The AGX Orin was only 64GB of LPDDR5 and priced at $5k so this does seem like a bargain in comparison with 128GB of presumably HBM. But Nvidia never lowers their prices, so there's a caveat somewhere.

The memory is LPDDR accordning to the specs graphic on the NV product page: https://www.nvidia.com/en-us/project-digits/ Anyone willing to guess how wide?

I've seen some claims that it can do 512 GB/s on Reddit (not sure where they got that from), which would imply a ~300 bit bus with LPDDR5X depending on the frequency.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#179

Post by moffkalast »

quick_brown_fox wrote: post #145

How about “We sell a computer called the tinybox. It comes in two colors + pro. tinybox red and green are for people looking for a quiet home/office machine. tinybox pro is for people looking for a loud compact rack machine.” [0] [0] https://tinygrad.org/#tinybox

>tinybox

>the size of several ATX desktops

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#180

Post by otabdeveloper4 »

anonylizard wrote: post #91
Cumpiler69 wrote: post #85

Earlier quoted context omitted.

There's a lot more gamers than people wanting to play with LLms at home.

There's a titanic market with people wanting some uncensored local LLM/image/video generation model. This market extremely overlaps with gamers today, but will grow exponentially every year.

> There's a titanic market with people wanting some uncensored local LLM/image/video generation model.

No. There's already too much porn on the internet, and AI porn is cringe and will get old very fast.

Post reply on HN