Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia's Project Digits is a 'personal AI supercomputer'

techcrunch.com

Post reply on HN
Print view View original

311–320 of 510 posts

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#311

Post by theptip »

nimish wrote: post #264
rbanffy wrote: post #233

Earlier quoted context omitted.

This is something every company should make sure they have: an onboarding path. Xeon Phi failed for a number of reasons, but one where it didn't need to fail was availability of software optimised for it. Now we have Xeons and EPYCs, and MI300C's with lots of efficient cores, but we could have been writing software tailored for those for 10 years now. Extracting performance from them would be a solved problem at this…

1000% all these ai hardware companies will fail if they don't have this. You must have a cheap way to experiment and develop. Even if you want to only sell a $30000 datacenter card you still need a very low cost way to play. Sad to see big companies like intel and amd don't understand this but they've never come to terms with the fact that software killed the hardware star

Isn’t the cloud GPU market covering this? I can run a model for $2/hr, or get a 8xH100 if I need to play with something bigger.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#312

Post by com2kid »

croes wrote: post #45
dagmx wrote: post #20

Earlier quoted context omitted.

I feel like a lot of people miss that Her was a dystopian future, not an ideal to hit. Also, it’s $3000. For that you could buy subscriptions to OpenAI etc and have the dystopian partner everywhere you go.

OpenAI doesn’t make any profit. So either it dies or prices go up. Not to mention the privacy aspect of your own machine and the freedom of choice which models to run

OpenAI built a 3 billion dollar business in less than 3 years of a commercial offering.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#313

Post by bwfan123 »

dagmx wrote: post #44
Karupan wrote: post #29

Earlier quoted context omitted.

I’m not so sure it’s negligible. My anecdotal experience is that since Apple Silicon chips were found to be “ok” enough to run inference with MLX, more non-technical people in my circle have asked me how they can run LLMs on their macs. Surely a smaller market than gamers or datacenters for sure.

I mean negligible to their bottom line. There may be tons of units bought or not, but the margin on a single datacenter system would buy tens of these. It’s purely an ecosystem play imho. It benefits the kind of people who will go on to make potentially cool things and will stay loyal.

Devalapers developers developers - balmer monkey dance - the key to be entrenched is the platform ecosystem.

Also why aws is giving trainium credits for free

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#314

Post by egorfine »

theptip wrote: post #310

$3k for a 128GB standalone is quite favorable pricing considering the next best option at home is going to be a 32GB 5090 at $2k for the card alone, so probably $3k when you’re done building a rig around it.

The press-release says "up to 128GB" while the price is a single figure of $3,000. So it won't be out of the real of possibility that the 128GB version would cost quite a bit more.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#315

Post by lhl »

theptip wrote: post #310

$3k for a 128GB standalone is quite favorable pricing considering the next best option at home is going to be a 32GB 5090 at $2k for the card alone, so probably $3k when you’re done building a rig around it.

The memory bandwidth has not been announced for this device. It's probably going to be more appropriate to compare vs a 128GB M4 Max (410-546GB/s MBW) or an AMD Ryzen AI Max+ 395 (yes, that's its real name) at 256GB/s of MBW.

The 5090 has 1.8TB/s of MBW and is in a whole different class performance-wise.

The real question is how big of a model will you actually want to run based on how slowly tokens generate.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#317

Post by sliken »

rfoo wrote: post #176
sliken wrote: post #167

Earlier quoted context omitted.

It's been far from clear what config options are going to be available, and the $3,000 price is the "starting at" price. Not sure what the options will be, but people have collectively found statements that imply all configs will have 128GB ram. Sounds good, I hope it's true. Seems like the storage will have options, because it's "up to 4TB". Unsure if there will be differently binned CPUs (clock or number of cores).…

Doubt it. I don't remember NVIDIA ever doing binning and having different SKUs for their Jetson Developer Kit line, which is similar to this Project Digits thing.

Well presumably there's some different configurations supported, otherwise they would say $2,999 instead of starting at $2,999.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#318

Post by varelse »

lz400 wrote: post #56
rubatuga wrote: post #51

Would consider at a lower price of $500 USD, way too expensive for what it brings.

I think it's cheap at $3000. 128gb RAM, top of the line GPU capabilities, 4tb storage... it's much better than what a top shelf mbp can do and much cheaper

[dead]

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#319

Post by loudmax »

quick_brown_fox wrote: post #145

How about “We sell a computer called the tinybox. It comes in two colors + pro. tinybox red and green are for people looking for a quiet home/office machine. tinybox pro is for people looking for a loud compact rack machine.” [0] [0] https://tinygrad.org/#tinybox

Going by the specs, this pretty much blows Tinybox out of the water.

For $40,000, a Tinybox pro is advertised as offering 1.36 petaflops processing and 192 GB VRAM.

For about $6,000 a pair of Nvidia Project Digits offer about a combined 2 petaflops processing and 256 GB VRAM.

The market segment for Tinybox always seemed to be people that were somewhat price-insensitive, but unless Nvidia completely fumbles on execution, I struggle to think of any benefits of a Tinygrad Tinybox over an Nvidia Digits. Maybe if you absolutely, positively, need to run your OS on x86.

I'd love to see if AMD or Intel has a response to these. I'm not holding my breath.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#320

Post by robohoe »

spaceman_2020 wrote: post #163
qwertox wrote: post #23

Earlier quoted context omitted.

You could have said the same about gamers buying expensive hardware in the 00's. It's what made Nvidia big.

I keep thinking about stocks that have 100xd, and most seemed like obscure names to me as a layman. But man, Nvidia was a household name to anyone that ever played any game. And still so many of us never bothered buying the stock Incredible fumble for me personally as an investor

Nvidia joined S&P500 in 2001 so if you've been doing passive index fund investing, you probably got a little bit of it in your funds. So there was some upside to it.
Post reply on HN