Live data from Hacker News

Nvidia's Project Digits is a 'personal AI supercomputer'

techcrunch.com

21–30 of 510 posts

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#21
post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

This is somewhat similar to what GeForce was to gamers back in the days, but for AI enthusiasts. Sure, the price is much higher, but at least it's a completely integrated solution.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#22
It costs the equivalent of 2 years of cloud GPU H100s at current prices.

Edit: Sorry fucked up my math. I wanted to do 40x52x4, $4/hr being the cloud compute price but that us actually $8300, so it is actually equivalent to about 4.5 months of cloud compute. 40 hours because I presume that this will only be used for prototyping and debugging, i.e during office hours.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#23
post #7
post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

I think the enthusiast side of things is a negligible part of the market. That said, enthusiasts do help drive a lot of the improvements to the tech stack so if they start using this, it’ll entrench NVIDIA even more.

You could have said the same about gamers buying expensive hardware in the 00's. It's what made Nvidia big.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#24

It costs the equivalent of 2 years of cloud GPU H100s at current prices. Edit: Sorry fucked up my math. I wanted to do 40x52x4, $4/hr being the cloud compute price but that us actually $8300, so it is actually equivalent to about 4.5 months of cloud compute. 40 hours because I presume that this will only be used for prototyping and debugging, i.e during office hours.

what are current h100 price ? lowest i have seen is only 0.99 per hour

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#25
post #17
post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

“Bigger” in what sense? For AI? Sure, because this an AI product. 5x series are gaming cards.

Bigger in the sense of the announcements.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#26
post #17
post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

“Bigger” in what sense? For AI? Sure, because this an AI product. 5x series are gaming cards.

Eh. Gaming cards, but also significantly faster. If the model fits in the VRAM the 5090 is a much better buy.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#27
post #20

Earlier quoted context omitted.

If I were NVidia, I would be throwing everything I could at making entertainment experiences that need one of these to run... I mean, this is awfully close to being "Her" in a box, right?

I feel like a lot of people miss that Her was a dystopian future, not an ideal to hit. Also, it’s $3000. For that you could buy subscriptions to OpenAI etc and have the dystopian partner everywhere you go.

they don't miss that part. they just want to be the evil character.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#28
post #17
post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

“Bigger” in what sense? For AI? Sure, because this an AI product. 5x series are gaming cards.

Not expecting this to compete with the 5x series in terms of gaming; But it's interesting to note the increase in gaming performance Jensen was speaking about with Blackwell was larger related to inferenced frames generated by the tensor cores.

I wonder how it would go as a productivity/tinkering/gaming rig? Could a GPU potentially be stacked in the same way an additional Digit can?

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#29
post #7
post #6

I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!

I think the enthusiast side of things is a negligible part of the market. That said, enthusiasts do help drive a lot of the improvements to the tech stack so if they start using this, it’ll entrench NVIDIA even more.

I’m not so sure it’s negligible. My anecdotal experience is that since Apple Silicon chips were found to be “ok” enough to run inference with MLX, more non-technical people in my circle have asked me how they can run LLMs on their macs.

Surely a smaller market than gamers or datacenters for sure.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#30
post #9

Feels like data center AI HW demand peak is over now that these things are trickling down to consumers and they are diversifying customers. Also going lower than expected on gaming HW, seems like they have enough fab capacity.

Their DC sales likely aren’t growing at the rates prior seen. Law of big numbers. They gotta diversify to satisfy growth & profit expectations
Post reply on HN