Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia's Project Digits is a 'personal AI supercomputer'

techcrunch.com

Post reply on HN
Print view View original

351–360 of 510 posts

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#351

Post by Filligree »

otabdeveloper4 wrote: post #324
Filligree wrote: post #298

Earlier quoted context omitted.

> No. There's already too much porn on the internet, and AI porn is cringe and will get old very fast. I needed an uncensored model in order to, guess what, make an AI draw my niece snowboarding down a waterfall. All the online services refuse on basis that the picture contains -- oh horrors -- a child. "Uncensored" absolutely does not imply NSFW.

Yeah, and there's that story about "private window" mode in browsers because you were shopping for birthday gifts that one time. You know what I mean though.

I really don't. Censored models are so censored they're practically useless for anything but landscapes. Half of them refuse to put humans in the pictures at all.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#353

Post by skavi »

adrian_b wrote: post #240
skavi wrote: post #57

Earlier quoted context omitted.

It’s actually “10 Arm Cortex-X925 and 10 Cortex-A725” [0]. These are much newer cores and have a reasonable chance of being competitive. [0]: https://newsroom.arm.com/blog/arm-nvidia-project-digits-high...

For programs dominated by iterations over arrays, these 10 Arm Cortex-X925 + 10 Cortex-A725, all 20 together, should have a throughput similar with only 10 of the 16 cores of Strix Halo (assuming that Strix Halo has full Zen 5 cores, which has not been confirmed yet). For programs dominated by irregular integer and pointer operations, like software project compilation, 10 Arm Cortex-X925 + 10 Cortex-A725 should have…

How did you come up with these numbers? There don't seem to be many shipping products with these cores. In fact, the only one I could find was the Dimensity 9400 with a single X925 and older generation A720s. And of course the Dimensity is a mobile SoC, so clocks will be low.

Are you projecting based on Arm's stated improvements from their last gen? In that case, what numbers are you using as your baseline?

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#354

Post by adolph »

motoxpro wrote: post #186
spaceman_2020 wrote: post #163

Earlier quoted context omitted.

I keep thinking about stocks that have 100xd, and most seemed like obscure names to me as a layman. But man, Nvidia was a household name to anyone that ever played any game. And still so many of us never bothered buying the stock Incredible fumble for me personally as an investor

Unless you predicted AI and Crypto then it was just really good, not 100x. It 20x from 2005-2020 but ~500x from 2005-2025 And if you truly did predict that Nvidia would own those markets and those markets would be massive, you could have also bought Amazon, Google or heck even Bitcoin. Anything you touched in tech really would have made you a millionaire really.

It is interesting to think about crypto as a stairstep that Nvidia used to get to its current position in AI. It wasn't games > ai, but games > crypto > ai.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#355

Post by mrybczyn »

tcdent wrote: post #350
Abishek_Muthian wrote: post #283

I'm looking at my Jetson Nano in the corner which is fulfilling its post-retirement role as a paper weight because Nvidia abandoned it in 4 years. Nvidia Jetson Nano, A SBC for "AI" debuted with already aging custom Ubuntu 18.04 and when 18.04 went EOL, Nvidia abandoned it completely without any further updates to its proprietary jet-pack or drivers and without them all of Machine Learning stack like CUDA, Pytorch et…

If you're expecting this device to stay relevant for 4 years you are not the target demographic. Compute is evolving way too rapidly to be setting-and-forgetting anything at the moment.

Eh? By all indications compute is now evolving SLOWER than ever. Moore's Law is dead, Dennard scaling is over, the latest fab nodes are evolutionary rather than revolutionary.

This isn't the 80s when compute doubled every 9 months, mostly on clock scaling.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#356

Post by ksec »

skavi wrote: post #57
sliken wrote: post #36

Earlier quoted context omitted.

Not sure how to judge better price/perf. I wouldn't expect 20 Neoverse N2 cores to do particularly well vs 16 zen5 cores. The GPU side looks promising, but they aren't mentioning memory bandwidth, configuration, spec, or performance. Did see vague claims of "starting at $3k", max 4TB nvme, and max 128GB ram. I'd expect AMD Strix Halo (AI Max plus 395) to be reasonably competitive.

It’s actually “10 Arm Cortex-X925 and 10 Cortex-A725” [0]. These are much newer cores and have a reasonable chance of being competitive. [0]: https://newsroom.arm.com/blog/arm-nvidia-project-digits-high...

For context, the X925 is what used to call Cortex X5 and it is now shipping in MediaTek Dimensity 9400. It has roughly the same performance per clock as a Snapdragon 8 Elite Or roughly 5% lower performance per clock compared to Apple M3 on Geekbench 6.

Assuming they are not limited by power or heat dissipation I would say that is about as good as it gets.

The hardware is pretty damn good. I am only worried about the software.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#357

Post by johndough »

theptip wrote: post #311
nimish wrote: post #264

Earlier quoted context omitted.

1000% all these ai hardware companies will fail if they don't have this. You must have a cheap way to experiment and develop. Even if you want to only sell a $30000 datacenter card you still need a very low cost way to play. Sad to see big companies like intel and amd don't understand this but they've never come to terms with the fact that software killed the hardware star

Isn’t the cloud GPU market covering this? I can run a model for $2/hr, or get a 8xH100 if I need to play with something bigger.

I have the skills to write efficient CUDA kernels, but $2/hr is 10% of my salary, so no way I'm renting any H100s. The electricity price for my computer is already painful enough as is. I am sure there are many eastern European developers who are more skilled and get paid even less. This is a huge waste of resources all due to NVIDIA's artificial market segmentation. Or maybe I am just cranky because I want more VRAM for cheap.

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#358

Post by saidinesh5 »

Abishek_Muthian wrote: post #283

I'm looking at my Jetson Nano in the corner which is fulfilling its post-retirement role as a paper weight because Nvidia abandoned it in 4 years. Nvidia Jetson Nano, A SBC for "AI" debuted with already aging custom Ubuntu 18.04 and when 18.04 went EOL, Nvidia abandoned it completely without any further updates to its proprietary jet-pack or drivers and without them all of Machine Learning stack like CUDA, Pytorch et…

Is there any recent, powerful SBC with fully upstream kernel support?

I can only think of raspberry pi...

Re: Nvidia's Project Digits is a 'personal AI supercomputer'

#359

Post by msh »

saidinesh5 wrote: post #358
Abishek_Muthian wrote: post #283

I'm looking at my Jetson Nano in the corner which is fulfilling its post-retirement role as a paper weight because Nvidia abandoned it in 4 years. Nvidia Jetson Nano, A SBC for "AI" debuted with already aging custom Ubuntu 18.04 and when 18.04 went EOL, Nvidia abandoned it completely without any further updates to its proprietary jet-pack or drivers and without them all of Machine Learning stack like CUDA, Pytorch et…

Is there any recent, powerful SBC with fully upstream kernel support? I can only think of raspberry pi...

The odroid H series. But that packs a x86 cpu.
Post reply on HN