Newbie question: can you connect a RTX 5090 to the GB10 Digits computer?
Nvidia's Project Digits is a 'personal AI supercomputer'
461–470 of 510 posts
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#462Earlier quoted context omitted.
>GPU databases are niche products with severe limitations. today. For the reasons like i mentioned. >GPUs are fast at massively parallel math problems, they anren’t useful for all tasks. GPU are fast at massively parallel tasks. Their memory bandwidth is 10x of that of the CPU for example. So, typical database operations, massively parallel in nature like join or filter, would run about that faster. Majority of compu…
The unified memory is no faster for the GPU than the CPU. So its not 10x the CPU. HBM on a GPU is much faster.
No. The unified memory on GB10 is much faster than regular RAM to CPU system:
https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwe...
"The GB10 Superchip enables Project DIGITS to deliver powerful performance using only a standard electrical outlet. Each Project DIGITS features 128GB of unified, coherent memory and up to 4TB of NVMe storage. With the supercomputer, developers can run up to 200-billion-parameter large language models to supercharge AI innovation."
https://www.nvidia.com/en-us/data-center/grace-cpu-superchip...
"Grace is the first data center CPU to utilize server-class high-speed LPDDR5X memory with a wide memory subsystem that delivers up to 500GB/s of bandwidth "
As far as i see it is about 4x of Zen 5.
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#463So, a company that doesn't feel like sharing all their secret sauce with Anthropic can run DeepSeek Coder on three of these for $9K, and it should be be more or less the same experience. Do I understand that right? It seems way to cheap.
Such a setup would likely work - assuming DS3 support on software stack but wouldn’t be able to serve as many requests in parallel as a classic gpu setup.
Main issue is the ram they’re using here isn’t the same as is in GPUs
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#464Earlier quoted context omitted.
I've had a similar experience, my Xavier NX stopped working after the last update and now it's just collecting dust. To be honest, I've found the Nvidia SBC to be more of a hassle than it's worth.
Xavier AGX owner here to report the same.
Xavier AGX is awesome for running ESXi aarch64 edition, including aarch64 Windows vms
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#465I'm looking at my Jetson Nano in the corner which is fulfilling its post-retirement role as a paper weight because Nvidia abandoned it in 4 years. Nvidia Jetson Nano, A SBC for "AI" debuted with already aging custom Ubuntu 18.04 and when 18.04 went EOL, Nvidia abandoned it completely without any further updates to its proprietary jet-pack or drivers and without them all of Machine Learning stack like CUDA, Pytorch et…
The Orin series and later use UEFI and you can apparently run upstream, non-GPU enabled kernels on them. There's a user guide page documenting it. So I think it's gotten a lot better, but it's sort of moot because the non-GPU thing is because the JetPack Linux fork has a specific 'nvgpu' driver used for Tegra devices that hasn't been unforked from that tree. So, you can buy better alternatives unless you're explicitl…
AGX also has UEFI firmware which allows you to install ESXi. Then you can install any generic EFI arm64 iso in a VM with no problems, including windows.
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#466Earlier quoted context omitted.
OpenAI built a 3 billion dollar business in less than 3 years of a commercial offering.
3 billion revenue and 5 billion loss doesn’t sound like a sustainable business model.
The real question is what the next 3 years look like. If it's another 5 billion burned for 3 billion or less in revenue, that's one thing... But...
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#467Earlier quoted context omitted.
I feel like a lot of people miss that Her was a dystopian future, not an ideal to hit. Also, it’s $3000. For that you could buy subscriptions to OpenAI etc and have the dystopian partner everywhere you go.
If Silicon Valley could tell the difference between utopias and dystopias, we wouldn't have companies named Soylent or iRobot, and the recently announced Anduril/Palantir/OpenAI partnership to hasten the creation of either SkyNet or Big Brother wouldn't have happened at all.
I mean, we still act like a "wild goose chase" is a bad thing.
We still schedule "bi-weekly" meetings.
We can't agree on which way charge goes in a wire.
Have you seen the y-axis on an economists chart?
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#468Earlier quoted context omitted.
Xavier AGX owner here to report the same.
My Jetson TX2 developer kit didn't stop working, but it's on a very out of date Linux distribution. Maybe if Nvidia makes it to four trillion in market cap they'll have enough spare change to keep these older boards properly supported, or at least upstream all the needed support.
Back in 2018 I've been involved in a product development based on TX2. I had to untangle the entire nasty mess of Bash and Python spaghetti that is JetPack SDK to get everything sensibly integrated into our custom firmware build system and workflow (no, copying your application files over prebaked rootfs on a running board is absolutely NOT how it's normally done). You basically need a few deb packages with nvidia libs for your userspace, and swipe a few binaries from Jetpack that have to be run with like 20 undocumented arguments in right order to do the rest (image assembly, flashing, signing, secure boot stuff, etc), the rest of the system could be anything. Right when I was finished, a 3rd party Yocto layer implementing essentially the same stuff that I came up with, and the world could finally forget about horrors of JetPack for good. I also heard that it has somewhat improved later on, but I have not touch any NVidia SoCs since (due to both trauma and moving to a different field).
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#469Earlier quoted context omitted.
Lambda has on-demand GH200 right now for $1.49. There might be a cheaper deal elsewhere for a contract.
Weird that they have cheapest H100 for $2.49. It should either be shared GH200 or it could just a promotional price.
It’s a temporary thing I think because nobody wants to use ARM
Re: Nvidia's Project Digits is a 'personal AI supercomputer'
#470Earlier quoted context omitted.
Isn't the Jetson line more of an embedded line and not a end-user desktop? Why would you run Ubuntu?
The Jetson TX2 developer kit makes a very nice developer machine - an ARM64 machine with good graphics acceleration, CUDA, etc. In any case, Ubuntu is what it comes with.
If you spent enough time and energy on it.. I'm fairly confident you could get the newest Ubuntu running. You'd have to build your own kernel, manually generate the initramfs, figure out how to and then flash it. You'd probably run into stupid little problems like the partition table the flash script makes doesn't allocate enough space for the kernel you've built.. I'm sure there would be hiccups, at the very least, but everything's out there to do it.