It's a bit disingenuous to claim 1 PFLOPs without making clear that's for FP4 (with "structured sparsity"?)
Nvidia DGX Spark
11–20 of 222 posts
Re: Nvidia DGX Spark
#12I’m not in this space, so I don’t know what’s normal, but I guess I’m a little surprised to see only 10 gig Ethernet for high speed connectivity.
Yeah, it’s miles better than WiFi. But if there was something I’d think maybe benefit from Thunderbolt this would’ve been it.
The ability to transfer large models or datasets that way just seems like it would be much faster and a real win for some customers.
Re: Nvidia DGX Spark
#13Is this the $3500 one?
Re: Nvidia DGX Spark
#14I was considering getting an RTX 5090 to run inference on some LLM models, but now I’m wondering if it’s worth paying an extra $2K for this option instead
Re: Nvidia DGX Spark
#15Power consumption : TBD
?? this seems more than a little disingenuous...
Re: Nvidia DGX Spark
#16It's a bit disingenuous to claim 1 PFLOPs without making clear that's for FP4 (with "structured sparsity"?)
It does say `Experience up to 1 petaFLOP of AI performance at FP4 precision with the NVIDIA Grace Blackwell architecture.` in the features section.
But yeah, this should have been further up.
Re: Nvidia DGX Spark
#17Am I missing something or does the comparably priced (technically cheaper) Jetson Thor have double the PFLOPs of the Spark with the same memory capacity and similar bandwidth?
My understanding is the DGX Spark is optimized for training / fine tuning and the Jetson Thor is optimized for running inference.
Architecturally, the DGX Spark has a far better cache setup to feed the GPU, and offers NVLINK support.
Re: Nvidia DGX Spark
#18I’m not in this space, so I don’t know what’s normal, but I guess I’m a little surprised to see only 10 gig Ethernet for high speed connectivity. Yeah, it’s miles better than WiFi. But if there was something I’d think maybe benefit from Thunderbolt this would’ve been it. The ability to transfer large models or datasets that way just seems like it would be much faster and a real win for some customers.
This thing has a ConnectX-7, which gives it 2 x 200 Gbps networking. The 10 gig port is far from the fastest network interface on the Spark.
Re: Nvidia DGX Spark
#19Am I missing something or does the comparably priced (technically cheaper) Jetson Thor have double the PFLOPs of the Spark with the same memory capacity and similar bandwidth?
[deleted]
Re: Nvidia DGX Spark
#20It'll be stunted in some way - Nvidia always holds back some crucial feature that you need, to push you up to the next highest priced product line.