Is there something similar with twice the memory/bandwidth? That's a use case that I would seriously consider to run any frontier open source model locally, at usable speed. 128GB is almost enough.
Mac Studio
Asus Ascent GX10
121–130 of 203 posts
Re: Asus Ascent GX10
#122I wonder why they even added this to the FAQ if they're gonna weasel their way around it and not answer properly? > What is the memory bandwidth supported by Ascent GX10? > AI applications often require a bigger memory. With the NVIDIA Blackwell GPU that supports 128GB of unified memory, ASUS Ascent GX10 is an AI supercomputer that enables faster training, better real-time inference, and support larger models like LL…
Taiwanese companies are legendary for producing baller hardware with terrible marketing and documentation that answers important questions. It's like those teams don't talk to each other inside the business. Fortunately, their products are also easy to crack open and probe.
Also terrible software and firmware. Examples are the programs for motherboard RGB control from Asus, Asrock, MSI, Gigabyte, etc.
Re: Asus Ascent GX10
#123"Nvidia dgx os", ugh. It would be a lot more enticing if that thing could run stock Linux.
DGXOS is a customized Ubuntu Noble!
/etc/os-release:
PRETTY_NAME="Ubuntu 24.04.3 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04.3 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo
DGX_NAME="DGX Spark"
DGX_PRETTY_NAME="NVIDIA DGX Spark"
DGX_SWBUILD_DATE="2025-09-10-13-50-03"
DGX_SWBUILD_VERSION="7.2.3"
DGX_COMMIT_ID="833b4a7"
DGX_PLATFORM="DGX Server for KVM"
DGX_SERIAL_NUMBER="Not Specified"
I couldn't get Nvidia AI Workbench to start on Neon KDE after changing to DISTRIB_ID=Ubuntu in /etc/lsb-release. Neon is based on Ubuntu Noble too.
Re: Asus Ascent GX10
#124I had one of these on pre-order/reservation from when they announced the DGX Spark and ended up returning it after a couple days. I thought I'd give it a shot, though. The 128GB of unified memory was the big selling point (as are any of the DGX Spark boxes), but the memory bandwidth was very disappointing. Being able to load a 100B+ parameter model was cool in terms of novelty but not particularly great for local inf…
I have a weird feeling that "Spark 2" may have an apple logo on it.
Re: Asus Ascent GX10
#125From the FAQ… doesn’t seem promising when they ask and then evade a crucial question. > What is the memory bandwidth supported by Ascent GX10? AI applications often require a bigger memory. With the NVIDIA Blackwell GPU that supports 128GB of unified memory, ASUS Ascent GX10 is an AI supercomputer that enables faster training, better real-time inference, and support larger models like LLMs.
They seem to have another FAQ here that gives a real answer (273GB/s): https://www.asus.com/us/support/faq/1056142/
Re: Asus Ascent GX10
#126Couldn't you buy a Mac Ultra with more memory for the same price?
My reasons for not choosing an Apple product for such a use-case: 1- I vote with my wallet, do I want to pay a company to be my digital overlord, doing everything they can to keep me inside their ecosystem? I put too much effort to earn my freedom to give it up that easily. 2- Software: Almost certainly, I would want to run linux on this. Do I want to have something that has or eventually will have great mainstream l…
Not disagreeing with any of your points, but this is a good trend right?
https://github.com/apple/container
> container is a tool that you can use to create and run Linux containers as lightweight virtual machines on your Mac. It's written in Swift, and optimized for Apple silicon.
Re: Asus Ascent GX10
#127From the FAQ… doesn’t seem promising when they ask and then evade a crucial question. > What is the memory bandwidth supported by Ascent GX10? AI applications often require a bigger memory. With the NVIDIA Blackwell GPU that supports 128GB of unified memory, ASUS Ascent GX10 is an AI supercomputer that enables faster training, better real-time inference, and support larger models like LLMs.
They have failed to provide answers to other FAQ as well. The answers are really awkward and don't read like LLM output which I'd expect to be much more fluent. Perhaps a model which was lobotomized through FP4 quantisation and "fine tuning" on one of these.
Re: Asus Ascent GX10
#128My hope was to find a system which does ASR, then LLM processing with MCP use and finally TTS: "Put X on my todo list" / "Mark X as done" -> LLM thinks, reads the todo list, edits the todo list, and tells me "I added X to your todo list", ... "Turn all the lights off" -> llm thinks and uses MCP to turn off the lights -> "Lights have been turned off". "Send me an email at 8pm reminding me to do" .... "Email has been scheduled for 8pm"
That's all I want. It does not have to be fast, but it must be capable of doing all of that.
Oh, and it should be energy efficient. Very important for a 24/7 machine.
Re: Asus Ascent GX10
#129ServeTheHome has already benchmarked the DGX Spark architecture against the (very obvious) Ryzen AI Max 395+ with 128G RAM:
https://www.servethehome.com/nvidia-dgx-spark-review-the-gb1...
If (and in case of Nvidia that's a big if at the moment) they get their software straight on Linux for once this piece of hardware seems to be something to keep an eye on.
Re: Asus Ascent GX10
#130These very narrow speed measurements are getting out of hand:
1 petaFLOP using FP4, that's 4 petaFLOPS using FP1 and infinite petaFLOPS using FP0.