Live data from Hacker News

New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

frame.work

61–70 of 117 posts

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#64
post #46

Earlier quoted context omitted.

They did not, can you explain what do you mean?

For those of us with feebler minds than you or him, the name is just full of qualifiers that make no sense.

To be fair - I'd much rather the name be overwrought but clear (once you know or have the decryption key to translate) than to have to look up an even uglier chart that i have ~no chance of memorizing to go 'ok, the Tiberian has X, Y, Z and Q and the Cyrian has Q, Y, but Z is nerfed'

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#65
post #18

Ryzen AI Max Plus Pro 495 How does a CEO read this and not immediately fire their entire marketing team?

I know right. Where’s the «Elite»?

Don't forget the X's as well, i'm looking at you Amd RX 7900XTX

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#67
post #2

I have a framework desktop w/ 128GB that I bought last Christmas and if I’m looking at it right it costs $2000 (CAD) more now because of the RAM shortage (and in any event is apparently out of stock). Would love to have 192 GB but I’m not sure I can justify buying another. Does anyone have a sense of how this might progress, e.g if I can get a 256 or 512 GB in a year if I wait. In any case I’m jealous this exists and…

Are you generally happy with it? What do you mainly use it for? I'm kinda tempted by the frameworks because they are somewhat energy efficient and compact (which I both value highly!) but my concern is that the GPU is on the low end for 1440p gaming (while being barely price-competitive with a self-built Ryzen9950 + 9070XT combination).

I use it exclusively as a server for LLM inference - first more for research but have been using it for coding now that there are sufficiently capable models that run on. For that I’m very happy.

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#68
post #28

Earlier quoted context omitted.

I use exactly the setup you describe; it can handle 1-3 agents working if the agent work has IO delays. with MTP models, prefill is quite fast. Not sure what damage you have, but no one waits 40 minutes per prompt or even a minute; The A3B model loads within 10 seconds and a simple response in opencode is maybe at most a minute, then catches up in 3-5second bursts depending on IO. I put dynamic context pruning into o…

Are you on Strix Halo? If so, which llama.cpp backend are you using? ROCm on Strix Halo still seems incompatible with MTP models.

I'm able to use ROCm with MTP just fine (Qwen and Gemma).

I use Lemonade and have only the ROCm installed through it (ETA: their llama.cpp version is a fork, not sure what is different vs the main trunk).

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#69
post #12

Earlier quoted context omitted.

On RAM supplies, the best estimates I've seen are https://www.tomshardware.com/pc-components/dram/cxmt-close-t... They are estimating a 25% shortfall in supply remaining in 2030, even with Chinese companies ramping up DDR5 supply. It's not looking great - the RAM producers need more of the same machines that other semi-conductor manufactures need and the suppliers of those seem unable to increase production.

> the RAM producers need more of the same machines that other semi-conductor manufactures need and the suppliers of those seem unable to increase production I suspect that it is very, very profitable for them not to increase production and instead increase prices. This is one of those cases where the free market fails and governments should step-in. IP laws are there to elevate the arts and sciences, not stifle them…

> IP laws are there to elevate the arts and sciences, not stifle them in the name of profit.

Hmmmmmmmmm

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#70
post #7

Im less interested in the memory than the memory bandwidth. The current system with 128GB can load pretty big models, but its meaningless unless you want to wait 40 minutes per prompt. I've had best results with Qwen3.6-35B-A3B, which uses 40GB of memory, but only uses 3 billion parameters per token which helps with throughput. Until memory bandwidth significantly improves I just can't see myself wanting to use all t…

I have an NVIDIA Spark thingy (the ASUS one) and it's the same problem there, though the prefill side is superior to the Ryzen ones. But I actually think 128GB is too little. There are some compelling models that are above what can fit in that at reasonable quants (e.g. DeepSeek V4 Flash) but could if the system was 256GB. If RAM prices weren't so f*cked I think we'd be seeing 256GB and even 512GB unified memory syst…

> RAM prices weren't so f*cked I think we'd be seeing 256GB and even 512GB unified memory systems becoming quite common

I agree but unfortunately that speaks to the depth of demand right now. Even as more capacity comes online (if it does) I suspect it will all get used up without prices needing to drop. Hopefully on the other side of this 10 years from now it means RAM will be insanely abundant and we’ll all have machines with a couple TB as the same inflation adjusted price as say 16GB a few years ago. Considering single digit MB of RAM was the norm in the early-mid ‘90s its not so far fetched.

Post reply on HN