Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

frame.work

Post reply on HN
Print view View original

21–30 of 117 posts

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#22

Post by myrmidon »

andy99 wrote: post #2

I have a framework desktop w/ 128GB that I bought last Christmas and if I’m looking at it right it costs $2000 (CAD) more now because of the RAM shortage (and in any event is apparently out of stock). Would love to have 192 GB but I’m not sure I can justify buying another. Does anyone have a sense of how this might progress, e.g if I can get a 256 or 512 GB in a year if I wait. In any case I’m jealous this exists and…

Are you generally happy with it? What do you mainly use it for?

I'm kinda tempted by the frameworks because they are somewhat energy efficient and compact (which I both value highly!) but my concern is that the GPU is on the low end for 1440p gaming (while being barely price-competitive with a self-built Ryzen9950 + 9070XT combination).

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#23

Post by egeozcan »

I typed my (masked) email into the input, pressed tab and enter, it redirected me to some cloudflare captcha marketing site. I thought at first it didn't want the masked email, but then it worked when I clicked with my mouse. Apparently there are 3 invisible focus targets in between!

Dear people who create websites, these things are important, they should work!

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#24

Post by cmrdporcupine »

notdefio wrote: post #7

Im less interested in the memory than the memory bandwidth. The current system with 128GB can load pretty big models, but its meaningless unless you want to wait 40 minutes per prompt. I've had best results with Qwen3.6-35B-A3B, which uses 40GB of memory, but only uses 3 billion parameters per token which helps with throughput. Until memory bandwidth significantly improves I just can't see myself wanting to use all t…

I have an NVIDIA Spark thingy (the ASUS one) and it's the same problem there, though the prefill side is superior to the Ryzen ones.

But I actually think 128GB is too little. There are some compelling models that are above what can fit in that at reasonable quants (e.g. DeepSeek V4 Flash) but could if the system was 256GB.

If RAM prices weren't so f*cked I think we'd be seeing 256GB and even 512GB unified memory systems becoming quite common. As it is I think it will be 10 years before >128GB becomes feasible on a regular consumer machine for normal people again.

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#28

Post by preya2k »

cyanydeez wrote: post #14
notdefio wrote: post #7

Im less interested in the memory than the memory bandwidth. The current system with 128GB can load pretty big models, but its meaningless unless you want to wait 40 minutes per prompt. I've had best results with Qwen3.6-35B-A3B, which uses 40GB of memory, but only uses 3 billion parameters per token which helps with throughput. Until memory bandwidth significantly improves I just can't see myself wanting to use all t…

I use exactly the setup you describe; it can handle 1-3 agents working if the agent work has IO delays. with MTP models, prefill is quite fast. Not sure what damage you have, but no one waits 40 minutes per prompt or even a minute; The A3B model loads within 10 seconds and a simple response in opencode is maybe at most a minute, then catches up in 3-5second bursts depending on IO. I put dynamic context pruning into o…

Are you on Strix Halo? If so, which llama.cpp backend are you using? ROCm on Strix Halo still seems incompatible with MTP models.
Post reply on HN