Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

frame.work

Post reply on HN
Print view View original

11–20 of 117 posts

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#11

Post by andy99 »

notdefio wrote: post #7

Im less interested in the memory than the memory bandwidth. The current system with 128GB can load pretty big models, but its meaningless unless you want to wait 40 minutes per prompt. I've had best results with Qwen3.6-35B-A3B, which uses 40GB of memory, but only uses 3 billion parameters per token which helps with throughput. Until memory bandwidth significantly improves I just can't see myself wanting to use all t…

Try poolside that came out yesterday https://news.ycombinator.com/item?id=49004937

or Qwen 3.5 122B A10B, both use more memory and still have experts sized for decent speed at the 395’s memory bandwidth at 4bit quantization

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#12

Post by nl »

andy99 wrote: post #2

I have a framework desktop w/ 128GB that I bought last Christmas and if I’m looking at it right it costs $2000 (CAD) more now because of the RAM shortage (and in any event is apparently out of stock). Would love to have 192 GB but I’m not sure I can justify buying another. Does anyone have a sense of how this might progress, e.g if I can get a 256 or 512 GB in a year if I wait. In any case I’m jealous this exists and…

On RAM supplies, the best estimates I've seen are https://www.tomshardware.com/pc-components/dram/cxmt-close-t...

They are estimating a 25% shortfall in supply remaining in 2030, even with Chinese companies ramping up DDR5 supply.

It's not looking great - the RAM producers need more of the same machines that other semi-conductor manufactures need and the suppliers of those seem unable to increase production.

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#14

Post by cyanydeez »

notdefio wrote: post #7

Im less interested in the memory than the memory bandwidth. The current system with 128GB can load pretty big models, but its meaningless unless you want to wait 40 minutes per prompt. I've had best results with Qwen3.6-35B-A3B, which uses 40GB of memory, but only uses 3 billion parameters per token which helps with throughput. Until memory bandwidth significantly improves I just can't see myself wanting to use all t…

I use exactly the setup you describe; it can handle 1-3 agents working if the agent work has IO delays. with MTP models, prefill is quite fast.

Not sure what damage you have, but no one waits 40 minutes per prompt or even a minute; The A3B model loads within 10 seconds and a simple response in opencode is maybe at most a minute, then catches up in 3-5second bursts depending on IO.

I put dynamic context pruning into opencode and tweaked it for 45k-85k context before it shrinks; this lets me get into 500k token sizes and fixed on medium sized github repos.

There's a chance this comment is a skill error:

1. USe llamacpp with a MTP model

2. Use reasoning-budget and reasoning-message

3. Tailor your agent to use the reasoning-message to use subagents and dyanmic compaction.

---

Now you have a reasonable coding agent for cloning, building and extending any github project I've seen so far.

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#16

Post by paxys »

notdefio wrote: post #7

Im less interested in the memory than the memory bandwidth. The current system with 128GB can load pretty big models, but its meaningless unless you want to wait 40 minutes per prompt. I've had best results with Qwen3.6-35B-A3B, which uses 40GB of memory, but only uses 3 billion parameters per token which helps with throughput. Until memory bandwidth significantly improves I just can't see myself wanting to use all t…

If you are waiting 40 minutes for a prompt on a Ryzen max+ you have no idea what you are doing.

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#17

Post by culopatin »

artisinal wrote: post #13

I understand their reasoning but it’s still a shame Framework opted for a proprietary motherboard instead of mini-ITX with a socket CPU and GPU. I value repairability over a little bit of extra performance.

What’s stopping you from building that yourself instead of having to go through Framework?

Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory

#20

Post by delfinom »

artisinal wrote: post #13

I understand their reasoning but it’s still a shame Framework opted for a proprietary motherboard instead of mini-ITX with a socket CPU and GPU. I value repairability over a little bit of extra performance.

Framework is going for a computer OEM market where they need to make margin, hence the soldered-on components and relatively limited options. People in the pre-built computer market overwhelmingly don't care about replaceable components, because anyone else will just buy components and build a PC, for both the greater market of options AND overall lower price than buying pre-built (if they don't overspec).
Post reply on HN