What LLM / image / video models would this allow people to self-host that are worth it at the presumably somewhat low speed?
New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
91–100 of 117 posts
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#92Earlier quoted context omitted.
It doesn't work that way. AMD said they simply couldn't do it. It wasn't about taking some modest performance hit, it was that they couldn't make the chip function with modular memory due to signal integrity problems.
Then why not pick a CPU that is socketable? There are dozens of them on the market that Framework could have picked for their Desktop product.
None of them have something even close to the memory bandwidth or integrated GPU performance of the Ryzen AI Max processors.
They want a Apple M_ Max like machine.
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#93Ryzen AI Max Plus Pro 495 How does a CEO read this and not immediately fire their entire marketing team?
We're running out of space on our e-commerce UI elements and physical labels to fit some of these names.
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#94I have a framework desktop w/ 128GB that I bought last Christmas and if I’m looking at it right it costs $2000 (CAD) more now because of the RAM shortage (and in any event is apparently out of stock). Would love to have 192 GB but I’m not sure I can justify buying another. Does anyone have a sense of how this might progress, e.g if I can get a 256 or 512 GB in a year if I wait. In any case I’m jealous this exists and…
Unfortunately we don't have any indication of memory pricing coming down in the next year, and many indications pointing to memory pricing continuing to increase pretty substantially over the next six months, especially for the LPDDR5X we use in Framework Desktop.
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#95I understand their reasoning but it’s still a shame Framework opted for a proprietary motherboard instead of mini-ITX with a socket CPU and GPU. I value repairability over a little bit of extra performance.
Based on the product spec sheet[1] it appears that the Framework Desktop motherboard is mini-ITX, and that the chassis is[2] as well. It’s fully possible that I’ve missed something, but it doesn’t appear to be proprietary to me. [1]: https://frame.work/desktop?tab=specs [2]: https://frame.work/products/desktop-case
This is correct, we used a standard Mini-ITX form factor, and we've seen a number of customers pick up just the Mainboard and drop it into standard ATX cases. The power supply is also a standard FlexATX PSU.
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#96> Seize the means of computation Feels like they blatantly ripped that off the title of a Cory Doctorow book [0]. [0]: https://en.wikipedia.org/wiki/The_Internet_Con
We're fans of Cory Doctorow, and he is a Framework Laptop user!
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#97No blog post, no order, no preorder; I think the only things about it are this sentence and a half: > 192GB coming soon > The most powerful Framework Desktop yet is coming soon with an AMD Ryzen™ AI Max+ PRO 495 processor and 192GB of LPDDR5X memory.
It wasn't our preferred way of making an announcement, but all that we are currently able to do this early on this pre-release processor.
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#98I typed my (masked) email into the input, pressed tab and enter, it redirected me to some cloudflare captcha marketing site. I thought at first it didn't want the masked email, but then it worked when I clicked with my mouse. Apparently there are 3 invisible focus targets in between! Dear people who create websites, these things are important, they should work!
I shared this internally, and the team confirmed this is indeed a bug in our email form rendering. We've added it to the development backlog.
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#99I typed my (masked) email into the input, pressed tab and enter, it redirected me to some cloudflare captcha marketing site. I thought at first it didn't want the masked email, but then it worked when I clicked with my mouse. Apparently there are 3 invisible focus targets in between! Dear people who create websites, these things are important, they should work!
I shared this internally, and the team confirmed this is indeed a bug in our email form rendering. We've added it to the development backlog.
Thanks for caring, this is really cool hearing from you!
Re: New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory
#100I have a framework desktop w/ 128GB that I bought last Christmas and if I’m looking at it right it costs $2000 (CAD) more now because of the RAM shortage (and in any event is apparently out of stock). Would love to have 192 GB but I’m not sure I can justify buying another. Does anyone have a sense of how this might progress, e.g if I can get a 256 or 512 GB in a year if I wait. In any case I’m jealous this exists and…
Yes, others should be able to do this too, and the change is larger memory chips.
The next big step is Medusa Halo, which will have a 384-bit LPDDR6 interface. Those should be able to support 256GB at release, with 512GB coming later with larger chips (But I don't know to what extent people should trust the memory vendor roadmaps.) I'm not sure if they will be out in a year. Probably will be in a year and half.