Earlier quoted context omitted.
There's no other way to get 256 GB/s of memory bandwidth for this cheap, and that's quite valuable in many workloads. I'm curious to get one for compiling code too. You can get similar bandwidth with server boards that cost 5-10x as much, or with a Mac Studio that costs 2.5x as much.
> You can get similar bandwidth with server boards Could be wrong, but I don't think you can. The bandwidth limit, AFAIK, is a problem with the DDR5 spec. These soldered solutions can go faster specifically because they aren't DDR5.
Framework's first desktop is a strange–but unique–mini ITX gaming PC
51–60 of 554 posts
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#52Two other Framework announcements: New 12-inch laptop form factor with 360 degree hinge (ie "tablet mode") and a touchscreen. No price announced, but it is aimed at students: https://arstechnica.com/gadgets/2025/02/frameworks-laptop-12... New mainboard upgrade options for Framework 13 models: https://arstechnica.com/gadgets/2025/02/framework-gives-its-...
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#53what is the pitch, because desktops don't have a problem with replacements, repairs etc.
For $2000, you get 128 of system RAM, 96 of which is addressable as VRAM. Only ways of getting 96GB of VRAM in a desktop are to either:
1. Drop ~$5000 on a (very non-upgradeable) Mac Studio 2. Drop ~$20k on a dual RTX 6000 workstation
For running local LLMs, there's nothing on the market presently even remotely like this.
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#54Earlier quoted context omitted.
There's no other way to get 256 GB/s of memory bandwidth for this cheap, and that's quite valuable in many workloads. I'm curious to get one for compiling code too. You can get similar bandwidth with server boards that cost 5-10x as much, or with a Mac Studio that costs 2.5x as much.
A Mac mini with an M4 Pro and 64GB of memory has the same bandwidth and costs £1,999, compared to £1,750 for the Framework Desktop when factoring in the minimum costs for storage, tiles, and necessary expansion cards.
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#55It seems unframeworky Memory, CPU and GPU once piece of metal, sitting in a tiny box. A regular PC in a regular case, it a lot more modular and upgradable. It does seem like an interesting box, and matches against Apple Studio I would presume. Yet customers of Apple are used to having (near) 0 user modifiable parts. It might well have a good market, It might b a great box. It is unframeworky.
The ceo kind of explains why in this video. In essence it seems to be a limitation of the chip from AMD
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#56Soldered memory and no x16 PCIe slot on a desktop are interesting choices. Not sure who the target market is. Seems like the interconnect between boards is also pretty slow compared to Nvidia Digits or even thunderbolt 5.
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#57I was really look forward to an ARM laptop. Hopefully they will develop one soon.
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#58what is the pitch, because desktops don't have a problem with replacements, repairs etc.
Repair-friendly form factor for a "Unified Memory" platform. For $2000, you get 128 of system RAM, 96 of which is addressable as VRAM. Only ways of getting 96GB of VRAM in a desktop are to either: 1. Drop ~$5000 on a (very non-upgradeable) Mac Studio 2. Drop ~$20k on a dual RTX 6000 workstation For running local LLMs, there's nothing on the market presently even remotely like this.
I have a max with 64GB RAM, which is good enough for 70b models with a 3 bit quant. Even if I had more RAM to run larger models, my GPU would be the bottleneck.
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#59Up to 128 GB RAM available for running AI models. Theoretically awesome, but this might have some interesting market consequences for everyone else.
Re: Framework's first desktop is a strange–but unique–mini ITX gaming PC
#60Up to 128 GB RAM available for running AI models. Theoretically awesome, but this might have some interesting market consequences for everyone else.