The Framework Desktop is a beast

Post by [deleted] » Sun, Aug 10, 2025, 12:58 PM UTC

mschild wrote: post #116

zozbot234 wrote: post #71

Earlier quoted context omitted.

It's taking a newly released mobile- and mini-PC-focused platform that's usually paired with proprietary technology, and building something that's as close as possible to a standard desktop with it. Seems very much in the Framework spirit once you account for that side of it.

Right, but why go with mobile at all? I get the laptops. For desktop you already have thousands of choices though and reparability, assuming its not some proprietary Dell/HP desktop, is already as good as it gets without breaking out your soldering iron. That said, they'll know more about the market demand than I do and another option won't hurt :)

Post by sidewndr46 » Sun, Aug 10, 2025, 1:05 PM UTC

izacus wrote: post #122

Kirth wrote: post #113

I was baffled by the comparison to the M4 Max. Does this mean that recent AMD chips will be performing at the same level, and what does that mean for on-device LLMs? .. or am I misunderstanding this whole ordeal?

Yes, the Strix series of AMD uses a similar architecture as M series with massive memory bandwidth and big caches. That results in significantly better performance.

Post by rr808 » Sun, Aug 10, 2025, 1:06 PM UTC

biehl wrote: post #123

Kirth wrote: post #113

I was baffled by the comparison to the M4 Max. Does this mean that recent AMD chips will be performing at the same level, and what does that mean for on-device LLMs? .. or am I misunderstanding this whole ordeal?

I think DHH compares them because they are both the latest, top-line chips. I think DHHs benchmarks show that they have different performance characteristics. But DHHs favorite benchmark favors whatever runs native linux and docker. For local LLM the higher memory bandwith of M4 Max makes it much more performant. Arstechnica has more benchmarks for non-llm things https://arstechnica.com/gadgets/2025/08/review-framewo…

Post by alpaca128 » Sun, Aug 10, 2025, 1:09 PM UTC

LargoLasskhyfv wrote: post #147

ggm wrote: post #104

Earlier quoted context omitted.

Pong!

Errm, No :-) I meant bars as in benchmarks, often rather meaningless, because within the range of statistic noise. For instance, something having 100.200 points in one config, in another 100.2 20 , with the bars/scales distorted to make that difference seem much larger. Gaming the bar-game, so to speak.

Post by nextos » Sun, Aug 10, 2025, 1:16 PM UTC

SomeoneOnTheWeb wrote: post #182

cuu508 wrote: post #177

What are more budget friendly options for similar workloads (running web app test suite in parallel)? My test suite currently runs in ~6 seconds on 9700K. Would be nice to speed it up, but maybe not for $2000 :-) Last I checked 13700K or 13900K looked like the price/performance sweet spot, but perhaps there are better options?

Minisforum 790S7/795S7, mini-ITX desktop. 16 cores, 32 threads, only a bit less powerful than a desktop Ryzen 7950X or a 14900K, but with a comparatively low power usage. About 500€ barebones, then you add your own SSD and SO-DIMM RAM.