I cancelled my Framework Desktop order and ordered a HP Z2 Mini G1a instead, the goal being to replace my Mac Studio as I've had it with Apple's arrogance and lousy software quality. The HP is much smaller, has ECC RAM and 10G Ethernet. Significantly more expensive, however.
The Framework Desktop is a beast
91–100 of 464 posts
Re: The Framework Desktop is a beast
#92Earlier quoted context omitted.
Your comment is unnecessarily hostile. There are plenty of components to choose from which do not need soldered-on RAM. Giving up modularity to gain access to higher memory bandwidth is certainly a trafeoff many are willing to make, but to take that tradeoff as a company known for modularity is, as the parent comment put it, curious.
Every single description of the Framework desktop that I've seen has addressed this issue. To comment as though it's some sort of mystery is disingenuous at best. My comment was precisely as friendly as the commenter deserved. And as I said, if you read the article, you'll see that the tradeoff in question has paid off very well.
1. Framework branded themselves as the company for DIY computer repairability and maintainability in the laptop space.
2. They've now released a desktop that is less repairable than their laptops, and much less repairable than most desktops you can buy today.
That's what I consider a curious move.
The hardware choice may provide a good reason to solder on the RAM, but I wasn't commenting on that and have no idea how anyone could read my comment and have that be their takeaway.
I was commenting on a brand throwing away the thing it's marketed itself for. In exchange for repairability, you now get shiny baubles like custom tiles for the case.
Re: The Framework Desktop is a beast
#93> In some ways, the Framework Desktop is a curious machine. Desktop PCs are already very user-repairable! So why is Framework even bringing their talents to this domain? In the laptop realm, they're basically alone with that concept, but in the desktop space, it's rather crowded already. Yet it somehow still makes sense. And even more curious, Framework Desktop is deliberately less repairable than their laptops. They…
The RAM is soldered on all Halo Strix platforms because physics is getting in the way. With pluggable DIMMs the memory bandwidth would be halved, at best.
I was commenting on a brand based on repairability selling a product that's deliberately not repairable. It's a curious choice to throw away the branding that brought them to where they are, and hopefully not the start of a trend for their other devices.
Re: The Framework Desktop is a beast
#94How is AMD GPU compatibility with leading generative AI workflows? I'm under the impression everything is CUDA.
In the LLM world, you really only see CUDA being used with Triton and/or PyTorch consumers that haven't moved onto better pastures (mainly because they only know Python and aren't actually programmers).
That said, AMD can run most CUDA code through ROCm, and AMD officially supports Triton and PyTorch, so even the academics have a way out of Nvidia hell.
Re: The Framework Desktop is a beast
#95Earlier quoted context omitted.
To be clear, AMD is giving you 2x the bandwidth of competing chips and you're complaining that it isn't 4x.
My complaints are the maximum RAM of the system and the modularity of the RAM. With an increased number of channels, you could have a greater amount of RAM at a lower frequency but at the same bandwidth. So you would at least be able to run some of these much larger AI models.
Re: The Framework Desktop is a beast
#96I cancelled my Framework Desktop order and ordered a HP Z2 Mini G1a instead, the goal being to replace my Mac Studio as I've had it with Apple's arrogance and lousy software quality. The HP is much smaller, has ECC RAM and 10G Ethernet. Significantly more expensive, however.
Plus, you can now deploy [MLX projects on CUDA](https://github.com/ml-explore/mlx/pull/1983)
Re: The Framework Desktop is a beast
#97Earlier quoted context omitted.
He is still right. It is a desktop PC that is less repairable than all other desktop PCs, from a brand that is known to champion repairability. They had a reason for it, but could've chosen to not create more throwaway things.
The only part I’ve ever had not fail on a PC or Laptop is RAM.
Re: The Framework Desktop is a beast
#98Earlier quoted context omitted.
A mac studio configured similarly With 128 GB of memory and an 8 TB SSD is $5799
The Mac Studio (at least the M3 Ultra model) blows the Framework out of the water when it comes to AI performance, though, at least according to this (Dutch language) benchmark: https://tweakers.net/reviews/13614/framework-desktop-de-fram... Paying twice the price for twice to seven times the performance may not be such a bad thing. Then again, with Apple you're kind of stuck with macOS and the like, so Framework may…
Re: The Framework Desktop is a beast
#99Oh, to be young again and care about benchmarks, bogomips and stuff like that.
Re: The Framework Desktop is a beast
#100Earlier quoted context omitted.
The only part I’ve ever had not fail on a PC or Laptop is RAM.
RAM failure is actually pretty common on non-JEDEC profiles, I've seen it happen a lot on gaming PCs. Very uncommon on "regular" computers that aren't pushing the clock and timings, though.