101–110 of 117 posts
Woof. What's that going to cost? And will we actually be able to buy one, because the 128GB model has been sold out pretty much since the LLM craze started...
Earlier quoted context omitted.
Then why not pick a CPU that is socketable? There are dozens of them on the market that Framework could have picked for their Desktop product.
None of them have something even close to the memory bandwidth or integrated GPU performance of the Ryzen AI Max processors. They want a Apple M_ Max like machine.
Earlier quoted context omitted.
My computer with socketed CPU had no issues being a computer. It’s so strange for Framework to make a machine you can’t repair. It’s the Framework Desktop. Why not create the best possible repairable Desktop instead of using some niche CPU soldered to the board? Not everyone has AI workloads. Some people just browse the web a little.
Can it run a local LLM with 35B+ parameters using GPU acceleration for reasonable token performance? If not, then you're being obtuse.
Earlier quoted context omitted.
Can it run a local LLM with 35B+ parameters using GPU acceleration for reasonable token performance? If not, then you're being obtuse.
How many people use a desktop for a local LLM with 35B+ parameters? Maybe 0.0001% of computer users?
If you don't want to engage in a reasonable discussion, you can get bent.
Earlier quoted context omitted.
None of them have something even close to the memory bandwidth or integrated GPU performance of the Ryzen AI Max processors. They want a Apple M_ Max like machine.
Why not put a big fat Ryzen 9 chip in it? Most people use their computer for browsing the web, playing some games, doing some spreadsheets. A standard CPU would have been more than powerful enough for that and the Desktop would be more repairable.
Earlier quoted context omitted.
To expand, positional definition of adjectives tends to be a bad marketing scheme. Nobody knows that pro and max mean specific things. If AMD needs to create a full cross-product of their hardware feature set, because they intend to have a SKU for every possible combination, they probably need a better scheme. Say what you want about Celeron/Pentium/i3/i5/i7, but it mostly got the idea across (except on the occasions…
So why do so many of major successful product corporations use this kind of naming scheme?
Earlier quoted context omitted.
> IP laws are there to elevate the arts and sciences, not stifle them in the name of profit. Hmmmmmmmmm
I mean, that's what the US constitution says very plainly. It does seem to be a pretty unpopular take these days though. "To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries."
Earlier quoted context omitted.
To expand, positional definition of adjectives tends to be a bad marketing scheme. Nobody knows that pro and max mean specific things. If AMD needs to create a full cross-product of their hardware feature set, because they intend to have a SKU for every possible combination, they probably need a better scheme. Say what you want about Celeron/Pentium/i3/i5/i7, but it mostly got the idea across (except on the occasions…
So why do so many of major successful product corporations use this kind of naming scheme?
(Ryzen) (AI) (Max+) (Pro) (495)
I have a framework desktop w/ 128GB that I bought last Christmas and if I’m looking at it right it costs $2000 (CAD) more now because of the RAM shortage (and in any event is apparently out of stock). Would love to have 192 GB but I’m not sure I can justify buying another. Does anyone have a sense of how this might progress, e.g if I can get a 256 or 512 GB in a year if I wait. In any case I’m jealous this exists and…
On RAM supplies, the best estimates I've seen are https://www.tomshardware.com/pc-components/dram/cxmt-close-t... They are estimating a 25% shortfall in supply remaining in 2030, even with Chinese companies ramping up DDR5 supply. It's not looking great - the RAM producers need more of the same machines that other semi-conductor manufactures need and the suppliers of those seem unable to increase production.