I know the prices of RAM are high, but 256GB RAM limit seems like omission. If they supported at least 512GB in quad or eight channel that would be something worth looking at for me. I know there is Threadripper but ECC memory is out of reach.
AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
141–150 of 179 posts
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#142Earlier quoted context omitted.
The RAM prices are so high and the storage is also getting more expensive every day, so we're forced to fit everything inside the CPU cache as a solution! /s
It would be interesting if it allowed to use the cache as ram and could boot without any sticks on the motherboard.
Instead of a cache you could put down an SRAM buffer, it would be more efficient than a cache and just as fast. And addressable. Interesting idea.
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#143Earlier quoted context omitted.
I think it’s mostly that they had leftover cache.
Makes sense. RAM pricing surely has lead to a fall of AM5 high-end CPU purchases, might as well try to get some extra cash from those who still buy. Bin the remaining now non-X3D chips as something else.
Bad time to move entirely new platform. Perfect time to sell to upgrade junkies just CPU.
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#144Whenever I see a chip like this, I think "why wont my company let me use a decent computer"
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#145Crazy to think that my first personal computer's entire storage (was 160MB IIRC?) could fit into the L3 of a single consumer CPU! It's probably not possible architecturally, but it would be amusing to see an entire early 90's OS running entirely in the CPU's cache.
Maybe in 50 years the cache of CPUs and GPUs will be 1TB. Enough to run multiple LLMs (a model entirely run for each task). Having robots like in the movies would need LLMs much much faster than what we see today.
doubtful that we will still have this computer architecture by then
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#146Earlier quoted context omitted.
Yeah the only way to run 4 sticks of DDR5 decently is with Intel. It's a bit of a shame that you can't cram enough RAM to run big models. The most I could get running on 10GB VRAM + 96GB RAM was a REAP'd + quantized version of MiniMax-M2.5
Got it running with 4800MT/s and literally 30 minute boot times in an AM5 machine. The 30 minute boot time could be worked around by enabling the (off-by-default) memory context restore option in BIOS, but it really made me think something was broken and it wasn't until I found other people talking about 30 minute boot times that I stopped debugging and just let it sit for an eternity. It's so bad. I don't get why th…
You need to enable MCR (which trains the memory once and caches the result for (iirc) 30 days) otherwise yeah, booting is horribly slow, even the 64GB I have can take several minutes but with MCR it boots basically instantly.
Some motherboards have it off by default.
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#147Earlier quoted context omitted.
Got it running with 4800MT/s and literally 30 minute boot times in an AM5 machine. The 30 minute boot time could be worked around by enabling the (off-by-default) memory context restore option in BIOS, but it really made me think something was broken and it wasn't until I found other people talking about 30 minute boot times that I stopped debugging and just let it sit for an eternity. It's so bad. I don't get why th…
I’m in the same situation! My machine will take 2-5 minute to post every few reboots, it seems random. The messed up part is the marketing material says this things can handle 256gb of ram or whatever absurd number, f me for thinking then 128gb should be no problem. Honestly this whole thing has soured me on AMD. Yea they have bigger numbers than intel but at what cost, stability?
Check you have MCR (Memory Context Restore) enabled, otherwise you train the RAM way more often than you need to (every boot).
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#148Back in 2004 my PC RAM was 256. My relative's laptop had 128. That's crazy when a modern CPU cache can theoretically host an OS (or even multiple OSes) from early 2000s.
The Power4 MCM had 128 MB cache in 2001. The G4 TiBook sold the same year came with 128 MB of system RAM base, and OS X supported 64 MB configurations for a few years after this.
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#149Earlier quoted context omitted.
The RAM prices are so high and the storage is also getting more expensive every day, so we're forced to fit everything inside the CPU cache as a solution! /s
It would be interesting if it allowed to use the cache as ram and could boot without any sticks on the motherboard.
Several processors support this by effectively locking cache lines. At the low end, it allows a handful of fast interrupt routines without dedicated TCM. At the high end, it allows boot ROMs to negotiate DRAM links in software, avoiding both the catch 22 and complex hardware negotiation.
Re: AMD's Ryzen 9 9950X3D2 Dual Edition crams 208MB of cache into a single chip
#150The extra cache doesn't do a damn thing (maybe +2%) The lower leakage currents at lower voltages allowed them to implement a far more aggressive clock curve from the factory. That's where the higher allcore clock comes from (+30W TDP) I'm not complaining at all, I think this is an excellent way to leverage binning to sell leftover cache. Though if I may complain, Ars used to actually write about such things in their…
> The extra cache doesn't do a damn thing (maybe +2%) It depends on the task. For some memory-bound tasks the extra cache is very helpful. For CFD and other simulation workloads the benefits are huge. For other tasks it doesn't help at all. If someone wants a simple gaming CPU or general purpose CPU they don't need to spend the money for this. They don't need the 16-core CPU at all. The 9850X3D is a better buy for mo…
CFD benefits from cache, but it benefits even more from sustained memory bandwidth, no? A small(ish) chunk of L3 + two channels of DRAM is not going to compete with a quarter as much L3 plus eight channels of DRAM when typical working set sizes (in my experience) are in the tens of gigabytes, is it?