Memory is slow, Disk is fast – Part 1
bitflux.ai
Memory is slow, Disk is fast – Part 1
1–10 of 49 posts
Re: Memory is slow, Disk is fast – Part 1
#2"Which is funny because that describes AI and you’d be doing this kind of work on a GPU which leans entirely into these advantages and not a CPU anyway"
Damn thats harder to parse than it needed to be.
Re: Memory is slow, Disk is fast – Part 1
#3"Which is funny because that describes AI and you’d be doing this kind of work on a GPU which leans entirely into these advantages and not a CPU anyway" Damn thats harder to parse than it needed to be.
"Who cares? Produc"
This one is even more hard to parse :)
Re: Memory is slow, Disk is fast – Part 1
#4"Which is funny because that describes AI and you’d be doing this kind of work on a GPU which leans entirely into these advantages and not a CPU anyway" Damn thats harder to parse than it needed to be.
"Who cares? Produc" This one is even more hard to parse :)
That was the typo that made me bail on reading this article.
Re: Memory is slow, Disk is fast – Part 1
#5> clocks, IPC, and latency flatlined
IPC has definitely not flatlined. Zen 4 can do something like 50-70% more IPC than a CPU from 10-15 years ago. Zen 5 is capable of ~16% more IPC than Zen 4.
Re: Memory is slow, Disk is fast – Part 1
#6There's some sleight of hand being perpetrated here through the use of an inappropriate scale to trick the reader into thinking that NVMe latency is roughly zero when it's not. Let's just stipulate that you have an unreleased, hypothetical NVMe device with consistent 10µs read latency. The same device will have a write latency 10-100x higher, which it hides, under transient conditions, with DRAM. It's a very poor mental model to assume that "I/O" latency has gone to zero. It only looks that way if you're polluting your chart with disk access times from 1980, and it assumes a false symmetry between "I" and "O".
Re: Memory is slow, Disk is fast – Part 1
#7> clocks, IPC, and latency flatlined IPC has definitely not flatlined. Zen 4 can do something like 50-70% more IPC than a CPU from 10-15 years ago. Zen 5 is capable of ~16% more IPC than Zen 4.
It's all good. The author spot-checked ChatGPT. Many or possibly even most facts in the article might be true.
Re: Memory is slow, Disk is fast – Part 1
#8"Which is funny because that describes AI and you’d be doing this kind of work on a GPU which leans entirely into these advantages and not a CPU anyway" Damn thats harder to parse than it needed to be.
who downvoted me for that?
Re: Memory is slow, Disk is fast – Part 1
#9Maybe part 2 will be useful, but part 1 absolutely does not answer the question in the headline.
Re: Memory is slow, Disk is fast – Part 1
#10The data does not support the premise much less the grandiose conclusions at the end of the article. By pure construction memory is always going to be faster than disk, right up to the point where disk is inplemented as memory which makes this a pointless semantic discussion. Such a fact would hardly invalidate the core pillars as computer science as the conclusions imply. Waste of time.