Is this the same thing as this talk? https://www.youtube.com/watch?v=hXurTRtmfWc
Yes.
Intel's roadmap for Optane SSDs with 1,000x performance
51–60 of 108 posts
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#52To be perfectly clear: the 1000x claim isn't about throughput , but latency . The graph in the article makes this clear: spinning drives have latencies on the order of 10ms, NAND flash about 10us, and DRAM about 1ns. The claim is that Optane will achieve latencies on the order of 10ns, or 1000x better than NAND. The on-stage benchmark shows a write throughput of about 2GB/s, which is a much more modest improvement ov…
Consumer OS I/O software stacks are completely unable to deal with this. It was fine for spinning drive latency, it's okay(ish) for high-performance SSD but the open/read/write model just cannot work that fast. It's several orders of magnitude off. Assuming we keep the file system model, I'm guessing some kind of direct memory mapping is in order? Anyone knows what's ahead of us on the software side, to take advantag…
What's wrong with plain old mmap ?
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#53This will change deeply how we make desktop applications, as well as database management systems.
Not so much for "traditional" desktop apps. This sort of performance isn't going to do anything for your spreadsheets or word docs. It might pave the way for some really interesting video games though!
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#54Earlier quoted context omitted.
Consumer OS I/O software stacks are completely unable to deal with this. It was fine for spinning drive latency, it's okay(ish) for high-performance SSD but the open/read/write model just cannot work that fast. It's several orders of magnitude off. Assuming we keep the file system model, I'm guessing some kind of direct memory mapping is in order? Anyone knows what's ahead of us on the software side, to take advantag…
What's wrong with plain old mmap ?
mmap() tricks you into thinking you can directly access the disk. What really happens when you access the mapped data is that the CPU generates a page fault, the OS takes control, copies the data from disk to physical memory and maps the page in your address space. So essentially it is a convient way to do read().
The mmap() model is good. The current page fault mechanism, not so much.
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#55Earlier quoted context omitted.
I'm curious, why do you say that the open/read/write model can't work? I suppose that current software should be optimized to take advantage of better performance, but I don't see why it is obsolete.
10ns latency means that a file entry/inode/block is available just 10-30 CPU cycles after it is requested. Suddenly the 1000 CPU cycles spent dispatching the system call look very inefficient by comparison. Obsolete might not be the right term, but there is essentially no way that open/read/write can take proper advantage of this kind of low latency storage. We are going to need a new way to abstract and interface wi…
Read/write are certainly a bit slow, but this may well be acceptable for most applications. High performance apps can use mmap, which can be extended to directly map the nonvolatile memory in question.
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#56Earlier quoted context omitted.
Consumer OS I/O software stacks are completely unable to deal with this. It was fine for spinning drive latency, it's okay(ish) for high-performance SSD but the open/read/write model just cannot work that fast. It's several orders of magnitude off. Assuming we keep the file system model, I'm guessing some kind of direct memory mapping is in order? Anyone knows what's ahead of us on the software side, to take advantag…
What's wrong with plain old mmap ?
It costs a fortune to map a file on every OS I've tried, it makes little sense unless you're consuming a lot of data from few files rather than little data from many files
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#57Earlier quoted context omitted.
What's wrong with plain old mmap ?
mmap() tricks you into thinking you can directly access the disk. What really happens when you access the mapped data is that the CPU generates a page fault, the OS takes control, copies the data from disk to physical memory and maps the page in your address space. So essentially it is a convient way to do read(). The mmap() model is good. The current page fault mechanism, not so much.
The difference is that you only take the page fault once per page (or less than once if you do some prefetching in the kernel), while you have to do a system call for every read().
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#58To be perfectly clear: the 1000x claim isn't about throughput , but latency . The graph in the article makes this clear: spinning drives have latencies on the order of 10ms, NAND flash about 10us, and DRAM about 1ns. The claim is that Optane will achieve latencies on the order of 10ns, or 1000x better than NAND. The on-stage benchmark shows a write throughput of about 2GB/s, which is a much more modest improvement ov…
Consumer OS I/O software stacks are completely unable to deal with this. It was fine for spinning drive latency, it's okay(ish) for high-performance SSD but the open/read/write model just cannot work that fast. It's several orders of magnitude off. Assuming we keep the file system model, I'm guessing some kind of direct memory mapping is in order? Anyone knows what's ahead of us on the software side, to take advantag…
>Consumer OS I/O software stacks are completely unable to deal with this. It was fine for spinning drive latency, it's okay(ish) for high-performance SSD but the open/read/write model just cannot work that fast. It's several orders of magnitude off.
Citation needed.
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#59Ah, interesting, it seemed as if it wasn't going to be competing with current ssd's in terms of capacity, but the last part of the article mentions 10x the capacity of nand and so over a terabyte on an M.2 drive. Assuming price might be quite high, it seems like it'll be a full upgrade over nand ssd's.
Re: Intel's roadmap for Optane SSDs with 1,000x performance
#60This will change deeply how we make desktop applications, as well as database management systems.
Not so much for "traditional" desktop apps. This sort of performance isn't going to do anything for your spreadsheets or word docs. It might pave the way for some really interesting video games though!
maybe not as much from a consumer standpoint, but the types of software architectures it will enable could be a big deal