Live data from Hacker News

High-Bandwidth Flash offers efficient storage for model weights

spectrum.ieee.org

21–27 of 27 posts

Re: High-Bandwidth Flash offers efficient storage for model weights

#21
post #13

Intel really missed out, when they discontinued the Optane line, right before the RAMpocalypse.

Wasn’t quite right before, but Optane was sold off, so it’s sad the buyer just sat on the IP. Also the selling point was latency, but I suspect we’ll see bandwidth being the important metric with AI using deep pipelines to stream in the weights in a latency insensitive manner.

Optane latency was low enough that it could be drop-in RAM replacement for models. Bandwidth is just "stack more of them"

Re: High-Bandwidth Flash offers efficient storage for model weights

#22
post #6

I have fond memories of Flash 5 in early 2000s. At the time I knew BASIC and Pascal. I could figure out how to draw things, how to animate them using keyframes and motion tweening, and how to make things interactive with ActionScript, all by poking around and reading the help manual (F1) on our underpowered offline PC.

Wrong Flash.

Re: High-Bandwidth Flash offers efficient storage for model weights

#23

we now only need AI companies to find a way to ruin hard disk storage and officially anything PC stops being affordable

They did. Hard disk drive prices are up, even the used and officially re-certified drive prices are way up. Hard drive makers are reporting they have sold out of their yearly production, just like the memory manufacturers.

Re: High-Bandwidth Flash offers efficient storage for model weights

#26

Intel really missed out, when they discontinued the Optane line, right before the RAMpocalypse.

It's maybe more maddening when you realize it was part of Intel getting completely out of memory, so that stings a bit. On the other hand, Intel needed focus rather than the multi-pronged MBA-driven mediocrity they'd been pursuing.

Re: High-Bandwidth Flash offers efficient storage for model weights

#27
post #13

Intel really missed out, when they discontinued the Optane line, right before the RAMpocalypse.

Wasn’t quite right before, but Optane was sold off, so it’s sad the buyer just sat on the IP. Also the selling point was latency, but I suspect we’ll see bandwidth being the important metric with AI using deep pipelines to stream in the weights in a latency insensitive manner.

Intel and Micron sold off the fab making Optane, but I haven't heard anything about them selling off the design rights, not there's much they can do without the fab that could make them.
Post reply on HN