31–40 of 415 posts
I looked at my eBay receipt from 2023 and I paid $84.98 for a "Kingston FURY Beast 64GB (2x32GB) 3200MHz DDR4" listing and now the equivalent on eBay "Buy It Now" is $374.99 for "Kingston FURY Renegade 64GB (2x32GB) DDR4 RAM 3200MHz (KF432C16RBK2/64)". What a timeline it has become for consumer computing three years later!
"back in my time", a dialup and 32 megs(!) of ram was enough for most stuff, including internet browsing. I have no idea why a weather forecast site needs tens of megabytes of resources, and gig+ of ram for my browser, since i get no more info from it, than i did back then. Same for chat programs (how is discord different than irc? and why does it need so much ram to do so? same for slack), mail clients, etc. Maybe i…
Usually these bottlenecks lead to a price crash later. Of course that’s also part of what fuels the bottleneck. Companies are afraid of over investing in production and being left with underwater capital later.
Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling, what's the most important factor to even running good enough models? RAM since you want the models in memory to not be total slogs.
Price should send a signal to manufacturers to build more capacity. I wonder if they will though, it takes quite a bit of time, and it's not certain that the demand will continue to exist once built.
A fab for high end memory costs $20B and 5 years to build. It will happen, but yeah it takes time and money
My bet is that the prices will crash once OpenAI (and/or Antrophic) IPO's have happened. Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling, what's the most important factor to even running good enough models? RAM since you want the models in memory to not be total slogs.
Price should send a signal to manufacturers to build more capacity. I wonder if they will though, it takes quite a bit of time, and it's not certain that the demand will continue to exist once built.