Memory has grown to nearly two-thirds of AI chip component costs
1–10 of 524 posts
Re: Memory has grown to nearly two-thirds of AI chip component costs
#2I bought 96GB of RAM a couple of years ago for ~$250.
That same RAM now costs $1200!
Re: Memory has grown to nearly two-thirds of AI chip component costs
#3The algorithm advances are going to crash this so hard.
Re: Memory has grown to nearly two-thirds of AI chip component costs
#4The algorithm advances are going to crash this so hard.
I mean, god willing, but it'll be just as likely that we'll blissfully consume 100 million token contexts in that case.
Re: Memory has grown to nearly two-thirds of AI chip component costs
#5Re: Memory has grown to nearly two-thirds of AI chip component costs
#6Awful time for gamers and PC hobbyists not fully into AI.
Re: Memory has grown to nearly two-thirds of AI chip component costs
#7Here’s the thing, what if memory manufacturers take this opportunity to collude and basically never reduce the price of memory below the current levels since it’s too hard for a new competitor to just rise up and undercut them? Everything I hear about is how hard and risky it is to spin up a new fab.
And by doing this, they ensure local LLMs never become feasible for the vast majority of people and AI companies solidify subscriptions forever.
Re: Memory has grown to nearly two-thirds of AI chip component costs
#8Bought a second hand Dell server a week ago. The entire rig with a 12-core CPU and 32GB DDR4 ecc RAM cost as much as I'd pay to buy 64 GB of DDR RAM alone. I hope there's an end to this absurdity soon enough otherwise the pain will affect other markets too. I read the other day that PC case sales have collapsed by more than 40%.
Re: Memory has grown to nearly two-thirds of AI chip component costs
#9Earlier quoted context omitted.
I mean, god willing, but it'll be just as likely that we'll blissfully consume 100 million token contexts in that case.
isn't there a law for that? as things become cheaper you consume more?
Jevons paradox.