[dead]
32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
101–110 of 415 posts
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#102My bet is that the prices will crash once OpenAI (and/or Antrophic) IPO's have happened. Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling, what's the most important factor to even running good enough models? RAM since you want the models in memory to not be total slogs.
If local models are good enough, doesn't that increase demand for DRAM as everyone buys
DRAM for their poorly utilized local machines?
Surely it is a more efficient use of DRAM to run inference on shared hardware with large batch sizes and more utilization.
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#103Earlier quoted context omitted.
So far haven't we seen the opposite? Consumer focused ram production shutting down to make more volume for server dimms or etc?
The bottleneck isn't the sticks, it's the chips. The chips are the same for consumer and server applications. What's been happening is that big companies have bought nearly all the wafer capacity for the next year or so, and perhaps some of that capacity has also been redirected from DDR5 to LPDDR5. If a stick manufacturer drops out of the consumer market that kinda doesn't matter, because manufacturing sticks is rel…
The fabs are the same and are the actual bottleneck. The chips are different for CPUs and GPUs.
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#104Earlier quoted context omitted.
> People want this, the demand is there. It's impossible to avoid using AI multiple times a day, just because it's forced into every product under the sun. That is NOT demand. None of those users WANT this.
You're wrong. There is demand. More and more people are exploring AI and getting real work done with it.
Like using it finally be able to do warcrimes without any human pulling the trigger, along the lines of https://en.wikipedia.org/wiki/AI-assisted_targeting_in_the_G...
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#105Earlier quoted context omitted.
I was picking up DDR3 16GB sticks for $5/piece on eBay last year. The world has gone mad.
To be fair, DDR3 is still kinda cheap. It's really only DDR4 and DDR5 that are massively in demand. DDR3 is a bit too old for it to be in high demand by consumers.
I wanted to buy another one and they are like $90 now :(
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#106Price should send a signal to manufacturers to build more capacity. I wonder if they will though, it takes quite a bit of time, and it's not certain that the demand will continue to exist once built.
We are down to 3 manufacturers thanks to RAM boom and bust cycles. The remaining ones are the one that know how not to over invest.
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#107Earlier quoted context omitted.
And? The primary goal should be to catch and stop pollution, not make manufacturers spend years promising not to do something they're not allowed to do. If someone wants to build a factory that can't operate without illegal emissions, then so be it. It's their money lost. All that matters is that they don't actually pollute. Using red tape as some kind of prophylactic is ridiculous. If the state doesn't have the moni…
> If someone wants to build a factory that can't operate without illegal emissions, then so be it. It's their money lost. All that matters is that they don't actually pollute. That's hopelessly naïve. If you let them build the facility that can pollute, they're going to pollute . And if you point to the pollution coming out and tell them "you have to stop," they're going to say "make us." And if you point to the poll…
First of all I disagree that it's difficult to get injunctions to stop an activity that was illegal from the start. In fact, sometimes environmental reviews can backfire because they typically require affirmation by the government, which can create a defense to doing something that would otherwise be judged illegal. That type of loophole is why people are so cynical.
But even so, how does the song & dance prevent any of that? It's not like, e.g., a battery manufacturer submits a plan admitting that they're gonna dump stuff.
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#108Earlier quoted context omitted.
Buddy they ain't building an ice-cream parlor. 200 miles of the Hudson river is a Superfund site. The biggest polluters, PCB's, lead and mercury.
And? The primary goal should be to catch and stop pollution, not make manufacturers spend years promising not to do something they're not allowed to do. If someone wants to build a factory that can't operate without illegal emissions, then so be it. It's their money lost. All that matters is that they don't actually pollute. Using red tape as some kind of prophylactic is ridiculous. If the state doesn't have the moni…
The process is there because Industry has proven that it can't be trusted.
The only way to stop it is to verify that it won't happen in the first place by making sure their building plans are up to par. The song-and-dance, well even with the review, they try their damn hardest to cut corners and hood-wig wherever they can.
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#109Earlier quoted context omitted.
We can be cynics of AI without ignoring reality, if no one wanted this no one would be chatting with Claude or ChatGPT directly, but people obviously are. The fact is there are people that do in fact want this, and it isn't just CEO's hoping to cut jobs.
It's very, very questionable if people want the situation we have. I have yet to meet anyone in person who is really excited about AI. Of course it's useful, but at this cost? Claiming people want this is like claiming that people wanted WW2 because look we're all enjoying the tech that was developed during it!
I unfortunately have met a few. I have one friend that legit scares me... we saw how people reacted to o4 being discontinued.
Though I do agree that most people probably don't want as much AI as is being shoved on us right now, there is a subset that do want at least some of it.
More my point, yeah I think there is an issue of the actual demand being extremely over estimated due to shady practices (like of course Gemini gets a lot of use when every single google search calls it whether you want it or not). But we also should not be so quick to disregard there being real demand just to hope for the outcome we want.
Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building
#110My bet is that the prices will crash once OpenAI (and/or Antrophic) IPO's have happened. Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling, what's the most important factor to even running good enough models? RAM since you want the models in memory to not be total slogs.
> that local models are good enough for whatever they're peddling they are not. Unless you are satisfied with plausible, but mostly garbage output.
I get results comparable to the saas. Maybe Anthropic sold you too much crack tokens.