Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building

tomshardware.com

Post reply on HN
Print view View original

61–70 of 415 posts

Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building

#61

Post by sixothree »

Hamuko wrote: post #50
whizzter wrote: post #35

My bet is that the prices will crash once OpenAI (and/or Antrophic) IPO's have happened. Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling, what's the most important factor to even running good enough models? RAM since you want the models in memory to not be total slogs.

My bet is that we're not gonna see any adjustments in RAM pricing until one of the planned data center projects collapses in a spectacular way.

And honestly, we will have much bigger problems if that bubble pops in a spectacular fashion.

Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building

#64

Post by lionkor »

WarmWash wrote: post #42
z2 wrote: post #23

Earlier quoted context omitted.

This is textbook negative externalities, of the AI buildout on everyone who isn't using RAM/GPUs for AI, of the use of electricity and water on anyone who isn't using it for AI. The cynic in me thinks this will go down in history alongside asbestos, leaded gasoline/paint, and the opioid crisis.

People want this, the demand is there. Like clockwork, people naturally want to have their cake and to eat it too, so there will be the incessant complaining about the externalities. Half the people lack the brainpower to see the good and bad are intrinsically linked, and the other half just like complaining. But at least for now, both halves aren't pulling back (in fact it's increasing), and money, not complaining,…

> People want this, the demand is there.

It's impossible to avoid using AI multiple times a day, just because it's forced into every product under the sun.

That is NOT demand. None of those users WANT this.

Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building

#65

Post by rvnx »

Hamuko wrote: post #50
whizzter wrote: post #35

My bet is that the prices will crash once OpenAI (and/or Antrophic) IPO's have happened. Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling, what's the most important factor to even running good enough models? RAM since you want the models in memory to not be total slogs.

My bet is that we're not gonna see any adjustments in RAM pricing until one of the planned data center projects collapses in a spectacular way.

One theory: they will need to throw away all these Nvidia cards in the trash at some point right ?

Because what to do with power-consuming outdated hardware ? let's say 5 years from now ?

They will need new RAM.

I wonder.

Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building

#67

Post by fluoridation »

varispeed wrote: post #43
whizzter wrote: post #35

My bet is that the prices will crash once OpenAI (and/or Antrophic) IPO's have happened. Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling, what's the most important factor to even running good enough models? RAM since you want the models in memory to not be total slogs.

> that local models are good enough for whatever they're peddling they are not. Unless you are satisfied with plausible, but mostly garbage output.

Honestly, that's the output I get from non-local models, anyway. If I'm going to get plausible nonsense either way, I may as well run it on my own hardware.

Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building

#68

Post by giantrobot »

Hamuko wrote: post #52
qingcharles wrote: post #31

Earlier quoted context omitted.

I was picking up DDR3 16GB sticks for $5/piece on eBay last year. The world has gone mad.

To be fair, DDR3 is still kinda cheap. It's really only DDR4 and DDR5 that are massively in demand. DDR3 is a bit too old for it to be in high demand by consumers.

While DDR3 is cheaper it's still tripled or quadrupled in price over the past two years. I just bought a pair or sticks for an old Mac Pro and it was 4x what i paid just a few years ago.

Re: 32GB of DDR5 now costs $375 – AI shortage continues to squeeze PC building

#70

Post by sixothree »

api wrote: post #34

This is insane. Didn’t know how bad it got. I bought a mini PC a few years ago with 64 gigs in it for a home VM server for like $600 total. Looks like I’m keeping it a while. Usually these bottlenecks lead to a price crash later. Of course that’s also part of what fuels the bottleneck. Companies are afraid of over investing in production and being left with underwater capital later.

[dead]
Post reply on HN