Live data from Hacker News

The RAM shortage comes for us all

jeffgeerling.com

51–60 of 416 posts

Re: The RAM shortage comes for us all

#52
Pricing compute out of the average persons budget to prop up investment in data centers, stocks, ultimately control agency

If an RTX 5000 series price topped out at historical prices no one would need hosted AI

Then it came to be that models were on a path to run well enough loaded into RAM... uh oh

This is in line with ISPs long ago banning running personal services and the long held desire to sell dumb thin clients that must work with a central service

Web developers fell for confidence games of old elders hook line and sinker. Nothing but the insane ego and vanity of some tech oligarchs driving this. They cannot appear weak. Vain aura farming, projection of strength.

Re: The RAM shortage comes for us all

#54

I just gathered enough money to build my new PC. I'll even go to another country to pay less taxes, and this spike hit me hard. I'll buy anyway because I don't believe it will slow down so soon. But yeah, for me is a lot of money

Me too. I had saved up to make a small server. I guess I'll have to wait up until 2027–2028 at this rate.

Re: The RAM shortage comes for us all

#56

32GB should be more than enough. You can go 16GB if you go native and throw some assembly in the mix. Use old school scripting languages. Debloat browsers. It has been long delayed.

Hey, hey 16k What does that get you today?

https://m.youtube.com/watch?v=IagZIM9MtLo

Re: The RAM shortage comes for us all

#57

This is ultimately the first stage of human economic obsolescence and extinction. This https://cdna.pcpartpicker.com/static/forever/images/trends/2... will happen to every class of thing (once it hits energy, everything is downstream of energy).

I'm no economist, but if (when?) the AI bubble bursts and demand collapses at the price point memory and other related components are at, wouldn't price recover?

not trying to argue, just curious.

Re: The RAM shortage comes for us all

#58
post #18

Anyone want to start a fab with me? We can buy an ASML machine and figure out the rest as we go. Toronto area btw

As someone with no skills in the space, no money, and lives near Ottawa: I'd love to help start a fab in Ontario.

Right on, partner. I think there's a ton of demand for it tbh

I'll do the engineering so we're good on that front. Just need investors.

Re: The RAM shortage comes for us all

#59
post #13

I think the OpenAI deal to lock wafers was a wonderful coup. OpenAI is more and more losing ground against the regularity[0] of the improvements coming from Anthropic, Google and even the open weights models. By creating a chock point at the hardware level, OpenAI can prevent the competition from increasing their reach because of the lack of hardware. [0]: For me this is really an important part of working with Claud…

Could this generate pressure to produce less memory hungry models?

Re: The RAM shortage comes for us all

#60
post #13

I think the OpenAI deal to lock wafers was a wonderful coup. OpenAI is more and more losing ground against the regularity[0] of the improvements coming from Anthropic, Google and even the open weights models. By creating a chock point at the hardware level, OpenAI can prevent the competition from increasing their reach because of the lack of hardware. [0]: For me this is really an important part of working with Claud…

I don't see this working for Google though, since they make their own custom hardware in the form of the TPUs. Unless those designs include components that are also susceptible?
Post reply on HN