What if the RAM/GPU shortage is deliberate?
xn--vk5b17r.online
What if the RAM/GPU shortage is deliberate?
1–10 of 25 posts
Re: What if the RAM/GPU shortage is deliberate?
#2Some personal thoughts on the current ram/GPU shortage -price hikes.
Re: What if the RAM/GPU shortage is deliberate?
#3So you're arguing that ai companies overbought memory to increase scarcity? Possibly even buying e.g. consumer ddr?
Re: What if the RAM/GPU shortage is deliberate?
#4So you're arguing that ai companies overbought memory to increase scarcity? Possibly even buying e.g. consumer ddr?
just a theory! The end result was too make it difficult for me and you to run llms on our systems, and you need porwerfull system to run them. But some months ago, those powerfull systems where affordable for end consumers. Now, good luck buying let's say 128gb ddr5.
Re: What if the RAM/GPU shortage is deliberate?
#5From the opposite angle, there's apparently evidence that the RAM companies themselves are price fixing: https://www.tomshardware.com/tech-industry/samsung-sk-hynix-...
Re: What if the RAM/GPU shortage is deliberate?
#6From the opposite angle, there's apparently evidence that the RAM companies themselves are price fixing: https://www.tomshardware.com/tech-industry/samsung-sk-hynix-...
The existence of a lawsuit is not evidence.
Re: What if the RAM/GPU shortage is deliberate?
#7So you're arguing that ai companies overbought memory to increase scarcity? Possibly even buying e.g. consumer ddr?
just a theory! The end result was too make it difficult for me and you to run llms on our systems, and you need porwerfull system to run them. But some months ago, those powerfull systems where affordable for end consumers. Now, good luck buying let's say 128gb ddr5.
Do you believe this is more likely than corporations trying to restrict the supply for their corporate competitors? My thinking would be that we're just caught in the crossfire. The percentage of people seriously running their own models locally would hardly be any less diminishing if hardware prices were at their previous levels.
Re: What if the RAM/GPU shortage is deliberate?
#8[flagged]
Re: What if the RAM/GPU shortage is deliberate?
#9Earlier quoted context omitted.
just a theory! The end result was too make it difficult for me and you to run llms on our systems, and you need porwerfull system to run them. But some months ago, those powerfull systems where affordable for end consumers. Now, good luck buying let's say 128gb ddr5.
Do you believe this is more likely than corporations trying to restrict the supply for their corporate competitors? My thinking would be that we're just caught in the crossfire. The percentage of people seriously running their own models locally would hardly be any less diminishing if hardware prices were at their previous levels.
absolutely!
Re: What if the RAM/GPU shortage is deliberate?
#10You are aware that a 1 trillion parameter model won’t run on any quantity of consumer hardware, even heavily quantized… you need a data center for that. And that is not even to talk of the Kimi K3 model which is in the ballpark of 3 trillion