281–290 of 423 posts
Earlier quoted context omitted.
I honestly can't wait to use used gpus as lego bricks similar to what kids in Weimar republic did with cash
Never gonna happen. Cash has no intrinsic value exccept maybe for use in fire / toiler paper. GPUs while currently inflated in price will always find enough value. Their price might go down 50-75% but never 99%
Earlier quoted context omitted.
You actually get more, for the 1500€ you don't have to mess with sticks yourself. They solder it directly on your mainboard. If that isn't great service, I don't know what is.
I don’t know why you are getting downvoted. The sarcasm in the comment is pretty obvious.
Earlier quoted context omitted.
shorter traces than soldered DIMM allow higher MT/s, this is fixed by CUDIMM/CAMM2, the other part of this is # of memory channels on the board, not sure why, but most consumer DDR5 boards have been 2 memory channels, you need to go to threadripper to get 4 or 8, It's unclear to me if this will still be an issue with future platforms.
You're not paying enough attention to the performance and cost impact of connectors and sockets. CAMM2/LPCAMM and CUDIMM have yet to be demonstrated operating at speeds that speeds that match the fastest soldered LPDDR, let alone GDDR; there's still a clear advantage for soldering memory. CPU sockets with more than two memory channels are also far more expensive; the higher pin count usually increases the number of l…
by trading them with longevity challenges.
Even though 2 decades have past after the "usual suspect" lead-free solder, gpu or vram chips needing a reball is still a common occurrence from a cursory look at YouTube channels of professional electronics repairmen.
Earlier quoted context omitted.
Now thinking of this from the other side, 2 big DRAM producers are taking the risk to dedicate a very big part of their production to AI and if we assume they also have similar deals with other AI companies or big datacenters, what is their risk profile if the AI bubble bursts? Are they viable as companies then ? What is their plan B ?
Their risks are none. They are not increasing capacity, only selling the available one to the highest bidder. Whenever these AI companies run out of money, these producers can simply resume their regular business.
Earlier quoted context omitted.
Their risks are none. They are not increasing capacity, only selling the available one to the highest bidder. Whenever these AI companies run out of money, these producers can simply resume their regular business.
Not sure about DRAM companies, but many businesses would still go under if they sold their annual production to a company that then goes bankrupt and won't pay anything for the delivered goods.
Funny how many dot-com esq things are popping up. https://en.wikipedia.org/wiki/DRAM_price_fixing_scandal
The big news story this cycle is that OpenAI secured two large contracts with two separate DRAM companies at the same time, carefully timing the deals so that neither DRAM company knew about the deal with other. Had either company known about the true demand from OpenAI they would have charged a lot more, but each only saw about half. In other words, there was no collusion between the DRAM manufacturers. They were bo…
To put this in long term relation. Even current DDR4 3200 DIMM prices are at an all time high. These are 6+ year old chip specs now! I even thought stuff was overpriced four years ago in mid-2021 already, but this is a whole new level. Some sample long term data for those: https://geizhals.eu/?phist=2151624&age=9999
anyone want to buy a 2x16 GB DDR4-3200 kit that only fails memtest86 some of the time?
Earlier quoted context omitted.
I honestly can't wait to use used gpus as lego bricks similar to what kids in Weimar republic did with cash
The most likely outcome is kids in third world countries extracting the valuable metals from piles of discarded GPUs.
https://www.mooreslawisdead.com/post/sam-altman-s-dirty-dram... On October 1st OpenAI signed two simultaneous deals with Samsung and SK Hynix for 40% of the worlds DRAM supply... the shock wasn’t that OpenAI made a big deal, no, it was that they made two massive deals this big, at the same time, with Samsung and SK Hynix simultaneously! In fact, according to our sources - both companies had no idea how big each other…
Novice question: If they built something other than classic dram modules with the wafers maybe they could achieve faster bus speeds? How does Apple do it?
Apple uses off the shelf LPDDR modules. They have nothing whatsoever special about them.
Apple gets high bandwidth out of these modules not with high bus speeds, but with a very, very wide bus. This is expensive on the SoC side (requires a large die, which is why others don't necessarily do this), but allows for commodity memory modules.