[deleted]
Nobody knows what a used GPU cluster is worth
11–20 of 285 posts
Re: Nobody knows what a used GPU cluster is worth
#12Maybe this article has something useful to say but the painfully LLM-generated prose is too distracting to make it evident.
Did an AI make all the text and kerning so ugly? Why do web sites look like this now?
Re: Nobody knows what a used GPU cluster is worth
#13Would it make economic sense to strip it down and sell for parts? That’s how it’s done now for older data centers, where the obsolete equipment is sent off to China, stripped down for parts, and sold on the secondary market. I’ve picked up several older but still useful RAID hardware cards off eBay this way.
I’m mainly interested in getting some DDR4/5 and RTX5090s on the cheap :).
Re: Nobody knows what a used GPU cluster is worth
#14I half expect Nvidia to have buyback contacts like Ferrari with the larger customers to prevent a price crash when they all upgrade and to keep them scarce. I hope not though, perhaps I can pick up a H100 in a few years if they get sold on the open market.
Wouldn't that be crazy - a hobbyist market for H100s? Maybe someone could start a business buying up and rehousing these.
They're pretty specific to the datacenter use case with no outputs and they need to be cooled externally, principally through the very loud high speed fans used in data centers. I suppose you could strap a fan to one and put it in a normal case or maybe make a dedicated after market cooler (like the water blocks made for water cooling cases).
Re: Nobody knows what a used GPU cluster is worth
#15I like Meg a lot a human, but Meg is all doom and gloom. Every single post she makes is about how GPUs fail [0] and now she's onto how financing is a big thing just waiting to crash and "nobody knows what a used GPU cluster is worth"...
Actually, we do, people offer them to me all the time. A used box of MI300x is $257k. "There is no GPU futures market"... actually there are a few of them that people have pitched to me.
This article is a lot of words from someone who isn't actually buying or deploying compute. My point is... take it all with a grain of salt.
Re: Nobody knows what a used GPU cluster is worth
#16so you're telling me you can't use 1 or 2% percent of 5 billions dollars to rebuild a team that runs GPU clusters for like a couple of years ?! and the guy that borrowed billions from these banks would want to mess up that relationship for what? I mean he is a stupid narcissist but not to that degree. This whole article makes no sense to me.
Re: Nobody knows what a used GPU cluster is worth
#17I half expect Nvidia to have buyback contacts like Ferrari with the larger customers to prevent a price crash when they all upgrade and to keep them scarce. I hope not though, perhaps I can pick up a H100 in a few years if they get sold on the open market.
Wouldn't that be crazy - a hobbyist market for H100s? Maybe someone could start a business buying up and rehousing these.
The GPU alone has a TDP of 700W, together with everything else (CPU, RAM, storage, fans) you're looking at 1500W+. Depending on the country, that may be enough to saturate your home's electricity uplink...
Re: Nobody knows what a used GPU cluster is worth
#18If nobody knows what a used GPU cluster is worth it means nobody is doing anything important with GPUs - time to short everything. Do you believe it?
Re: Nobody knows what a used GPU cluster is worth
#19Earlier quoted context omitted.
Wouldn't that be crazy - a hobbyist market for H100s? Maybe someone could start a business buying up and rehousing these.
The GPU alone has a TDP of 700W, together with everything else (CPU, RAM, storage, fans) you're looking at 1500W+. Depending on the country, that may be enough to saturate your home's electricity uplink...
Hell no. 1.5kw is half a socket capacity. A heat pump or many kitchen appliances are using much more. Our car charger uses more as well.
Re: Nobody knows what a used GPU cluster is worth
#20Nothing, because those "GPU's" are special proprietary hardware and are not what most people are capable of plugging in into anything.