241–250 of 285 posts
Earlier quoted context omitted.
Would you call a trade-in a fraudulent tactic?
Trade ins are fine. A contractual commitment to not buy hardware sounds like illegal restraint of trade.
I don’t understand the desire to tell totally anonymous third parties the terms under which they are allowed to deal with each other.
Earlier quoted context omitted.
There's going to be a golden age of GPGPU compute in the next few years once A100/H100 are fully obsolete for running frontier models efficiently and the price plummets It will be perfect for stuff like GPU-accelerated query engines, "classical ML" and every other CPU-based workload that could conceivably be offloaded to GPU
There's nothing stopping you doing this now. You can get used 16GB P100s on AliExpress for ~$100 if you want obsolete GPUs. Allegedly new AMD BC 250s are only slightly more. I've looked at this some but I already have a GTX1070 which is only supported upto CUDA 11.9. That's precludes some interesting modern optimizations out of the box. I've spend a lot of LLM tokens backporting some things, but I'm really not sure t…
This is assuming that there is no big, big disruption to the semiconductor industry (e.g. TSMC getting attacked), in which case... well, I am gonna treat each stick of RAM I currently have like it's a faberge egg.
Someone should stand up a vulture fund to buy these data centres off companies when they go bust.
Earlier quoted context omitted.
Where is this exponential thing coming from? Why would hardware failure raise exponential with linear scale? Doesn't make sense
> Where is this exponential thing coming from? That's what you get from a constant failure rate per unit of time. It's saying that hardware fails in the same way that Carbon-14 dating works.
Most if not all hardware failure on my side is def not memoryless besides the one lightning damage thingy but thats not hardwares fault.
I half expect Nvidia to have buyback contacts like Ferrari with the larger customers to prevent a price crash when they all upgrade and to keep them scarce. I hope not though, perhaps I can pick up a H100 in a few years if they get sold on the open market.
That should be illegal. Sounds like a very fraudulent business tactic.
a) It's not fraudulent, and
b) Nvidia has already signed on to buyback any unused capacity from the DCs it is selling to.
Earlier quoted context omitted.
There's going to be a golden age of GPGPU compute in the next few years once A100/H100 are fully obsolete for running frontier models efficiently and the price plummets It will be perfect for stuff like GPU-accelerated query engines, "classical ML" and every other CPU-based workload that could conceivably be offloaded to GPU
There's nothing stopping you doing this now. You can get used 16GB P100s on AliExpress for ~$100 if you want obsolete GPUs. Allegedly new AMD BC 250s are only slightly more. I've looked at this some but I already have a GTX1070 which is only supported upto CUDA 11.9. That's precludes some interesting modern optimizations out of the box. I've spend a lot of LLM tokens backporting some things, but I'm really not sure t…
In a recent Gamer Nexus video with Level 1 Tech, they mention V100s are also quite useful for many applications that use FP64: stuff four in a workstation, and many PhD candidates would be quite happy with the throughput they can get for certain scenarios.
Earlier quoted context omitted.
Wouldn't that be crazy - a hobbyist market for H100s? Maybe someone could start a business buying up and rehousing these.
The GPU alone has a TDP of 700W, together with everything else (CPU, RAM, storage, fans) you're looking at 1500W+. Depending on the country, that may be enough to saturate your home's electricity uplink...
1500W is the power of the typical American microwave or (tea) kettle at 120V. (Convert over to a NEMA 6 plug and dual-pole breaker and you can get 3000W.)
3000W is nothing special in the rest of the world with >200V wall plugs.
Earlier quoted context omitted.
Wouldn't that be crazy - a hobbyist market for H100s? Maybe someone could start a business buying up and rehousing these.
They're pretty specific to the datacenter use case with no outputs and they need to be cooled externally, principally through the very loud high speed fans used in data centers. I suppose you could strap a fan to one and put it in a normal case or maybe make a dedicated after market cooler (like the water blocks made for water cooling cases).
You don't need much of a fan if you are prepared to pump a lot of water.
I mean, sure, if you're trying to cool the thing with 100ml of water, then yeah, you need a fan.
OTOH I have an unused car radiator in my garage, a quiet and cheap pump, and space to hang that radiator outside the window. It's barely an afternoon's worth of work if the H100s already have liquid-cooling intakes/exhausts on them already (I dunno, I have never seen one in the flesh).
I'm pretty certain 10+ litres of constantly circulating water (antifreeze, in my case) through a car radiator would be sufficient to cool down 2x H100s. Hell, add in 10 RPM used car cooling fan and I can probably cool 20x of those running at full-bore.
If anyone wants to ship me a bunch of H100s, I'll happily build it all out, take pics and videos and post it back here. Just sayin' :-)
Earlier quoted context omitted.
The process node size in William the Conqueror's time was really off the charts.
Plotting that backwards shows a transistor would be the size of a continent, at least.
Means that the computer would be the size of earth... maybe the mice really were onto something :-)