41–50 of 199 posts
i've ran some multi vendor frankenstein setups before and sometimes it even works, so i'm curious to hear your experience with it.
The AMD MI250X GPUs are also interesting - 128GB of HBM2E at 3TB/s, sometimes you see them second-hand for under $1k, the catch obviously is that it needs an OAM socket. Never seen an easy way to hook them up to a regular mainboard.
Also, the cheap HPE pulls on eBay need some proprietary HPE magic to work, and I have yet to see anyone figure that out.
Could probably avoid the crazy fan with a waterblock - I've seen a whole kit, v100 + PCIE adapter + block for £235. Yes, you'll have to pay for pump, radiators and radiator fans, but that should really quieten it down
Some resell group is going to have to make this easier. The shear amount of these cards otherwise heading towards the landfill is staggering. That is if Big Tech don't destroy them to prevent model weights from leaking.
How would destroying the GPUs prevent the model weights from leaking? By the time you get your hands on them the memory is powered off for a long enough time that a cold-boot style attack is impossible.
Some resell group is going to have to make this easier. The shear amount of these cards otherwise heading towards the landfill is staggering. That is if Big Tech don't destroy them to prevent model weights from leaking.
2X NVIDIA Tesla V100 32GB NVLink Water Cooled X99 E5-2686v4 AI Workstation PC
Item Quantity
Intel Xeon E5-2686 v4 CPU 1
2U CPU Cooler 1
Jingyue X99 Motherboard 1
DDR3 Memory 32GB
SSD 480GB
AMD Radeon R5 240 4K Display Card 1
NVIDIA Tesla V100 32GB SXM2 GPU 2
NVLink SXM2 Dual-GPU Baseboard 1
Corsair Water Cooling System 2
850W Bronze Power Supply 1
Dual-GPU 300G NVLink SXM2 Baseboard 1
8654 Data Cable 2
8654 to PCIe Adapter Card 1The AMD MI250X GPUs are also interesting - 128GB of HBM2E at 3TB/s, sometimes you see them second-hand for under $1k, the catch obviously is that it needs an OAM socket. Never seen an easy way to hook them up to a regular mainboard.