Viewing profile — eso_logic

This is a great datapoint. Someone else brought up that I should be memory checking the GPUs to understand if things are breaking down.

Lesson learned for real, and TIL matplotlib is happy to export SVG. Good to know for next time. I upgraded my lightsail instance size in the meantime.

I'm trying bruh fuck!

Yes! P4 and the other small cards are fantastic. I've been more focused on developing a cooling system around the 2 slot sized cards so I don't have any of these lying around. Are …

16 GPUs would require one or more 220V breaker panels, more akin to an EV charger than a computer. You would also quickly run out of PCIe lanes. My goal with this benchmarking is t…

No problem. Varying context size is a common request I've been getting as well. Personally I'm looking forward to seeing how much we can cram into the ancient K80's 24GB of VRAM :0…

This initial round of benchmarking was to understand if there was any usecase here at all and I think there is. In a follow up, I'll be trying to answer questions like this. How bi…

Thanks! Yeah this is a major consideration. I have looked at power consumption throughout runs in the past ( https://esologic.com/gpu-server-benchmark/#gpu-box-benchmark ) and foun…

Wow holy crap this is news to me! I will have to consider picking some of these up for testing, what is it like working with them?