Viewing profile — vlejd

This is awesome. I have been trying to track similar things mainly to identify brands of cloths that actually last long enough to be worth it. How do you keep the discipline to do …

Interestingly enough, we found that cublas is not that well optimized for some less common consumer GPUs, specifically 3090. We saw that is didn't really achieve it's full potentia…

I think the lack of efficient GPU kernels was the main problem. It is much, much easier to get a real speedup and memory reduction from quantization from fp16 to fp8 than from 50% …

To get benefits from sparsity, you usually need to have very sparse matrices, impose some structure on the sparsity pattern or have specialized hardware. None of it is the case if …

Internet is dead indeed. Amazing idea! Will use it to test my posts.

Thant looks very nice. I am writing some technical blogs from time to time and this will come in handy. How does it work with the code execution though? Are you running some servic…