We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It

Post by antithesizer » Sun, Aug 17, 2025, 5:23 PM UTC

3eb7988a1663 wrote: post #7

Something tells me they are calculating utilization in a non-standard way. While I have no doubt there is room for clever pipelining of data, to say you cut out all memory transfer overhead sounds ridiculous. If they did, Zuckerberg will cut them a $5+ billion check today.

Post by 3eb7988a1663 » Sun, Aug 17, 2025, 5:32 PM UTC

antithesizer wrote: post #11

3eb7988a1663 wrote: post #7

Something tells me they are calculating utilization in a non-standard way. While I have no doubt there is room for clever pipelining of data, to say you cut out all memory transfer overhead sounds ridiculous. If they did, Zuckerberg will cut them a $5+ billion check today.

hmm maybe that's why they didn't post it