We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
1–10 of 13 posts
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#2There's no explanation as to how they achieved that speed up :( it would have been better if they also wrote a post on that
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#3Sounds like some basic plumbing that an LLM should be able to do.
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#4There's no explanation as to how they achieved that speed up :( it would have been better if they also wrote a post on that
yeah, just feels like an ad for daft...
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#5There's no explanation as to how they achieved that speed up :( it would have been better if they also wrote a post on that
> That story’s for another post, but first, here’s the recipe that got us to near-100%.
From the article - it states that speed up is part of next post.
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#6There's no explanation as to how they achieved that speed up :( it would have been better if they also wrote a post on that
> That story’s for another post, but first, here’s the recipe that got us to near-100%. From the article - it states that speed up is part of next post.
Then that’s a very inaccurate click bait title for this post.
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#7Something tells me they are calculating utilization in a non-standard way. While I have no doubt there is room for clever pipelining of data, to say you cut out all memory transfer overhead sounds ridiculous.
If they did, Zuckerberg will cut them a $5+ billion check today.
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#8Ok nice clickbaiting, post your 3x speed up part and we will talk
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#9Something tells me they are calculating utilization in a non-standard way. While I have no doubt there is room for clever pipelining of data, to say you cut out all memory transfer overhead sounds ridiculous. If they did, Zuckerberg will cut them a $5+ billion check today.
[deleted]
Re: We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
#10There's no explanation as to how they achieved that speed up :( it would have been better if they also wrote a post on that
> That story’s for another post, but first, here’s the recipe that got us to near-100%. From the article - it states that speed up is part of next post.
Scammy post