Viewing profile — jeffra

We tried to communicate the key ideas in the video released with the blog post. It shows how DeepSpeed and the ZeRO optimizer save memory, and shows exactly what happens during eac…

> Is it getting a lot of internal use already (beyond the example we just heard about)? We have hundreds of internal users of DeepSpeed using it to train production ready models, m…

I'm from the DeepSpeed team, we're happy to answer questions if people have them.