Training 3x larger model on the same GPU cards
1–2 of 2 posts
Re: Training 3x larger model on the same GPU cards
#2MegEngine (A Deep Learning Framework) implements DTR. Now you can train 3x larger model by tradeoff a little bit speed for lots of GPU memory.