Farewell, CUDA OOM: Automatic Gradient Accumulation
mosaicml.com