Horovod: Uber’s Open Source Distributed Deep Learning Framework for TensorFlow
eng.uber.com