Model Batch Inference in Ray: Actors, ActorPool, and Datasets
anyscale.com