Scaling TensorFlow inference to unlimited items per request with bounded latency
medium.com