The Cap Principle for LLM Serving
arxiv.org