70x faster cold(ish) starts for SGLang

Post by somnial » Mon, Apr 27, 2026, 4:18 PM UTC