70x faster cold(ish) starts for SGLang

Post by mezark » Fri, Apr 24, 2026, 3:02 PM UTC