Speculative KV coding: ~4× losslessly compressed KV cache using a small model #1 Post by somnial » Tue, May 12, 2026, 1:18 PM UTC Speculative KV coding: ~4× losslessly compressed KV cache using a small modelfergusfinn.com