Attention Became Efficient and Scalable: KV Caching, MQA, GQA, MLA, and DSA
chizkidd.github.io