Fastest JSON Decoding for Local LLMs with Compressed Finite State Machine
lmsys.org