Fast JSON Decoding for Local LLMs with Compressed Finite State Machine #1 Post by yeesian » Thu, Mar 07, 2024, 5:47 AM UTC Fast JSON Decoding for Local LLMs with Compressed Finite State Machinelmsys.org