On-Device LLM Inference Powered by X-Bit Quantization #1 Post by dynamix » Wed, May 29, 2024, 2:29 PM UTC On-Device LLM Inference Powered by X-Bit Quantizationgithub.com