More Low-Bit LLMs
github.com
More Low-Bit LLMs
1–2 of 2 posts
Re: More Low-Bit LLMs
#2This community has launched over 200 low-bit LLMs on Huggingface and they provide tools for full parameter fine-tuning of the LLaMA-3 8B model using a single GTX 3090 GPU with 24GB of graphics memory. Github: https://github.com/GreenBitAI/green-bit-llm