Live data from Hacker News

Show HN: Fine-tuned coding copilot with Gemma and qLORA

github.com

1–2 of 2 posts

Re: Show HN: Fine-tuned coding copilot with Gemma and qLORA

#2
Hey, co-founder of https://double.bot coding copilot here. Thanks for sharing this! I'm assuming OP is the author?

Curious how does the double quantization of weights in qLORA impact the model's performance compared to standard fine-tuning. Could qLORA and LoRA be combined with other optimization methods, such as pruning or knowledge distillation, for more efficiency gains?