Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
1–10 of 61 posts
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#2Glad to see the NER-like task performed the best, as I was just about to test something like this for comparison with a fine-tuned BERT model. Any idea about the training costs for this task?
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#3Just to add to this, I run through a lot of these topics around fine-tuning Llama 2 on your own dataset (for me it's my own code :P) in a coding live stream a couple weeks ago. All on Colab single GPU
Fine-tuning Llama stream: https://www.youtube.com/watch?v=TYgtG2Th6fI&t=2282s
I have a couple more one where I do a QLoRa fine tuning session and explain the concepts as a personally self taught engineer (software engineer of 8 years moving into ML recently)
QloRa fine-tuning stream: https://www.youtube.com/watch?v=LitybCiLhSc&t=4584s
Overall I'm trying to breakdown how I'm approaching a lot of my personal projects and my current AI driven startup. Want to make this information as accessible as possible. Also have a series where I'm fine-tuning a model to be the smallest webdev llm as possible which seems like people are liking. Only been streaming for about a month and plenty more to come.
Ask me any question about the stream and fine-tuning llama!
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#4Seeing NER examples pop up more frequently now, and wondering why folks don’t use spacy for those sorts of tasks.
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#5[deleted]
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#6Seeing NER examples pop up more frequently now, and wondering why folks don’t use spacy for those sorts of tasks.
I use a fine-tuned BERT-like model for NER, but I'd be interested to compare how it performs.
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#7I'm really glad to see a post like this come out. I've seen so many discussions online about customizing models -- this post really does cut through the noise.
Really like the evaluation methodology, and seems well-written as well.
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#8Just to add to this, I run through a lot of these topics around fine-tuning Llama 2 on your own dataset (for me it's my own code :P) in a coding live stream a couple weeks ago. All on Colab single GPU Fine-tuning Llama stream: https://www.youtube.com/watch?v=TYgtG2Th6fI&t=2282s I have a couple more one where I do a QLoRa fine tuning session and explain the concepts as a personally self taught engineer (software engin…
one gpu? feasible with one 3060?
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#9It's weird that Lora and training with quantization is not being taken more seriously. It's way cheaper, takes less time, and a lot of evidence shows it's pretty good.
I don't think it should be something brushed on the side to be tried out later..
Re: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
#10It's weird that Lora and training with quantization is not being taken more seriously. It's way cheaper, takes less time, and a lot of evidence shows it's pretty good. I don't think it should be something brushed on the side to be tried out later..