State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
1–10 of 143 posts
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#2See the original Vicuna post:
https://news.ycombinator.com/item?id=35378683
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#3[deleted]
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#4Amazing model, close and probably better than Bard. Journey to getting the weights was a fun one : )
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#5what are model weights?
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#6what are model weights?
the secret sauce of AI
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#7Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#8what are model weights?
They basically encapsulate what a model has "learned." ML models without their weights are useless because the output is essentially random noise. You then train the model on data, and it changes the weights into numbers that cause the whole thing to work. Training data and processing power are usually very expensive so the resulting weights are valuable.
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#9what are model weights?
They are the parameters of this large language model. There are 13B fp16 numbers.
Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
#10Note that what they released are the delta weights from the og LLaMa model. To play around with it, you'll need to grab the original LLaMA 13B model and apply the changes.
> We release Vicuna weights as delta weights to comply with the LLaMA model
> license. You can add our delta to the original LLaMA weights to obtain
> the Vicuna weights.
Edit: took me a while to find it, here's a direct link to the delta weights: https://huggingface.co/lmsys/vicuna-13b-delta-v0