TinyLlama: An Open-Source Small Language Model
1–10 of 46 posts
Re: TinyLlama: An Open-Source Small Language Model
#2GitHub repo with links to the checkpoints: https://github.com/jzhang38/TinyLlama
Re: TinyLlama: An Open-Source Small Language Model
#3I've been using one of the earlier checkpoints for benchmarking a Llama implementation. Completely anecdotally I feel at least as good or better about this one than the earlier openllama 3B. I wouldn't use either of them for RAG or anything requiring more power, just to say that it's competitive as a smaller model, whatever you use those for, and easy to run on CPU at FP16 (meaning without serious quantization).
Re: TinyLlama: An Open-Source Small Language Model
#4I've been using one of the earlier checkpoints for benchmarking a Llama implementation. Completely anecdotally I feel at least as good or better about this one than the earlier openllama 3B. I wouldn't use either of them for RAG or anything requiring more power, just to say that it's competitive as a smaller model, whatever you use those for, and easy to run on CPU at FP16 (meaning without serious quantization).
>I wouldn't use either of them for RAG
What's RAG?
Re: TinyLlama: An Open-Source Small Language Model
#5OP here with a shameless plug: for anyone interested, I'm working on a site called Emergent Mind that surfaces trending AI/ML papers. This TinyLlama paper/repo is trending #1 right now and likely will be for a while due to how much attention it's getting across social media: https://www.emergentmind.com/papers/2401.02385. Emergent Mind also looks for and links to relevant discussions/resources on Reddit, X, HackerNews, GitHub, and YouTube for every new arXiv AI/ML paper. Feedback welcome!
Re: TinyLlama: An Open-Source Small Language Model
#6I've been using one of the earlier checkpoints for benchmarking a Llama implementation. Completely anecdotally I feel at least as good or better about this one than the earlier openllama 3B. I wouldn't use either of them for RAG or anything requiring more power, just to say that it's competitive as a smaller model, whatever you use those for, and easy to run on CPU at FP16 (meaning without serious quantization).
>I wouldn't use either of them for RAG What's RAG?
Retrieval augmented generative, basically giving it some text passage and asking questions about the text.
Re: TinyLlama: An Open-Source Small Language Model
#7OP here with a shameless plug: for anyone interested, I'm working on a site called Emergent Mind that surfaces trending AI/ML papers. This TinyLlama paper/repo is trending #1 right now and likely will be for a while due to how much attention it's getting across social media: https://www.emergentmind.com/papers/2401.02385 . Emergent Mind also looks for and links to relevant discussions/resources on Reddit, X, HackerNe…
I visit your site every day. Thank you for creating it and evolving it past simple summaries to show paper details!
I recall you were looking to sell it at some point. Was wondering what that process looked like, and why you ended up holding on to the site.
Re: TinyLlama: An Open-Source Small Language Model
#8I've been using one of the earlier checkpoints for benchmarking a Llama implementation. Completely anecdotally I feel at least as good or better about this one than the earlier openllama 3B. I wouldn't use either of them for RAG or anything requiring more power, just to say that it's competitive as a smaller model, whatever you use those for, and easy to run on CPU at FP16 (meaning without serious quantization).
>I wouldn't use either of them for RAG What's RAG?
If you want more on RAG with a concrete example: https://neuml.hashnode.dev/build-rag-pipelines-with-txtai
Re: TinyLlama: An Open-Source Small Language Model
#9OP here with a shameless plug: for anyone interested, I'm working on a site called Emergent Mind that surfaces trending AI/ML papers. This TinyLlama paper/repo is trending #1 right now and likely will be for a while due to how much attention it's getting across social media: https://www.emergentmind.com/papers/2401.02385 . Emergent Mind also looks for and links to relevant discussions/resources on Reddit, X, HackerNe…
I am new to this space. Is it hard to fine tune this model?
Re: TinyLlama: An Open-Source Small Language Model
#10Link to model on HF Hub: https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0