DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
1–10 of 45 posts
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#2I appreciate how these folks released after the model was already on Hugging Face.
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#3How is it faster that other 7b models using pytorch?
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#4Ignoring the fact that this is a 1 day old account, why should I care that this LLM's bars are larger and numbers bigger? Is this corporate blogpost actually good content for anyone? What is the appeal other than "yup, that blue bar sure is longer than the other color bars."?
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#5Just one observation. This model seems "less" multilingual than LLAMA and Mistral. I always ask in Portuguese "What is the capital of Bahia?"/ "Qual a capital da Bahia?" and DeciLM answered wrong and in English ( it said it was Brasilia, the right answer is Salvador). The other models replied correctly.
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#6For someone who is a bit techie, but not familiar with much past the original PyTorch, can I get an explanation of why this should matter to me? Are we at the point yet where I can give one of these LLMs a list of characters and an introductory paragraph, and get a 100K word book out of it yet? Totally not asking because I have too many ideas and not enough time to write them all...
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#7> The Fastest and Most Accurate 7B-Parameter LLM to Date
There's plainly 7B models that surpass it on https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...
Am I missing something?
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#8How is it faster that other 7b models using pytorch?
It uses variable grouped query attention, so it reduces the memory required to fetch during inference.
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#9> The Fastest and Most Accurate 7B-Parameter LLM to Date There's plainly 7B models that surpass it on https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb... Am I missing something?
You have to look at the pre-trained models and not the "tuned" models. Its number one in that category (which is what I think they are referring to, given the benchmarks are against Mistral and llama)
Re: DeciLM-7B: The Fastest and Most Accurate 7B-Parameter LLM to Date
#10> The Fastest and Most Accurate 7B-Parameter LLM to Date There's plainly 7B models that surpass it on https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb... Am I missing something?
Base model, not fine-tuned