Seems there is 7b, 13b and 70b models
Llama 2
51–60 of 860 posts
Re: Llama 2
#52Well that is lamer than expected. The RLHF censorship was expected, but no 30B model, and single digit benchmark improvements with 40% more data? Wat. Some of the community fine tunes managed better than that. The 4k context length is nice, but RoPE makes it irrelevant anyway. Edit: Ah wait, it seems like there is a 34B model as per the paper: "We are releasing variants of Llama 2 with 7B, 13B, and 70B parameters. We…
>The 4k context length is nice, but RoPE makes it irrelevant anyway. Can you elaborate on this?
Start searching SuperHOT and RoPE together. 8k-32k context length on regular old Llama models that were originally intended to only have 2k context lengths.
Re: Llama 2
#53Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…
Seeing a16z w/early access, enough to build multiple tools in advance, is a very unpleasant reminder of insularity and self-dealing of SV elites.
My greatest hope for AI is no one falls for this kind of stuff the way we did for mobile.
Re: Llama 2
#54Well that is lamer than expected. The RLHF censorship was expected, but no 30B model, and single digit benchmark improvements with 40% more data? Wat. Some of the community fine tunes managed better than that. The 4k context length is nice, but RoPE makes it irrelevant anyway. Edit: Ah wait, it seems like there is a 34B model as per the paper: "We are releasing variants of Llama 2 with 7B, 13B, and 70B parameters. We…
>The 4k context length is nice, but RoPE makes it irrelevant anyway. Can you elaborate on this?
Here's some more info on it:
https://arxiv.org/pdf/2306.15595.pdf
https://www.reddit.com/r/LocalLLaMA/comments/14lz7j5/ntkawar...
https://www.reddit.com/r/LocalLLaMA/comments/14mrgpr/dynamic...
In short, the context is just an array of indexes passed along with the data, which can be changed to floats and encode more sparsely to scale to an arbitrarily small or large context. It does need some tuning of the model to work well though afaik.
What's funnier is that Meta came up with it (that paper is theirs) and somehow didn't bother including it in LLama 2.
Re: Llama 2
#55Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
It doesn't look like a block to me, more a "please call us to discuss terms".
Re: Llama 2
#56we need someone to leak it again...
Re: Llama 2
#57This is really exciting. I work at Replicate, where we've already setup a hosted version for anyone to try it:
Re: Llama 2
#58Would really want to see some benchmarks against ChatGPT / GPT-4. The improvements in the given benchmarks for the larger models (Llama v1 65B and Llama v2 70B) are not huge, but hard to know if still make a difference for many common use cases.
Then why not read their paper?
"The largest Llama 2-Chat model is competitive with ChatGPT. Llama 2-Chat 70B model has a win rate of 36% and a tie rate of 31.5% relative to ChatGPT."
Re: Llama 2
#59Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
Defense against tiktok and bytedance
Re: Llama 2
#60Earlier quoted context omitted.
I think more Apple. It's not like Google or Microsoft would want to use LLaMA when they have fully capable models themselves. I wouldn't be surprised if Amazon does as well. Apple is the big laggard in terms of big tech and complex neural network models.
Google's model is not as capable as llama-derived models, so I think they would actually benefit from this. > I wouldn't be surprised if Amazon does as well. I would - they are not a very major player in this space. TikTok also meets this definition and probably doesn't have LLM.
Google has far better models than llama based models. They just simply don't put them facing the public.
It is pretty ridiculous that they essentially just set a marketing team with no programming experience to write Bard, but that shouldn't fool anyone into believing they don't have capable models in Google.
If Deepmind were to actually provide what they have in some usable form, it would likely be quite good. Despite being the first to publish on RLHF (just right before OpenAI) and bring the idea to the academic sphere, they mostly work in areas tangential to 'just chatbots' (e.g. how to improve science with novel GNNs, etc). However, they're mostly academics, so they aren't set on making products, doing the janitorial work of fancy UIs and web marketing, and making things easy to use, like much of the rest of the field.