The improvements in the given benchmarks for the larger models (Llama v1 65B and Llama v2 70B) are not huge, but hard to know if still make a difference for many common use cases.
Llama 2
11–20 of 860 posts
Re: Llama 2
#12Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
> greater than 700 million monthly active users Hmm. Sounds like specifically a FAANG ban. I personally don't mind. But would this be considered anti-competitive and illegal? Not that Google/MS/etc. don't already have their own LLMs.
Re: Llama 2
#13They don't benchmark against the OpenAI models at all for some reason. In my experience so far even GPT-3.5 was so much better than any OSS models I tried. Meta must be missing having a cloud business at this point. AI would have fit perfectly with that. Since they ran Whatsapp for so many years kinda without interfering too much, they could have also tried a somewhat independent cloud unit.
(based on page 7 in the GPT-4 report https://cdn.openai.com/papers/gpt-4.pdf)
Re: Llama 2
#14Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
It's essentially a "Amazon and Google don't use this k thx."
Re: Llama 2
#15Why doesn't FB create an API around their model and launch OpenAPI competitor? It is not like they don't have resources, and the learnings (I am referring to actual learning from users' prompts) will improve their models over time.
Re: Llama 2
#16Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
> greater than 700 million monthly active users Hmm. Sounds like specifically a FAANG ban. I personally don't mind. But would this be considered anti-competitive and illegal? Not that Google/MS/etc. don't already have their own LLMs.
Re: Llama 2
#17Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
But only existing competitors. If you don't yet have 700MM MAU, the impact of this is only that, after you reach 700MM MAU, you can't get future versions of the Llama models for free. You can still continue to use versions that were released before you reached that threshold.
For reference, neither Instagram nor WhatsApp had 700MM MAU at the time Facebook decided to acquire them.
Re: Llama 2
#18Model playground here: https://llama2.ai
Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat
If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions.
Developers can:
* clone the chatbot app as a starting point (https://github.com/a16z-infra/llama2-chatbot)
* use the Replicate endpoint directly (https://replicate.com/a16z-infra/llama13b-v2-chat)
* or even deploy your own LLaMA v2 fine tune with Cog (https://github.com/a16z-infra/cog-llama-template)
Please let us know what you use this for or if you have feedback! And thanks to all contributors to this model, Meta, Replicate, the Open Source community!
Re: Llama 2
#19Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
That's an oddly high number for blocking competition. OpenAI's ChatGPT hit 100 million MAUs in January, and has gone down since. It's essentially a "Amazon and Google don't use this k thx."
Apple is the big laggard in terms of big tech and complex neural network models.