121–130 of 860 posts
In the things you can't do (at https://ai.meta.com/llama/use-policy/ ): "Military, warfare, *nuclear industries or applications*" Odd given the climate situation to say the least...
Why doesn't FB create an API around their model and launch OpenAPI competitor? It is not like they don't have resources, and the learnings (I am referring to actual learning from users' prompts) will improve their models over time.
Earlier quoted context omitted.
>The 4k context length is nice, but RoPE makes it irrelevant anyway. Can you elaborate on this?
Start searching SuperHOT and RoPE together. 8k-32k context length on regular old Llama models that were originally intended to only have 2k context lengths.
Edit: even if it's doing full attention like the commentator says, turns out that's not good enough! https://arxiv.org/abs/2307.03172
Earlier quoted context omitted.
That's an oddly high number for blocking competition. OpenAI's ChatGPT hit 100 million MAUs in January, and has gone down since. It's essentially a "Amazon and Google don't use this k thx."
I think more Apple. It's not like Google or Microsoft would want to use LLaMA when they have fully capable models themselves. I wouldn't be surprised if Amazon does as well. Apple is the big laggard in terms of big tech and complex neural network models.
Making advanced LLMs and releasing them for free like this is wonderful for the world. It saves a huge number of folks (companies, universities & individuals) vast amount of money and engineering time. It will enable many teams to do research and make products that they otherwise wouldn't be able to. It is interesting to ponder to what extent this is just a strategic move by Meta to make more money in the end, but wh…
You have to agree to any terms they might think of in the future. Clicking download, they claim you agree to their privacy policy which they claim they can update on a whim Google's privacy policy, for example, was updated stealthfully to let them claim rights over every piece of IP you post on the internet that their crawlers can get to
This is a nonsense. They added a disclaimer basically warning that LLMs might learn some of your personal data from the public web, because that’s part of the training data. A privacy policy is not a contract that you agree to, it’s just a notice of where/when your data is handled.
Earlier quoted context omitted.
I think more Apple. It's not like Google or Microsoft would want to use LLaMA when they have fully capable models themselves. I wouldn't be surprised if Amazon does as well. Apple is the big laggard in terms of big tech and complex neural network models.
Google's model is not as capable as llama-derived models, so I think they would actually benefit from this. > I wouldn't be surprised if Amazon does as well. I would - they are not a very major player in this space. TikTok also meets this definition and probably doesn't have LLM.
It seems it is not aware of the notion of historic development, perhaps its world-model is "static"?
Temporal reasoning is interesting , if you google for "news" do you get what was news last year because a website updated last year had a page claiming to contain "Latest News".
REF: https://www.stefanjudis.com/today-i-learned/property-order-i...
Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…
its not clear but can we also download the model with this Llama v2 Cog thing? EDIT: Meta is being extremely prompt, just got sent the download instructions https://twitter.com/swyx/status/1681351712718876673 also is it now Llama or LLaMA since the website says Llama? lol
https://github.com/facebookresearch/llama/commit/6d4c0c290ae...
Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
https://blogs.microsoft.com/blog/2023/07/18/microsoft-and-me... I think this is effectively an Apple + Amazon + Google ban? (MS employee, just noticing interesting intersection of announcements and licensing).
The benchmarks look amazing compared to other open source LLMs. Bravo Meta. Also allowing commercial use? Can be downloaded today? Available on Azure AI model catalog today? This is a very impressive release. However, if I were starting a company I would be a little worried about the Llama 2 Acceptable Use Policy. Some of the terms in there are a little vague and quite broad. They could, potentially, be weaponized in…