651–660 of 965 posts
Earlier quoted context omitted.
It’s a shame it can’t just be giving back to the community and not questioned. Why is selfishness from companies who’ve benefited from social resources not a surprising event vs the norm.
Because they're a publicly traded company with a fiduciary duty to generate returns for shareholders.
Earlier quoted context omitted.
Those additional restrictions mean it's not an open source license by the OSI definition, which matters if you care about words sometimes having unambiguous meanings. I call models like this "openly licensed" but not "open source licensed".
Call it what you will, but it'd be silly if Meta let these 700M+ customer mega-corps (Amazon, Google, etc) just take Meta models and sell access to them without sharing revenue with Meta. You should be happy that Meta find ways to make money from their models, otherwise it's unlikely that they'd be giving you free access (until your startup reaches 700M+ customers, when the free ride ends).
I am, this is unambiguously great. Just don't call it open source.
I don't see any explanation for why they trained 8B instead of 7B. I thought that If you have a 16GB GPU, you can put 14GB(7B*16bits) model into it, but how does it fit If the model is exactly 16GB?
The bigger size is probably from the bigger vocabulary in the tokenizer. But most people are running this model quantized at least to 8 bits, and still reasonably down to 3-4 bpw.
How does that affect anything? It still uses 16 bit floats in the model doesn't it?
They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.
Also added Llama 3 70B to our coding copilot https://www.double.bot if anyone wants to try it for coding within their IDE and not just chat in the console
Do you support any other editors? If the list is small, just name them. Not everyone uses or likes VS Code.
Earlier quoted context omitted.
Yes or no, do you conceed that for almost everyone, none of what you said matters, and almost everyone can use llama 3 for their use case, and that basically nobody is going to have to worry about being sued, other than maybe like Google, or equivalent? You are using all these scary words without saying the obvious, which is that for almost everyone, none of that matters.
I don't support GP's claims, but you have to realize that you're "almost everyone" up until you build something very successful with lots of capital at stake, and then you definitely become "someone special" and have to think ahead about how the licenses of your models impact you. Of course random individuals don't care much about the licenses on their personal AI projects. But if you intend to grow something signifi…
Earlier quoted context omitted.
That business can search and find talents globally for fraction of SV salary. If FAANG company can hire an engineer overseas for 60k$ annually why other cannot?
Because maintaining the organizational infrastructure to coordinate remote teams dispersed to time zones all over the world and with different communication styles, cultural assumptions, and legal requirements is a whole matter of its own? Companies that can do that are at an advantage over those who can't right now, but pulling that off is neither trivial nor immediate nor free.
I had teams in North American, Europe, Russia and East Asia. It resulted in a diversified set of engineers who were close to our customers (except in Russia where the engineers were highly qualified but few prospects for sales). Managing across cultures and time zones is a competence. Jet lag from travel was not as great...
Earlier quoted context omitted.
That's a strange list of nations, isn't it? I wonder what their logic is.
No EU initially - I think this is the same with Gemini 1.5 Pro too. I believe it’s to do with the various legal restrictions around AI which iirc take a few weeks.
Earlier quoted context omitted.
What does the “free ride ends” mean? If you mean you can’t use the next model they might release after you have reached that many users, sure that might be true. It is not true that you have to pay for the already released llama 3. I don’t care what Zuckerberg says. I care what the licence says. I recommend you to read it. It is shorter and more approachable than the usual rental agreement of a flat.
Here is the relevant Llama 3 license section, below, in it's entirety. It says that if you have 700M+ users then you'll need a new license, which Meta may or may not choose to grant to you. It does not say what the terms of that new license will be, but if you are interested you can watch the Dwarkesh interview, or just believe me when I tell you that Zuck said it'll be a commercial license - you will pay. ** 2. Addi…
> If, on the Meta Llama 3 version release date, the monthly active users … is greater than 700 million monthly active users in the preceding calendar month …
If that’s not true then the free license applies to you.