Great to see e2e openness. One of the only true OSS models out there, vs most of the models releasing the binaries (weights). Surprised that they didn’t mention Mistral 7b in the comparisons.
Falcon also released open dataset.
Hello OLMo: A truly open LLM
21–30 of 76 posts
Re: Hello OLMo: A truly open LLM
#22This is 2 months old.
[deleted]
Re: Hello OLMo: A truly open LLM
#23This is the only LLM that is exciting to me. Clearly, LLMs are powerful tools that may end up replacing search and even go much further than simple searches by performing the research for you and producing final answers. Closed models like those from Open AI (ironically) or Anthropic cannot be audited. When most users will end up blindly hitting Microsoft’s Copilot button, which they are forcing OEMs to adopt, who’s…
One thing I wanted to add and call attention to is the importance of licensing in open models. This is often overlooked when we blindly accept the vague branding of models as “open”, but I am noticing that many open weight models are actually using encumbered proprietary licenses rather than standard open source licenses that are OSI approved ( https://opensource.org/licenses ). As an example, Databricks’s DBRX model…
Do we even know if these licenses are binding? AFAIK we have no ruling on whether model weights are even eligible for copyright. They're machine-produced derivatives of other work, so it's not a guarantee that copyright protects them.
Re: Hello OLMo: A truly open LLM
#24This is 2 months old.
And yet it's topical and relevant.
Re: Hello OLMo: A truly open LLM
#25If I read the license correctly, it seems that if you want to use the LLM, you need to tell the authors what you are doing with it.
Am I reading this correctly? https://allenai.org/licenses/impact-mr
“Derivative Impact Reports. AI2 seeks to encourage transparency around Derivatives through the use of Derivative Impact Reports, available here. Before releasing a Model Derivative or Data Derivative, You will share with AI2 the intended use(s) of Your Derivative by completing a Derivative Impact Report or otherwise providing AI2 with substantially similar information in writing. You agree that AI2 may publish, post, or make available such information about Your Derivative for review by the general public.
You will use good faith efforts to be transparent about the intended use(s) of Your Derivatives by making the information freely available to others who may access or use Your Derivatives. You acknowledge that Derivative Impact Reports are not intended to penalize any good faith disclosures about Derivatives. Accordingly, if You initiate or participate in any lawsuit or other legal action against a Third Party based on information in such Third Party’s Derivative Impact Report, then this MR Agreement will terminate immediately as of the date such lawsuit or legal action is filed or commenced.”
Re: Hello OLMo: A truly open LLM
#26Notably “The Pile” doesn’t seem to be part of the training data. So this might be more sound legally than many other “open” LLMs
For those also wondering: https://pile.eleuther.ai > The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together. By what's the legal complication with it?
I took a quick peak at this last time it was mentioned and it had dozens of my own repos of unlicensed source code in it. All of that was published on GitHub and made public, but much of it has no license specified.
Re: Hello OLMo: A truly open LLM
#27If I read the license correctly, it seems that if you want to use the LLM, you need to tell the authors what you are doing with it. Am I reading this correctly? https://allenai.org/licenses/impact-mr “Derivative Impact Reports. AI2 seeks to encourage transparency around Derivatives through the use of Derivative Impact Reports, available here. Before releasing a Model Derivative or Data Derivative, You will share with…
Interesting. I recall seeing Apache licenses in their official repositories. I wonder how these additional restrictions get pulled in.
Re: Hello OLMo: A truly open LLM
#28If I read the license correctly, it seems that if you want to use the LLM, you need to tell the authors what you are doing with it. Am I reading this correctly? https://allenai.org/licenses/impact-mr “Derivative Impact Reports. AI2 seeks to encourage transparency around Derivatives through the use of Derivative Impact Reports, available here. Before releasing a Model Derivative or Data Derivative, You will share with…
Does that apply to this model? On huggingface it says "License: The code and model are released under Apache 2.0."
Re: Hello OLMo: A truly open LLM
#29If I read the license correctly, it seems that if you want to use the LLM, you need to tell the authors what you are doing with it. Am I reading this correctly? https://allenai.org/licenses/impact-mr “Derivative Impact Reports. AI2 seeks to encourage transparency around Derivatives through the use of Derivative Impact Reports, available here. Before releasing a Model Derivative or Data Derivative, You will share with…
no, this is apache license-d. yes it is confusing that AI2 has custom licenses but they aren't using them here
Re: Hello OLMo: A truly open LLM
#30Earlier quoted context omitted.
One thing I wanted to add and call attention to is the importance of licensing in open models. This is often overlooked when we blindly accept the vague branding of models as “open”, but I am noticing that many open weight models are actually using encumbered proprietary licenses rather than standard open source licenses that are OSI approved ( https://opensource.org/licenses ). As an example, Databricks’s DBRX model…
Do we even know if these licenses are binding? AFAIK we have no ruling on whether model weights are even eligible for copyright. They're machine-produced derivatives of other work, so it's not a guarantee that copyright protects them.
That’s a great point and I hope more people speak up to treat models as just numerical derivative works so they aren’t automatically granted these protections. It’s better if society meaningfully debates this and chooses the right approach.