It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
Open source LLM with 32k Context Length
11–20 of 31 posts
Re: Open source LLM with 32k Context Length
#12It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
Also "don't do naughty things", is there a chart for that? How is that defined, is it part of the non-existing license?
Re: Open source LLM with 32k Context Length
#13Re: Open source LLM with 32k Context Length
#14It's probably too new for anyone to have integrated this into text-generation-webui / Gradio? I've been looking for a large context LLM (self-hosted or not) for a project, and as a European I unfortunately don't have access to Anthropic's Claude API yet.
Re: Open source LLM with 32k Context Length
#15It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Re: Open source LLM with 32k Context Length
#16i.e. all other things being equal is a 8k model better at math than a 32k model
Re: Open source LLM with 32k Context Length
#17It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
https://ai.meta.com/llama/license/ https://ai.meta.com/llama/use-policy/
Re: Open source LLM with 32k Context Length
#18Earlier quoted context omitted.
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
There is no open source-ish. It either protects the fundamental freedoms or it...doesn't.
Re: Open source LLM with 32k Context Length
#19Earlier quoted context omitted.
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
There is no open source-ish. It either protects the fundamental freedoms or it...doesn't.
Edit: this is in fact fairly interesting discussion because LLM is a new breed of digital products. Meta's terms are practical for limiting the usage for commercial applications, and they are designed to protect the general population. It's not the worn out "protecting us from ourselves", its actually preventing Llama users from harming non-users. Yes, we can be jaded and say it's about protecting the brand and dissociating from bad actors. My point is that it's hard to apply usual arguments for open source and freedom of computing, when you're defending rights of people who want to harm other people.
Re: Open source LLM with 32k Context Length
#20Does anyone know if larger context lengths are inherent worse at other task? i.e. all other things being equal is a 8k model better at math than a 32k model