Open source LLM with 32k Context Length
blog.abacus.ai
Open source LLM with 32k Context Length
1–10 of 31 posts
Re: Open source LLM with 32k Context Length
#2Abacus always seemed to me like a 'we got a lot of VC money with inflated claims now we gotta show we do everything' company. I don't really understand what they do, they seem to offer everything but I don't see anyone talking about using their offerings in the real-world. Ever. The only time I see mentions of the company are when I am targeted with ads or promoted posts of the founder.
Re: Open source LLM with 32k Context Length
#3It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo.
Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Re: Open source LLM with 32k Context Length
#4[deleted]
Re: Open source LLM with 32k Context Length
#5It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
Re: Open source LLM with 32k Context Length
#6It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
It’s not possible to have a license over an ML model trained on other peoples’ works, since such models are uncopyrightable. They’re more like a phone book; a collection of facts trained by an entirely un-creative process. https://news.ycombinator.com/item?id=36691050
This hasn’t been proven in court, but it seems the most likely outcome.
Re: Open source LLM with 32k Context Length
#7It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
If the JSON license isn't considered open, due to requiring that "The Software shall be used for Good, not Evil.", then I don't see how tacking an additional financial threshold onto it makes it more open. I don't think meta even released the training dataset, so you cant even replicate it (should you have the funds to do so).
There are other LLMs that don't have such restrictions, and publish their training data.
Re: Open source LLM with 32k Context Length
#8It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
It’s not possible to have a license over an ML model trained on other peoples’ works, since such models are uncopyrightable. They’re more like a phone book; a collection of facts trained by an entirely un-creative process. https://news.ycombinator.com/item?id=36691050 This hasn’t been proven in court, but it seems the most likely outcome.
And yet meta are specifying a license, implying they do hold the copyright.
Re: Open source LLM with 32k Context Length
#9Earlier quoted context omitted.
It’s not possible to have a license over an ML model trained on other peoples’ works, since such models are uncopyrightable. They’re more like a phone book; a collection of facts trained by an entirely un-creative process. https://news.ycombinator.com/item?id=36691050 This hasn’t been proven in court, but it seems the most likely outcome.
And yet meta are specifying a license, implying they do hold the copyright.
They’re mistaken.
It’ll take awhile for this mistake to be reconciled in court though.
Re: Open source LLM with 32k Context Length
#10It seems this is built on LLAMA. Did meta change the license to make it open source now? It still seems to be showing otherwise in the repo. Edit: No mention of it being open source in the linked article. Maybe the title here is just wrong? @dang
Llama 2 is open source-ish. Weights are freely available and can be commercially used, but only if you have less than 700m users and agree to some "don't do naughty things" terms.
There is no open source-ish. It either protects the fundamental freedoms or it...doesn't.