Live data from Hacker News

Falcon 40B LLM (which beats Llama) now Apache 2.0

twitter.com

11–20 of 143 posts

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#11

This Falcon-40B royalty free license may force Meta ... that LLama-7B/13B may soon be fully open sourced as Meta wants open source LLM advancements and contributions on its own LLM architecture.

Research in the LLM space is moving so fast, I doubt any architecture will "stick".

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#12

Earlier quoted context omitted.

Do you consider the Unity model "sleazy"? But I agree that it was poor form to call it open-source at the time. Sadly, it seems to be standard practice in the LLM space to release models with all kinds of restrictions on use and call them "open source". Well now Falcon is open source. Given they are giving away something that was very expensive to train, I am grateful.

I don't know unity's model. I call Falcon sleazy because the royalty stuff (plus a bunch of absurd related terms) were buried in the license while the headline said open source. I'm not against commercial products, nor products with free and premium tiers. This otoh felt, like I say, just sleazy.

Here is a link to an explanation of the Unity model.

https://gamedevbeginner.com/is-unity-free/

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#13

This Falcon-40B royalty free license may force Meta ... that LLama-7B/13B may soon be fully open sourced as Meta wants open source LLM advancements and contributions on its own LLM architecture.

Why do people think that Meta released their model in order to get open source coders to improve their models? They will get absolutely no competitive advantage from this. Every other team developing a closed source LLM can easily copy the innovations that open source coders have applied to Llama on their own, closed source models.

There's no advantage here. Meta just spent $10 million on releasing fun chaos into the world and increasing their recruiting power.

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#14

Earlier quoted context omitted.

Well if its Apache 2.0 now, can't you clone it as-is and have it be open "forever?"

That's part of why I'm interested in their motivation changing licenses. They obviously had a profit motive and a model that centered on collecting rents on the model and decided to back off from it. Will they keep maintaining their code and improving the models and continue releasing everything under Apache 2.0? I'm just saying I feel like we got a glimpse of what they're about and it wasn't pretty, so why build aro…

They dont need to do squat.

Look at Stable Diffusion 1.5 and LLaMA: They are thriving, but the original implementations are ancient history, and Meta/StabilityAI/RunawayML have done precisely nothing. And to be blunt, their legality is very ugly, which already makes Falcon more attractive.

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#15

Earlier quoted context omitted.

That's part of why I'm interested in their motivation changing licenses. They obviously had a profit motive and a model that centered on collecting rents on the model and decided to back off from it. Will they keep maintaining their code and improving the models and continue releasing everything under Apache 2.0? I'm just saying I feel like we got a glimpse of what they're about and it wasn't pretty, so why build aro…

They dont need to do squat. Look at Stable Diffusion 1.5 and LLaMA: They are thriving, but the original implementations are ancient history, and Meta/StabilityAI/RunawayML have done precisely nothing. And to be blunt, their legality is very ugly, which already makes Falcon more attractive.

Very good point, if a community builds up around it, that would make it much more attractive. So chicken / egg in a way. I can definitely see that happening.

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#17

Earlier quoted context omitted.

They dont need to do squat. Look at Stable Diffusion 1.5 and LLaMA: They are thriving, but the original implementations are ancient history, and Meta/StabilityAI/RunawayML have done precisely nothing. And to be blunt, their legality is very ugly, which already makes Falcon more attractive.

Very good point, if a community builds up around it, that would make it much more attractive. So chicken / egg in a way. I can definitely see that happening.

Yeah. TBH the biggest hurdle is that Falcon is a different architecture, so the existing tooling won't "just work." A drop in LLaMA or RWKV replacement has a better chance of catching on, even if it leaves some architecture improvements on the table.

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#18

Earlier quoted context omitted.

That's part of why I'm interested in their motivation changing licenses. They obviously had a profit motive and a model that centered on collecting rents on the model and decided to back off from it. Will they keep maintaining their code and improving the models and continue releasing everything under Apache 2.0? I'm just saying I feel like we got a glimpse of what they're about and it wasn't pretty, so why build aro…

They dont need to do squat. Look at Stable Diffusion 1.5 and LLaMA: They are thriving, but the original implementations are ancient history, and Meta/StabilityAI/RunawayML have done precisely nothing. And to be blunt, their legality is very ugly, which already makes Falcon more attractive.

Agree. The Stable Diffusion Open RAIL M license: "You agree not to use the Model or Derivatives of the Model ... To defame, disparage or otherwise harass others"

Does "disparage" have a settled meaning in law? Is a parody disparaging?

https://github.com/CompVis/stable-diffusion/blob/main/LICENS...

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#19

This Falcon-40B royalty free license may force Meta ... that LLama-7B/13B may soon be fully open sourced as Meta wants open source LLM advancements and contributions on its own LLM architecture.

Meta's eventual, internal LLM architecture will be totally different than the open source LLMs, right? They don’t need to run on commodity hardware. Maybe I am cynical, but I dont see the incentive for Meta to contribute an open model.

To be fair, they contributed Pytorch which has defined a whole industry and is responsible for creating hundreds of billions of dollars in value or more. Contributing a set of model weights is an extremely minor thing in the shadow of that, so wouldn't exactly be uncharacteristic.

Re: Falcon 40B LLM (which beats Llama) now Apache 2.0

#20

This Falcon-40B royalty free license may force Meta ... that LLama-7B/13B may soon be fully open sourced as Meta wants open source LLM advancements and contributions on its own LLM architecture.

Yann LeCun: "No. But it's not because we don't want to. It's because of complicated legal issues." https://twitter.com/ylecun/status/1651782621540524032

Complicated legal issues of having the cake and eating it too.
Post reply on HN