Live data from Hacker News

Open source AI is the path forward

about.fb.com

431–440 of 936 posts

Re: Open source AI is the path forward

#431
Software 2.0 is about open licensing.

I.e., the more important thing - the more "free" thing - is the licensing now.

E.g., I play around with different image diffusion models like Stable Diffusion and specific fine-tuned variations for ControlNet or LoRA that I plug into ComfyUI.

But I can't use it at work because of the licensing. I have to use InvokeAI instead of ComfyUI if I want to be careful and only very specific image diffusion models without the latest and greatest fine-tuning. As others have said - the weights themselves are rather inscrutable. So we're building on more abstract shapes now.

But the key open thing is making sure (1) the tools to modify the weights are open and permissive (ComfyUI, related scripts or parts of both the training and deployment) and (2) the underlying weights of the base models and the tools to recreate them have MIT or other generous licensing. As well as the fine-tuned variants for specific tasks.

It's not going to be the naive construction in the future where you take a base model and as company A you produce company A's fine tuned model and you're done.

It's going to be a tree of fine-tuned models as a node-based editor like ComfyUI already shows and that whole tree has to be open if we're to keep the same hacker spirit where anyone can tinker with it and also at some point make money off of it. Or go free software the whole way (i.e., LGPL or equivalent the whole tree of tools).

In that sense unfortunately Llama has a ways to go to be truly open: https://news.ycombinator.com/item?id=36816395

Re: Open source AI is the path forward

#432
post #132

Earlier quoted context omitted.

If Microsoft can't do it, then we can reasonably conclude that it can't be done for any practical purpose. Discussing infinitesimal possibilities is better left to philosophers.

Doesn’t Microsoft maintain its own fork of Chromimum?

yes - their browser is chromium-based

Re: Open source AI is the path forward

#433

Earlier quoted context omitted.

I am not sure I follow this. 1. Is there such a thing as 'attention grabbing AI content' ? Most AI content I see is the opposite of 'attention grabbing'. Kindle store is flooded with this garbage and none of it is particularly 'attention grabbing'. 2. Why would creation of such content, even if it was truly attention grabbing, benefit meta in particular ? 3. How would poliferation of AI content lead to more ad spend…

Sure - there is plenty of attention grabbing AI content - it doesn't have to grab _your_ attention, and it won't work for everyone. I have seen people engaging with apps that redo a selfie to look like a famous character or put the person in a movie scene, for example. Every piece of content in any feed (good, bad, or otherwise) benefits the aggregator (Meta, YouTube, whatever), because someone will look at it. Not e…

> it doesn't have to grab _your_ attention

I am talking about in general, not me personally. No popular content on any website/platform is AI generated. Maybe you have examples that lead you believe that its possible on a mass scale.

> look like a famous character or put the person in a movie scene

what attention grabbing movie used gen ai persons

Re: Open source AI is the path forward

#434

Earlier quoted context omitted.

"Use it for whatever you want(conditions apply), but not if you are Google, Amazon, etc. If you become big enough talk to us." That's how I read the license, but obviously I might be missing some nuance.

You also can't use it for training or improving other models. You also can't use it if you're the government of India. Neither can sex workers use it. (Do you know if your customers are sex workers?) There are also very vague restrictions for things like discrimination, racism etc.

They're actually updating their license to allow LLAMA outputs for training!

https://x.com/AIatMeta/status/1815766335219249513

Re: Open source AI is the path forward

#435
It's hard to say Llama is an "open source" when their license states Meta has full control under certain circumstances

https://raw.githubusercontent.com/meta-llama/llama-models/ma...

> 2. Additional Commercial Terms. If, on the Llama 3.1 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under this Agreement unless or until Meta otherwise expressly grants you such rights.

Re: Open source AI is the path forward

#436
post #41

Earlier quoted context omitted.

"Open weights" is a more appropriate term but I'll point out that these weights are also largely inscrutable to the people with the code that trained it. And for licensing reasons, the datasets may not be possible to share. There is still a lot of modifying you can do with a set of weights, and they make great foundations for new stuff, but yeah we may never see a competitive model that's 100% buildable at home. Edit…

"Open weights" means you can use the weights for free (as in beer). "Open source" means you get the training dataset and the methodology. ~Nobody does open source LLMs.

Why is the dataset required for it to be open source?

If I self host a project that is open sourced rather than paying for a hosted version, like Sentry.io for example, I don't expect data to come along with the code. Licensing rights are always up for debate in open source, but I wouldn't expect more than the code to be available and reviewable for anything needed to build and run the project.

In the case of an LLM I would expect that to mean the code run to train the model, the code for the model data structure itself, and the control code for querying the model should all be available. I'm not actually sure if Meta does share all that, but training data is separate from open source IMO.

Re: Open source AI is the path forward

#437

This is really good news. Zuck sees the inevitability of it and the dystopian regulatory landscape and decided to go all in. This also has the important effect of neutralizing the critique of US Government AI regulation because it will democratize "frontier" models and make enforcement nearly impossible. Thank you, Zuck, this is an important and historic move. It also opens up the market to a lot more entry in the ar…

Unfortunately, there are a number of AI safety people that are still crowing about how AI models need to be locked down, with some of them loudly pivoting to talking about how open source models aid China.

Plus there's still the spectre of SB-1047 hanging around.

Re: Open source AI is the path forward

#439

It's hard to say Llama is an "open source" when their license states Meta has full control under certain circumstances https://raw.githubusercontent.com/meta-llama/llama-models/ma... > 2. Additional Commercial Terms. If, on the Llama 3.1 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active use…

It should be transparently clear that this move was taken by Meta to drive their competitors out of business in a capital intensive space.

Re: Open source AI is the path forward

#440

Earlier quoted context omitted.

Is there an LLM with actual open source training code and dataset? Besides BLOOM https://huggingface.co/bigscience/bloom

Yes, there are a few dozen full open source models (license, code, data, models)

What are some of the other ones? I am aware mainly of OLMo (https://blog.allenai.org/olmo-open-language-model-87ccfc95f5...)
Post reply on HN