Meta AI: "The Future of AI Is Open Source and Decentralized"
1–10 of 120 posts
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#2Decentralized inferencing perhaps, but the training is very much centralized around Metas continued willingness to burn obscene amounts of money. The open source community simply can't afford to pick up the torch if Meta stops releasing free models.
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#3The future of everything you depend on is open source and decentralized.
Because all indications are that the powers over you cannot abide your freedoms of association, communication and commerce.
So, if it’s something your family needs to survive - it has better be distributed and cryptographically secured against interference.
This includes interference in the training dataset of whatever AIs you use; this has become a potent influence on the formation of beliefs, and thus extremely valuable.
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#4Decentralized inferencing perhaps, but the training is very much centralized around Metas continued willingness to burn obscene amounts of money. The open source community simply can't afford to pick up the torch if Meta stops releasing free models.
[deleted]
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#5Decentralized inferencing perhaps, but the training is very much centralized around Metas continued willingness to burn obscene amounts of money. The open source community simply can't afford to pick up the torch if Meta stops releasing free models.
There's plenty of open source AI out there that isn't Meta. It's just not as good.
The #1 problem is not compute, but data and the manpower required to clean that data up.
The main thing you can do is support companies and groups who are releasing open source models. They are usually using their own data.
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#6Great, who gives me $500,000,000, Nvidia connections to actually get graphics cards and a legal team to protect against copyright lawsuits from the entities whose IP was stolen for training?
Then I can go ahead and train my open source model.
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#7Curious but is there a path where llm training or inference could be distributed across the BOINC network:
https://en.m.wikipedia.org/wiki/Berkeley_Open_Infrastructure...
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#8Decentralized inferencing perhaps, but the training is very much centralized around Metas continued willingness to burn obscene amounts of money. The open source community simply can't afford to pick up the torch if Meta stops releasing free models.
There's plenty of open source AI out there that isn't Meta. It's just not as good. The #1 problem is not compute, but data and the manpower required to clean that data up. The main thing you can do is support companies and groups who are releasing open source models. They are usually using their own data.
> There's plenty of open source AI out there that isn't Meta. It's just not as good.
To my knowledge all of the notable open source models are subsidised by corporations in one way or another, whether by being the side project of a mega-corp which can absorb the loss (Meta) or coasting on investor hype (Mistral, Stability). Neither of those give me much confidence that they will continue forever, especially the latter category which will just run out of money eventually.
For open source AI to actually be sustainable it needs to stand on its own, which will likely require orders of magnitude more efficient training, and even then the data cleaning and RLHF are a huge money sink.
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#9* pre-trained models
* does not apply to training data
Re: Meta AI: "The Future of AI Is Open Source and Decentralized"
#10only when it's financially convenient for them...