Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta AI: "The Future of AI Is Open Source and Decentralized"

twitter.com

Post reply on HN
Print view View original

71–80 of 120 posts

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#71

Post by Der_Einzige »

leetharris wrote: post #5
jsheard wrote: post #2

Decentralized inferencing perhaps, but the training is very much centralized around Metas continued willingness to burn obscene amounts of money. The open source community simply can't afford to pick up the torch if Meta stops releasing free models.

There's plenty of open source AI out there that isn't Meta. It's just not as good. The #1 problem is not compute, but data and the manpower required to clean that data up. The main thing you can do is support companies and groups who are releasing open source models. They are usually using their own data.

Compute is for sure the number one problem. Look at how long it’s taking for anything better than Pony Diffusion to come out for NSFW image gen despite the insane amount of demand for it.

Look at how much computer purple AI actually has. It’s basically nothing.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#72

Post by Der_Einzige »

caeril wrote: post #60
pjkundert wrote: post #3

The future of everything you depend on is open source and decentralized. Because all indications are that the powers over you cannot abide your freedoms of association, communication and commerce. So, if it’s something your family needs to survive - it has better be distributed and cryptographically secured against interference. This includes interference in the training dataset of whatever AIs you use; this has beco…

It's not the training dataset. All of these models, including the "open" ones, have been RLHF'ed by teams of politically-motivated people to be "safe" after initial foundation training.

Not mistrals. Mistral large is willing to tell me how to genocide minorities or NSFW without any kind of orthogonalization or fine tuning. Please actually try models instead of pontificating without evidence.

Try it for yourself: https://huggingface.co/mistralai/Mistral-Large-Instruct-2407

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#73

Post by numpad0 »

jsheard wrote: post #2

Decentralized inferencing perhaps, but the training is very much centralized around Metas continued willingness to burn obscene amounts of money. The open source community simply can't afford to pick up the torch if Meta stops releasing free models.

Centralized production, decentralized consumption.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#76

Post by LtWorf »

redleader55 wrote: post #48
Calvin02 wrote: post #34

Earlier quoted context omitted.

Doesn’t Threads and Fediverse indicate that they are headed that way for social as well?

The last time we had a corporate romance between an open source protocol/project, "XMPP + Gtalk/Facebook = I think the success of the "Threads + Fediverse = I don't want to say the big tech are awesome and without fault, but at the end of the day big-techs will be big-techs. Let's keep the Fediverse relevant and Meta will continue to support it, otherwise it will be swallowed by the bigger fish.

The problem was not that it was not evolving. The problem was that they decided they had trapped all the users of other networks they could trap.

Slack did the same killing xmpp and irc bridge. I don't see them making a matrix bridge.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#77

Post by farco12 »

dzonga wrote: post #27

the reason - i'm a little bearish on AI is due to its cost. small companies won't innovate on models if they don't have billions to burn to train the models. yet when you look back at history, things that were revolutionary, it was due to low cost of production. web, bicycles, cars, steam engine cars etc.

I could see the cost of licensing data to train models increasing significantly, but the cost of compute for training models is only going to drop on a $/PFLOP basis.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#78

Post by pjkundert »

Der_Einzige wrote: post #72
caeril wrote: post #60

Earlier quoted context omitted.

It's not the training dataset. All of these models, including the "open" ones, have been RLHF'ed by teams of politically-motivated people to be "safe" after initial foundation training.

Not mistrals. Mistral large is willing to tell me how to genocide minorities or NSFW without any kind of orthogonalization or fine tuning. Please actually try models instead of pontificating without evidence. Try it for yourself: https://huggingface.co/mistralai/Mistral-Large-Instruct-2407

I wasn’t aware that there was any publicly accessible interface to the Mistrals (or any other) models without training-wheels!
Post reply on HN