Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta AI: "The Future of AI Is Open Source and Decentralized"

twitter.com

Post reply on HN
Print view View original

51–60 of 120 posts

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#51

Post by bloatedGoat »

jsheard wrote: post #18
cynicalpeace wrote: post #17

Earlier quoted context omitted.

One area that's interesting, but easy to dismiss because it's the ultimate cross-section of hype (AI and crypto) is bittensor. AFAICT it decentralizes the training of these models by giving you an incentive to train models which will mine the crypto if you're improving it. I learned about it years ago, mined some crypto, lost the keys and now kicking myself cuz I would've made a pretty penny lol

Does it actually work? AIUI the current consensus is that you need massive interconnect bandwidth to train big models efficiently, and the internet is nowhere near that. I'm sure the Nvidia DGX boxes have 10x400Gb NICs for a reason.

There are methods that make it feasible to train models over the internet. DiLoCo is one [1] and NousResearch has found a way to improve on that using a method they call DisTro [2].

1. https://arxiv.org/abs/2311.08105

2. https://github.com/NousResearch/DisTrO?tab=readme-ov-file

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#54

Post by KaiserPro »

troupo wrote: post #24
hyuuu wrote: post #16

the view of the comments here seems to be quite negative for what meta is doing. Honest question, should they go to the route of openai and closed source + paid access instead? OpenAI or Claude seem to garner more positive views than llama open sourced.

They use "open source" to whitewash their image. Now ask yourself a question: where does Meta's data come from? Perhaps from their users' data? And they opted everyone in by default. And made the opt-out process as cumbersome as possible: https://threadreaderapp.com/thread/1794863603964891567.html And now complain that the EU is preventing them from "collecting rich cultural context" or something https://x.com/nickcl…

> Perhaps from their users' data?

nope, not yet.

FAIR, the people that do the bigboi training, for a lot of their stuff cant even see user data, because the place they do the training can't support the access.

Its not like openAI where the lawyers don't even know whats going on, because they've not yet been properly taken to court.

at Meta, the lawyers are everywhere and if you do naughty shit to user data, you are going to be absolutely fucked.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#55

Post by atq2119 »

CatWChainsaw wrote: post #30

Facebook promised to connect the world in a happy circle of friendship and instead causes election integrity controversies, bizarre conspiracy theories about pandemics and immigrants to go viral, and massive increases in teen suicide. Not sure why anyone would trust them with their promises of decentralized-AI and roses.

Good. Now compare to OpenAI. Clearly what Meta is doing is better than OpenAI from the perspective of freedom and decentralization.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#57

Post by bee_rider »

redleader55 wrote: post #48
Calvin02 wrote: post #34

Earlier quoted context omitted.

Doesn’t Threads and Fediverse indicate that they are headed that way for social as well?

The last time we had a corporate romance between an open source protocol/project, "XMPP + Gtalk/Facebook = I think the success of the "Threads + Fediverse = I don't want to say the big tech are awesome and without fault, but at the end of the day big-techs will be big-techs. Let's keep the Fediverse relevant and Meta will continue to support it, otherwise it will be swallowed by the bigger fish.

For some reason, this has made me wonder if we just need more non-classical-social-media fediverse stuff. Like of course people will glom on to Threads, it means they can interact with the network while still being inside Facebook’s walled garden…

I wonder if video game engines could use it as an alternative to Steam or Discord integration.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#58

Post by CatWChainsaw »

atq2119 wrote: post #55
CatWChainsaw wrote: post #30

Facebook promised to connect the world in a happy circle of friendship and instead causes election integrity controversies, bizarre conspiracy theories about pandemics and immigrants to go viral, and massive increases in teen suicide. Not sure why anyone would trust them with their promises of decentralized-AI and roses.

Good. Now compare to OpenAI. Clearly what Meta is doing is better than OpenAI from the perspective of freedom and decentralization.

Cool. What Meta is doing is better than cigarettes from the perspective of addiction. If Meta is the best we have, then we'd better create something better, or prepare for the inevitable enshittification.

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#59

Post by miguelaeh »

dzonga wrote: post #27

the reason - i'm a little bearish on AI is due to its cost. small companies won't innovate on models if they don't have billions to burn to train the models. yet when you look back at history, things that were revolutionary, it was due to low cost of production. web, bicycles, cars, steam engine cars etc.

The first cars, networks, and many other things were not unexpensive. They became so with time and growing adoption.

Cost of compute will continue decreasing and we will reach that point where it is feasible to have AI everywhere. I think with this particular technology we have already reached a no return point

Re: Meta AI: "The Future of AI Is Open Source and Decentralized"

#60

Post by caeril »

pjkundert wrote: post #3

The future of everything you depend on is open source and decentralized. Because all indications are that the powers over you cannot abide your freedoms of association, communication and commerce. So, if it’s something your family needs to survive - it has better be distributed and cryptographically secured against interference. This includes interference in the training dataset of whatever AIs you use; this has beco…

It's not the training dataset.

All of these models, including the "open" ones, have been RLHF'ed by teams of politically-motivated people to be "safe" after initial foundation training.

Post reply on HN