I think it's enough to use Open Router to encourage competition in the market place.
Open source AI must win
421–430 of 538 posts
Re: Open source AI must win
#422I've been contemplating a decentralized model training system for some time using volunteer machines that we all contribute. But, it is astronomically difficult. The communication speeds are untenable. And, there is the issue of data poisoning from untrusted nodes. I've almost cracked that last issue with a self-healing checkpointed rollback system that doesn't have to throw out anything that follows the corrupt datu…
Ya that'd be an awesome project, the only issue is how do you verify it's not being poisoned? To actually validate it would require more analysis than the training took to run. It would require a trusted network, not an open one, unless that can get solved somehow.
[deleted]
Re: Open source AI must win
#423To me it does not matter whether AI is open source or not. Yes,
it is better if it is open source, no doubt, but either way I
think AI must die. Naturally it won't, we all know that, but
this does not change my statement in the slightest - AI must
die. Having it open source is, while an improvement, just
painting lipstick on the pig.
Re: Open source AI must win
#424I would be totally willing to pay $50 per month to support an open source AI lab, rather to get open source models as byproducts of corporations.
Well, AI labs are spending hundreds of billions, so you're gonna need a lot of subscribers to compete...
Good point. I currently choose to give money to Anthrophic rather than OpenAI because they align a tiny bit more with my values and the product is good. Perhaps releasing an open source model every year could be a differentiator from competitors, where enterprise and individuals choses the lab not because is the best model out there but because gives autonomy in case something happens to the organization providing the models.
Re: Open source AI must win
#425This, and distributed LLM inference. We are at a point where no single person can setup a rig to run a SOTA model, it is just too expensive. So we must build and adopt frameworks that allow individuals to share resources to run SOTA models in a distributed manner. That way they will also be non-censorable by governments. Also The only way to prevent that one entity weaponizes it, is by giving EVERYONE access to it.
I wonder if there is way local small LLMs can complement each other in away that the sum-total yields a much more performant LLM
Perhaps some radical MoE where you download _exactly_ the components you need as you need them. Currently MoE is switched usually on per-token per-layer basis, so you need all weights locally. But e.g. Apple made one which pre-selects all experts based on prompt embedding. That might be further scaled up - e.g. predict exactly what's needed
Re: Open source AI must win
#426Earlier quoted context omitted.
DeepSeek and GLM (plus Kimi) are at or above Sonnet level wrt. favorable workloads like coding. They're not close to Opus or the latest GPT yet, and Fable is even higher than that. Other workloads relying more on real-world knowledge have them even further behind, and this can't be mitigated without making the model itself bigger and harder to host locally.
Not true. Big models buy you baked in knowledge and long context cohesion. A model can be trained to use search and knowledge base tools more efficiently to mitigate the former, and harnesses/workflows can be designed to push models into small parallel threads to mitigate the latter. The thing that big models will always bring to the table is the ability to YOLO weak/under-specified prompts, and spend less time in th…
These things sound plausible, but have they actually been demonstrated? Wouldn't anyone who succeeded in making such a small but useful LLM be raking in the money now?
Re: Open source AI must win
#427For US citizens: counting on Open Source AI is another libertarian fantasy.
Open source AI should and will get better for sure (including better defined first), but the state will have the power over AI never the less.
If you don't like govt's AI policy or the people making those policies, go fix that, don't act like you can avoid them.
For Chinese: saying "Open source AI must win" sounds like singing "L'Internationale, sera le genre humain". The reality is Open Source AI will be over the moment US competitive pressure gone.
For rest of world: there's no real AI for you so far, go work on it or be a citizen of US&A or China.
Re: Open source AI must win
#428There are no open source LLMs.
Re: Open source AI must win
#429Re: Open source AI must win
#430I would be totally willing to pay $50 per month to support an open source AI lab, rather to get open source models as byproducts of corporations.
Well, AI labs are spending hundreds of billions, so you're gonna need a lot of subscribers to compete...
For now. Progress in hardware/model efficiency is one of the threats the big AI labs face, because if LLMs become commoditized they can’t make back the billions they spent.