Where does Anthropic or OpenAI winning leave us? Dependents of an AI-megacorp for our "facts"? Our software? Our work? It's possible these companies will become everyone's boss, and will dictate to everyone what everyone is allowed to work on, think, say, do, believe, etc. Before Big Tech springs that trap, we must support and divert resources to open models.
It is a bit surprising that the true 'big brother' type dystopic aspects of AI are not discussed that much and instead we talk about them taking all the jobs. We feed these things so much information. It could be used against us for advertising, control, or worse.
Open source AI must win
71–80 of 538 posts
Re: Open source AI must win
#72Definitely, but I see the gap widening everyday, especially while commercial AI models have started converging towards AGI. However I do believe and support the cause, as it's the next big thing as developers we need to take to prevent a complete monopoly in the coming few years.
These things can't even center a div correctly half the time.
Not everything is code. Just because it generates a shitty SaaS clone for you and that seemed magical, it does not mean we are approaching "AGI".
An AGI could design an Oil tanker, manage the project from start to finish, handle all contract negotiations and purchasables, payroll, scheduling. Then it could do that 50x over and start a leading logistics firms.
In reality an LLM can't even complete upwork projects that are worth $20 an hour more than 4% or the time.
Source:
https://labs.scale.com/leaderboard/rli
4% guys, 4%. It cannot complete entry level work on fucking Upwork 96% of the time. Stop falling for the marketing and sorry but an LLM will never be AGI.
Its literally just text autocomplete with some RLHF post training, holy shit im losing my mind. I want this hype to end so badly holy shit I need this to end.
Re: Open source AI must win
#73Were it not for China, America would have restricted the most advanced models from being used outside the US. NATO members would have access to GPT-4, with some countries entirely blocked from AI. Biden's GPU controls should give you an idea. Thank you, China. Open source AI must win.
Go ask Claude to criticize Anthropic and see how long your account stays active.
Re: Open source AI must win
#74I've been contemplating a decentralized model training system for some time using volunteer machines that we all contribute. But, it is astronomically difficult. The communication speeds are untenable. And, there is the issue of data poisoning from untrusted nodes. I've almost cracked that last issue with a self-healing checkpointed rollback system that doesn't have to throw out anything that follows the corrupt datu…
Re: Open source AI must win
#75You have either VC funded models looking for a return on investment, or CCP funded models looking to solidify authoritarian "model Chinese society".
Maybe there are some university 4B models, but I doubt those will carry far.
Re: Open source AI must win
#76what is Open Source AI even? to me Open Source, like Free Software, is something i can run on my own computer. any AI system that runs on a computer that i do not control is by my definition not Open Source. so how then can Open Source AI win? it can't even compete. even if we collect enough money and create a dedicated Open Source organization to build and run a community owned AI datacenter, how does that help? so…
Qwen models are actually very competitive with frontier models, and you can run them on your local computer. Gotta have a decent graphics card and by that time the current cost of the rig may not justify it over paying $100/month for cloud model but it’s all out there.
Re: Open source AI must win
#77Earlier quoted context omitted.
> Dependents of an AI-megacorp for our "facts"? Our software? Our work? It's worse than this, it's more like our thinking. There's already plummetting math grades [1], handing over our thinking to AI megacorps where there's likely to be a monopoly or duopoly is an incredibly dangerous thing for humanity as a whole. [1] https://www.dailycal.org/news/campus/academics/failing-grade...
If humanity is over-reliant on frontier labs' models to perform work, the result is a dependence on the actual intelligence of these models -- not on human intelligence. This could be a small reason, on top of many others, why investors are throwing hundreds of billions of dollars a bit "carelessly" to these labs. It's fascinating seeing the models do the "hard work" (the deep, challenging thinking) for you. The conu…
What will happen? Massive. Deflation. What will you pay for an oil change? Corn? Meals? Everything is about to be free. But tokens will be expensive!! Sure but, you wont do white collar work anymore so it wont matter what tokens cost.
Re: Open source AI must win
#78Anthropic just kneecapped themselves, and possibly OpenAI and Google as well, with their FUD strategy that got fable shutdown by the government.
But that doesn't impact Chinese providers. Then can US companies get investments for expensive model development if they can't actually sell those models-as-a-service?
In the meantime, open source will continue its march onward because while slower, it's completely open source, and the models are already good enough to improve their own work as well as build out the next gen of models.