Earlier quoted context omitted.
As I replied to a child comment - this is a nice idea that just isn't tenable in reality. AI hardware isn't just hilariously faster than consumer GPUs, it's also hilariously more power-efficient and has hilariously better connectivity. Every one of these dimensions kills the idea. The far, FAR superior power efficiency means that even if you did harness every public GPU or GPU-like device on earth, you'd end up consu…
What makes you think Deepseek or GLM won't catch up to Fable level? Why would there be a break in the trend now?
Open source AI must win
341–350 of 538 posts
Re: Open source AI must win
#342I've been contemplating a decentralized model training system for some time using volunteer machines that we all contribute. But, it is astronomically difficult. The communication speeds are untenable. And, there is the issue of data poisoning from untrusted nodes. I've almost cracked that last issue with a self-healing checkpointed rollback system that doesn't have to throw out anything that follows the corrupt datu…
Re: Open source AI must win
#343Re: Open source AI must win
#344Earlier quoted context omitted.
Yes, but have you seen what's happened to hardware improvements over the past 20 years? From the 1960s to the mid-2000s, every 10 years you'd have a big enough improvement in computing power that you could basically throw out the old computers and replace them with two new ones that were each massive improvements for the same cost (this varied, of course, from hyperbole to massive understatement). We achieved this by…
The bottleneck right now isn't making hardware more powerful, it's manufacturing it fast enough. Hardware right now is expensive because of scarcity, and those with a monopoly on it have no incentive to change that. The Chinese would love to produce AI hardware much cheaper, but are blocked from doing so because US sanctions stop a Dutch company from selling them the machines capable of doing so. Coincidentally the c…
[1]https://www.eetimes.com/u-s-gives-ok-to-asml-on-euv-effort/
Re: Open source AI must win
#345Who is going to fund it? Training is unfathomably expensive. You have either VC funded models looking for a return on investment, or CCP funded models looking to solidify authoritarian "model Chinese society". Maybe there are some university 4B models, but I doubt those will carry far.
I share your concerns, although we still see pretty similarly large and complex things that remain open source today. I am astonished on a daily basis that my Linux computer is so close to the same experience as two operating systems put out by trillion dollar companies. It even does things that those commercial alternatives don’t do. Also, if DeepSeek is truly putting out models with 1/10th the cost of Western compe…
Re: Open source AI must win
#346Re: Open source AI must win
#347Earlier quoted context omitted.
Amazing that anyone in 2026 still can believe in "don't be evil" marketing from multibillion dollar corporations.
The proof is in the pudding though. I'm judging based on their actions, not on their words. They're making AI models and AI research widely accessible, including selling consumer grade hardware to run them locally, and to use open-weight models. They could have just gone all in on selling to Anthropic, OpenAI, and all the other big tech companies, but they aren't. Meanwhile, Anthropic is trying to price people out of…
Re: Open source AI must win
#348Re: Open source AI must win
#349Re: Open source AI must win
#350I would be totally willing to pay $50 per month to support an open source AI lab, rather to get open source models as byproducts of corporations.