OpenSource will win in the end!
The state of open source AI
341–350 of 379 posts
Re: The state of open source AI
#342State of open source AI would be a very very short article. This is about open weights.
Re: The state of open source AI
#343Earlier quoted context omitted.
Who says it hasn't already? I've driven in a LOT of the USA. Sure Chicago, NYC, DC, LA, LV... They're all built up and feel modern. Try driving anywhere in the Midwest outside of the big cities. Dilapidated carcas buildings everywhere. Urban and rural blight. Only jobs are low paying service work. Its bleak. Like, really bad poverty as a disease bleak. And its crazy watching it too. They're ignorant (involuntatily),…
At risk of greatly oversimplifying American politics, it's truly impressive how good Democrats are at shooting themselves in the foot. That's why I personally believe Sanders and Mamdani have found so much success with the working class; they keep themselves separate from the Culture War slugfest that mainline Democrats either voluntarily engage in or let Republicans drag them into. IMO the vast majority of those "cu…
" can't put my finger on it exactly but Democrats have a tendency to message on those issues in ways that are either counter-productive or get soundbit saying something moronic."
There are people that have explained this a lot better than I have, but here is my poor paraphrasing to answer your question.
Democrats are a bit less centrally controlled and you have a mix of Progressives/Greens etc.. that would prefer their own party but the closest thing they have is the DNC. Some of these ideas are not universally shared even in the Democratic party but they try to include them all.
Compare this with the GOP, there are also disagreements but until recently has a pretty unifiying message. This makes it easier to rally a base.
I could be off, and stating incorrectly but this is how I see it.
Re: The state of open source AI
#344Earlier quoted context omitted.
yep, all those coders paying $200-$500 per day to use claude once subsidy ends will be seriously rethinking how much they really want to vibe-code "rewriting X in rust". Helping people write word docs, recipes, and emails isn't going to justify $15K per month subscriptions either.
The subscription is certainly subsidized but its no where near 100x cheaper than API prices. Heck, most large enterprise moved to usage based billing and are still happily paying for it. They are force multipliers for your top talent, and when a top engineer is being paid $500k a year, doubling their output for $500/day is a no brainer.
Yes, it's close to 100x and it's easy to calculate this.
Take a $10 claude sub and fill it with Fable/Opus for a month (meaning use all your tokens) and then use one of the many token/session recording tools (I like agentsview).
It will show you how much your token cost is at current rates if using an api. I use the $20 plan and I don't use all my tokens, and am around 50x.
Re: The state of open source AI
#345Earlier quoted context omitted.
Qwen will have an aneurysm if you ask that exact question. Don’t know about others as I don’t have access to them at work
Out of curiosity, I just tried this exact question with Qwen 3.6. It proceeded to look through my git commit history and then gave me a summary of the changes committed on June 4... Of course, yes, the models will provide propaganda-aligned responses to prompts that specifically mention certain political issues. I don't care for this behavior, but it's virtually never triggered in everyday use, and can be trained out…
> Of course, yes, the models will provide propaganda-aligned responses to prompts that specifically mention certain political issues.
The only study I’ve seen about that actually showed Chinese models to be less “propaganda-aligned” than the Western counterparts.
Re: The state of open source AI
#346OpenSource will win in the end!
100%. Often open source projects lag when they're too niche or don't have enough interest, but open source AI - I can't think of anything better suited to be open source and the demand/interest is through the roof - people will make it happen.
Re: The state of open source AI
#347Earlier quoted context omitted.
I seriously doubt that we'll be running 1TB ram setups any time soon. I was hearing about people running 64GB back in 2014 or so
Moore's law also applies to memory. With personal computers, we've gone from ~16KB in the late 1970s to ~640KB in the mid-80s to ~512 MB in the late-90s, to ~1GB in the early 2000s, to ~64GB today. If you look at the memory per dollar graph, it's even more obvious. This is exponential growth. I see no reason to think the trend won't continue for the next couple of decades.
Moores law is dead for memory and other things
Re: The state of open source AI
#348Earlier quoted context omitted.
> Helping people write word docs, recipes, and emails isn't going to justify $15K per month subscriptions either. Those things can all be done today on a $250 used video card and pennies of electricity
Not really. Models that can run on a $250 card may be able to produce a decent word doc sometimes, but the fidelity of such models is so poor that it's no longer very attractive for general use on those types of tasks.
Then I buy a very expensive GPU rack and timeshare it with a couple of friends.
Re: The state of open source AI
#349Earlier quoted context omitted.
If you think about it, every corporation is essentially a fascist entity, or features many distinctly fascist aspects, in terms of internal governance, structure, culture, and relationship with the outside world. And I think that is why Americans haven't really resisted this trajectory, because so many Americans work within corporations as a fact of life, that they are quite accustomed to the workings of fascism, as…
Corporations don't have armies and prisons. Get a grip.
They would love to, though.
Re: The state of open source AI
#350Earlier quoted context omitted.
A bold prediction. Phones have gigabytes today. There are famous laws of growth that put terabytes at just a few years away - perhaps 10 isn't too bad an estimate?
> Phones have gigabytes today. Phones have zero HBM today. > There are famous laws of growth that put terabytes at just a few years away I assume you're referring to Moore's law here, but if you are, it doesn't really apply to HBM in the same way, especially in a smartphone form factor where LPDDR is the only practical option due to heat and energy constraints, and a variety of architectural complexities specific to…
capability has been advancing faster than raw FLOPS