Live data from Hacker News

The state of open source AI

stateofopensource.ai

181–190 of 379 posts

Re: The state of open source AI

#181
I see a gap in the ecosystem: too few mature open source harnesses.

I’d like a community led, BYOK, modular project where I can define, orchestrate, monitor and maintain agents.

Of course this is a new area and projects like this take time. But still, IMHO, a gap exists.

Unless someone wants to recommend their favorite FOSS tool; please do.

Re: The state of open source AI

#182
This presentation is painful to read. It's an LLM's idea of a CTO presentation. I'm overwhelmed by charts, only slightly connected to the text around them. But no matter, it looks like a CTO slide deck. HIGH IMPACT.

Much better would be if the CTO of Mozilla had actually articulated their own analysis.

Re: The state of open source AI

#183

Speculation: open models is what will kill Anthropic and OpenAI. Hyperscalers can run the models without a licensing fee. Apple can make them smaller and put them on the device. The frontier models are an edge and a liability. They're astronomically expensive to train. Without them, their models will fade into obscurity. Their marketing depends on people believing the models are meaningfully different, as people have…

I agree with your speculation to be honest. And yet I’ve tried several local open weights model now and none gives the same quality of answers as Claude gives me on a regular Sonnet model. Mind you: I am “running” 48GB of RAM so I can’t try every model. Where does this difference come from? Can we actually get close locally?

Re: The state of open source AI

#184

mozilla only began babbling about open source ai when they got their teeth extracted for free via the entire community giving them the curbiest of curbstomps. i still use firefox but hot damn did they utterly fail to read the room initially. the only other company i can think of in recent memory -- besides sony cutting out discs -- is logitech when their ceo began gibbering about a subscription mouse or microsoft and…

It's frustrating because I truly believe they are well-meaning, honest actors. Every single "controversy" surrounding Mozilla can be directly attributed to miscommunication rather than malice. They do often struggle to read the room.

That said, the takeaways from this report are exciting, and I do feel that Mozilla now has the right lens in their assessment of OSS AI and their own approach to ensuring interoperability and setting open, modern standards.

Re: The state of open source AI

#185

Earlier quoted context omitted.

While that may be technically true for a strict definition of “smartphone,” there’s no denying the iPhone redefined the concept in a way that its competitors were forced to copy to have any hope of keeping up. Nobody hears the word “smartphone” and thinks of a Blueberry or Treo anymore.

What exactly did the iPhone do better?

Perfected multi-touch touchscreen

Before that we had touchscreen but they sucked.

---

    2002: FingerWorks makes advances in multi-touch technology
    2005: Apple acquires FingerWorks and its patents
    2007: iPhone launches

Re: The state of open source AI

#186

Speculation: open models is what will kill Anthropic and OpenAI. Hyperscalers can run the models without a licensing fee. Apple can make them smaller and put them on the device. The frontier models are an edge and a liability. They're astronomically expensive to train. Without them, their models will fade into obscurity. Their marketing depends on people believing the models are meaningfully different, as people have…

The frontier models are obviously superior. The question is if progress slows down.

Re: The state of open source AI

#187

Earlier quoted context omitted.

not really a feeling; if you listen to ed zitron and strip out the vitriol, you still get the fact that the VCs are looking for some 5 trillion dollars in 5 years. The onlly way that happens is if America turns into zimbawe.

Who says it hasn't already? I've driven in a LOT of the USA. Sure Chicago, NYC, DC, LA, LV... They're all built up and feel modern. Try driving anywhere in the Midwest outside of the big cities. Dilapidated carcas buildings everywhere. Urban and rural blight. Only jobs are low paying service work. Its bleak. Like, really bad poverty as a disease bleak. And its crazy watching it too. They're ignorant (involuntatily),…

As a Canadian driving through Michigan/Ohio/Upstate New York and places look run down and like they peaked in the 60s-80s and its been down hill since.

When I was younger and it was a new thing it was quite a shock since American media obviously doesnt portray it that way. It is quite a contrast to even how the more run down parts of Canada look.

Re: The state of open source AI

#188

Speculation: open models is what will kill Anthropic and OpenAI. Hyperscalers can run the models without a licensing fee. Apple can make them smaller and put them on the device. The frontier models are an edge and a liability. They're astronomically expensive to train. Without them, their models will fade into obscurity. Their marketing depends on people believing the models are meaningfully different, as people have…

I agree with your speculation to be honest. And yet I’ve tried several local open weights model now and none gives the same quality of answers as Claude gives me on a regular Sonnet model. Mind you: I am “running” 48GB of RAM so I can’t try every model. Where does this difference come from? Can we actually get close locally?

You’re running 48GB now but imagine a future where everyone has 512GB RAM or 1TB RAM in their computers (it might sound like a lot but also 20 years ago we had 512MB PCs).

It’s not hard to imagine what 5-10 years of pressure to increase RAM will do to specs, on top of the normal tech improvements.

That’s worth bearing in mind when thinking about local models.

Plus, local models keep getting better and better; 2 years ago what you could get out of those 48GB of RAM was embarrassing compared to what’s doable today.

We’re getting there. Just takes time.

Re: The state of open source AI

#189

Exactly 4 months ago, the marketshare on openrouter was 60%-40% in favor of closed models. Now it's 63%-37% in favor of open models. On March 19th, the open models processed 888B tokens in aggregate, yesterday, they processed 4.19T tokens in aggregate. That's almost 5x in 4 months! I can't think of the right intensifier to describe this level of growth. If you are looking for more details (as inferred by openrouter d…

Why would I use open router with claude? No thanks

Re: The state of open source AI

#190
Mozilla presents themselves as an "open community". But they are a commercial corporation bankrolled by Google, and with an oppressive organizational culture. I would interpret this post as being not just about an opportunity for their self-aggrandizement, but also Mozilla trying to whitewash its mass surveillance of users, likely used also to train some model or another, or perhaps just to feed their patronn (Alphabet)'s ad machine.

They tell us about how the farmers and native people and whateve are all happy with their chatbots and models. The major effects are a massive and ever-increasing energy use - in a time where we must cut back and economize to avoid further global warming; a massive diversion of investment capital - especially in the US; fantastic stock valuations for a few tech giants (gee, I wonder whether any of them is related to Mozilla somehow); and other effects one could survey, all more significant by far than the examples they bring.

Post reply on HN