Inkling: Our Open-Weights Model • Hacker News Board

Re: Inkling: Our Open-Weights Model

#141

Post by blovescoffee » Wed, Jul 15, 2026, 11:11 PM UTC

suprjami wrote: post #121

YetAnotherNick wrote: post #108

Earlier quoted context omitted.

Do any of these even have match a year old Deepseek 3.1?

DS3 isn't even looked at anymore. GLM-5.2 is the best in that class right now. It is competitive with current GPT/Claude/Gemini.

"Current GPT/Claude/Gemini" is not a meaningful statement about perf. There's many different models from each of those providers and there's a considerable gap between the best of anthropic and open ai compared to gemini.

Benchmarks have GLM 5.2 somewhere underneath Sol and Fable and closer to now last-gen openai and anthropic models.

Re: Inkling: Our Open-Weights Model

#142

Post by oehtXRwMkIs » Wed, Jul 15, 2026, 11:12 PM UTC

paxys wrote: post #119

segmondy wrote: post #65

Very nice, multi modal, largest open weight model that supports audio. Would be interesting to see how good the audio capability is. If you want to run locally, checkout https://github.com/danielhanchen/llama.cpp/tree/add-inkling https://unsloth.ai/docs/models/inkling https://huggingface.co/unsloth/inkling-GGUF https://huggingface.co/unsloth/inkling-NVFP4 This supposedly is better than KimiK2.7, as much hype as GLM5.…

Not to mention - it is American. This is the first competitive non-Chinese open weights model since what, Llama 3?

Gemma 4

Re: Inkling: Our Open-Weights Model

#143

Post by jansan » Wed, Jul 15, 2026, 11:14 PM UTC

oehtXRwMkIs wrote: post #142

paxys wrote: post #119

Earlier quoted context omitted.

Not to mention - it is American. This is the first competitive non-Chinese open weights model since what, Llama 3?

Gemma 4

Isn't that British?

Re: Inkling: Our Open-Weights Model

#144

Post by janalsncm » Wed, Jul 15, 2026, 11:14 PM UTC

jjfoooo4 wrote: post #140

gkapur wrote: post #7

Earlier quoted context omitted.

It could be but there are a host of companies going after open weights models: Arcee, Reflection, Llama (TBD on Meta's focus on closed-source versus open-source), etc. That said, the fine-tuning API + open weight model at least is a semblance of a viable business that could work so I will be curious about it. I'm not sure the synergy is fully there (why is someone with an open weights model privelaged to fine-tune it…

I don’t really get the business plan for open weights model companies, is the idea companies would pay them for serving?

From what I can tell it’s a bit of the following.

1. Magic

2. Managed hosting of their model

3. Hurting competitors. If people are using Meta’s commoditized models they’re not paying Google or allowing OpenAI to become too big.

4. Free R&D from open source. If open source developers are optimizing systems to run Llama, that helps Meta.

5. More magic

Re: Inkling: Our Open-Weights Model

#145

Post by ignoramous » Wed, Jul 15, 2026, 11:15 PM UTC

jjfoooo4 wrote: post #140

gkapur wrote: post #7

Earlier quoted context omitted.

It could be but there are a host of companies going after open weights models: Arcee, Reflection, Llama (TBD on Meta's focus on closed-source versus open-source), etc. That said, the fine-tuning API + open weight model at least is a semblance of a viable business that could work so I will be curious about it. I'm not sure the synergy is fully there (why is someone with an open weights model privelaged to fine-tune it…

I don’t really get the business plan for open weights model companies, is the idea companies would pay them for serving?

> don't really get the business plan for open weights model companies

The Chinese "Neijuan" aside, most competing labs are going for the classic, 'your margin is my opportunity': https://tomtunguz.com/is-your-margin-my-opportunity-software... / https://archive.vn/5Vmq3

Re: Inkling: Our Open-Weights Model

#146

Post by wgd » Wed, Jul 15, 2026, 11:38 PM UTC

joshmarlow wrote: post #64

ls_stats wrote: post #2

America needs its own DeepSeek or Z.ai, a lot of people (myself included) root for open chinese models to win because they have no other choice. Thinking Machines might be it.

I don't hear about them a lot but it looks like arcee.ai is aiming to be just that. Here are some of their current open weight offerings: https://www.arcee.ai/open-source-catalog

You don't hear about them much because their models aren't really competitive. I really wanted to try Trinity Large as a daily-driver in the MiniMax M2 sort of niche but I couldn't make it through a single day. The models need another couple point releases worth of post-training to make useful agents and if memory serves they weren't any less slopped in writing style and those are really the only two things people look for in models.

Re: Inkling: Our Open-Weights Model

#147

Post by soundworlds » Wed, Jul 15, 2026, 11:41 PM UTC

ls_stats wrote: post #2

America needs its own DeepSeek or Z.ai, a lot of people (myself included) root for open chinese models to win because they have no other choice. Thinking Machines might be it.

AllenAI is also one to keep your eye on. Founded by Paul Allen of Microsoft, they are one of the best teams working towards truly transparent / open AI (including training data)

Re: Inkling: Our Open-Weights Model

#148

Post by paulsutter » Wed, Jul 15, 2026, 11:43 PM UTC

The most important observation is that open source matches their business model, which is to provide fine tuning services for enterprises, etc.

That what makes this a (potentially) safer model to build on top of

Re: Inkling: Our Open-Weights Model

#149

Post by Topfi » Wed, Jul 15, 2026, 11:45 PM UTC

jansan wrote: post #143

oehtXRwMkIs wrote: post #142

Earlier quoted context omitted.

Gemma 4

Isn't that British?

British-American with much of the research happening in London. I don't know if it's known what team specifically worked on which of the Gemmas, I'd suspect it's a healthy mix of multiple satellites across the globe, but the contribution by the UK Deepmind parts likely was significant, certainly not so small that it'd justify downing a regular question.

Re: Inkling: Our Open-Weights Model

#150

Post by thatoneengineer » Wed, Jul 15, 2026, 11:45 PM UTC

mhluongo wrote: post #43

Interested in the implied strategy - that training a bespoke model for what you need will make economic sense over using a mass-trained model. I wonder if that's true?

Same. Gutsy bet to make in the face of Fable / Mythos, but the multimodal quality is at least a promising technical/ product story to tell. Everyone knows throwing Opus at everything is wasteful and domain expertise should live in the weights eventually; the question is whether foundation model scaling will slow down enough soon enough for that to matter.

Or maybe this is just a warm-up / stopgap and Thinking Machines is betting on finding the next architectural breakthrough that lets it compete with the big foundation models?