Inkling: Our Open-Weights Model • Hacker News Board

Re: Inkling: Our Open-Weights Model

#191

Post by andy99 » Thu, Jul 16, 2026, 2:05 AM UTC

Topfi wrote: post #152

paxys wrote: post #119

Earlier quoted context omitted.

Not to mention - it is American. This is the first competitive non-Chinese open weights model since what, Llama 3?

North Mini Code by Cohere (HQd in Toronto) has honestly been very competitive in my personal assessment with many of the models coming out of the PRC. I'd position it below Moonshot AIs and Z.ais recent releases, but above the varieties of Qwen, Deepseek, MiMo, etc. Depends whether America the continent or just the United States counts of course.

Interesting, I didn’t know this existed, do you think it’s competitive with Qwen 3.6 35B A3B which seems to be the closest comparator?

It’s 20 vs 32 in favor of Qwen on artificial analysis intelligence index (cohere isn’t benchmarked on the coding index)

Re: Inkling: Our Open-Weights Model

#192

Post by paxys » Thu, Jul 16, 2026, 2:08 AM UTC

gkapur wrote: post #7

ls_stats wrote: post #2

America needs its own DeepSeek or Z.ai, a lot of people (myself included) root for open chinese models to win because they have no other choice. Thinking Machines might be it.

It could be but there are a host of companies going after open weights models: Arcee, Reflection, Llama (TBD on Meta's focus on closed-source versus open-source), etc. That said, the fine-tuning API + open weight model at least is a semblance of a viable business that could work so I will be curious about it. I'm not sure the synergy is fully there (why is someone with an open weights model privelaged to fine-tune it…

Llama is dead. Meta is now releasing proprietary models (Muse Spark).

Re: Inkling: Our Open-Weights Model

#193

Post by JumpCrisscross » Thu, Jul 16, 2026, 2:09 AM UTC

paxys wrote: post #119

segmondy wrote: post #65

Very nice, multi modal, largest open weight model that supports audio. Would be interesting to see how good the audio capability is. If you want to run locally, checkout https://github.com/danielhanchen/llama.cpp/tree/add-inkling https://unsloth.ai/docs/models/inkling https://huggingface.co/unsloth/inkling-GGUF https://huggingface.co/unsloth/inkling-NVFP4 This supposedly is better than KimiK2.7, as much hype as GLM5.…

Not to mention - it is American. This is the first competitive non-Chinese open weights model since what, Llama 3?

> it is American

It's also–hopefully–run by a cooler head. Altman launching a nuke into his own backside with his "stop me before I shoot grandma" routine was at least novel. Dario repeating the same playbook to the same effect years later still genuinely confounds me.

If Thinking Machines pans out I could see it finding a welcome home at Apple.

Re: Inkling: Our Open-Weights Model

#194

Post by calny » Thu, Jul 16, 2026, 2:11 AM UTC

simonw wrote: post #159

Here's a pelican: https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

well it's good they didn't train on the test!

Re: Inkling: Our Open-Weights Model

#195

Post by JumpCrisscross » Thu, Jul 16, 2026, 2:12 AM UTC

jjfoooo4 wrote: post #140

gkapur wrote: post #7

Earlier quoted context omitted.

It could be but there are a host of companies going after open weights models: Arcee, Reflection, Llama (TBD on Meta's focus on closed-source versus open-source), etc. That said, the fine-tuning API + open weight model at least is a semblance of a viable business that could work so I will be curious about it. I'm not sure the synergy is fully there (why is someone with an open weights model privelaged to fine-tune it…

I don’t really get the business plan for open weights model companies, is the idea companies would pay them for serving?

> don’t really get the business plan for open weights model companies

Feature as a company for now. Apple is struggling to build an in-house model set. And plenty of software behemoths, e.g. IBM, are realising they don't have a ticket to the new tech economy.

Re: Inkling: Our Open-Weights Model

#196

Post by jakswa » Thu, Jul 16, 2026, 2:17 AM UTC

inkvi wrote: post #31

Do they have an api to try the model in real envs?

They've got an openai + anthropic compatible endpoints. I got far enough to run some tests on the openai endpoint, albeit with some finagling (their /models list is empty, my tool auto-configures using that, was an initial stumble).

Re: Inkling: Our Open-Weights Model

#197

Post by hattmall » Thu, Jul 16, 2026, 2:18 AM UTC

altmanaltman wrote: post #154

HaloZero wrote: post #136

Earlier quoted context omitted.

I think practically every government will want to put restrictions on private companies building models. Frankly the EU and the US will practically be less involved and have more pushback from the public in this than China. I think that’s less “China bad” than recognizing that China is a more authoritarian state and has far more proclivity to interfere than western states. Maybe I’m wrong? What does deep seek say abo…

https://chat.deepseek.com/share/uf8jih4q95lbq3s8t2 This is what Deepseek replied when I asked it with a burner account. Claims it doesn't have it in its training data... sure.

Be interesting to see if it's possible to jailbreak and have it talk about it.

Re: Inkling: Our Open-Weights Model

#198

Post by mstank » Thu, Jul 16, 2026, 2:25 AM UTC

ls_stats wrote: post #2

America needs its own DeepSeek or Z.ai, a lot of people (myself included) root for open chinese models to win because they have no other choice. Thinking Machines might be it.

Do you think American companies will secretly distill frontier models to build open weight ones?

Re: Inkling: Our Open-Weights Model

#199

Post by NetOpWibby » Thu, Jul 16, 2026, 2:43 AM UTC

ascent817 wrote: post #189

paxys wrote: post #119

Earlier quoted context omitted.

Not to mention - it is American. This is the first competitive non-Chinese open weights model since what, Llama 3?

There's also poolside.ai

I was hoping for some relation to poolside.fm but alas. This looks cool though.

Re: Inkling: Our Open-Weights Model

#200

Post by SilverSlash » Thu, Jul 16, 2026, 2:59 AM UTC

Do you think the barbarians are at the gates of OpenAI and Anthropic? If cheaper, open weights models can seriously take revenue away from those two labs for (frontier - 1) model use cases (which are the models most enterprises will choose) then OpenAI and Anthropic are left only with users using their latest and greatest model AND who will keep upgrading to the newer ones?