[dead]
Inkling: Our Open-Weights Model
11–20 of 324 posts
Re: Inkling: Our Open-Weights Model
#12If it's ~30% bigger and not as good as GLM 5.2, why would I tinker with this model? Maybe for the multi modal?
> If it's ~30% bigger and not as good as GLM 5.2, why would I tinker with this model?
The benchmarks never tell the full story. Some of the open weights models have been benchmaxxed for a while. Their utility on real work can be different than the benchmark number.
The multimodal input is also a big deal. Having vision input is really helpful for a lot of tasks.
Re: Inkling: Our Open-Weights Model
#13They also indicate they have a 276B A12B version, but it doesn't seem the weights are available. This might actually be able to fit in 128GB when quantized to 2 bits or so which makes it interesting.
Re: Inkling: Our Open-Weights Model
#14If it's ~30% bigger and not as good as GLM 5.2, why would I tinker with this model? Maybe for the multi modal?
There's also an Inkling-Small that is 276B, 12B active that is much smaller than GLM 5.2 and still multimodal. Not released yet, but in the announcement link they mention that they're testing Inkling-Small & will release as open weight after testing. That one may be interesting as a Deepseek V4 Flash replacement.
Re: Inkling: Our Open-Weights Model
#15The Artifical Analysis has a link on their homepage but it 404's :/
Re: Inkling: Our Open-Weights Model
#16Cool, now we just need the GPU that supports it
Re: Inkling: Our Open-Weights Model
#17They also indicate they have a 276B A12B version, but it doesn't seem the weights are available. This might actually be able to fit in 128GB when quantized to 2 bits or so which makes it interesting.
They mention in the announcement link https://thinkingmachines.ai/news/introducing-inkling/ that they are still testing Inkling-Small and it will also still be multimodal. This makes it super interesting as a Deepseek V4 Flash replacement (and would be interesting with DwarfStar / ds4 if it gets supported).
Re: Inkling: Our Open-Weights Model
#18I never thought i'd see the day they released a model, rather than a blog post. The Figure 3 demo being a screencap of chrome in localhost made me feel better about myself. Jokes aside, best western open weights model- very cool.
They are one of the few labs (perhaps even the only one at this level) that are doing something both unique and useful, rather than simply imitating what the others are doing: https://thinkingmachines.ai/blog/interaction-models/
Re: Inkling: Our Open-Weights Model
#19For the most part it’s better than Nemotron, worse than GLM. This makes it the best American open weights model from what I can tell?
Re: Inkling: Our Open-Weights Model
#20If it's ~30% bigger and not as good as GLM 5.2, why would I tinker with this model? Maybe for the multi modal?
> If it's ~30% bigger and not as good as GLM 5.2, why would I tinker with this model? The benchmarks never tell the full story. Some of the open weights models have been benchmaxxed for a while. Their utility on real work can be different than the benchmark number. The multimodal input is also a big deal. Having vision input is really helpful for a lot of tasks.
Then why are they publishing the benchmarks which makes them look worse than GLM 5.2?