Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Inkling: Our Open-Weights Model

thinkingmachines.ai

Post reply on HN
Print view View original

301–310 of 324 posts

Re: Inkling: Our Open-Weights Model

#301

Post by rpdillon »

dimgl wrote: post #118
segmondy wrote: post #65

Very nice, multi modal, largest open weight model that supports audio. Would be interesting to see how good the audio capability is. If you want to run locally, checkout https://github.com/danielhanchen/llama.cpp/tree/add-inkling https://unsloth.ai/docs/models/inkling https://huggingface.co/unsloth/inkling-GGUF https://huggingface.co/unsloth/inkling-NVFP4 This supposedly is better than KimiK2.7, as much hype as GLM5.…

What harness do you use for Kimi?

Not OP, but I tend to use Kimi 2.6/7 more than other models, works great with omp.

Re: Inkling: Our Open-Weights Model

#303

Post by juliangoetze »

nullbio wrote: post #296
segmondy wrote: post #65

Very nice, multi modal, largest open weight model that supports audio. Would be interesting to see how good the audio capability is. If you want to run locally, checkout https://github.com/danielhanchen/llama.cpp/tree/add-inkling https://unsloth.ai/docs/models/inkling https://huggingface.co/unsloth/inkling-GGUF https://huggingface.co/unsloth/inkling-NVFP4 This supposedly is better than KimiK2.7, as much hype as GLM5.…

I'm sure it's better than KimiK2.7 and GLM5.2. Benchmarks aren't the full picture. Despite GLM5.2 performing well on benches and supposedly near frontier, in reality it was nothing close to frontier in actual usage.

Have you used Inkling enough to be able to tell? Or how can you be sure? Please add some substance before making such claims

Re: Inkling: Our Open-Weights Model

#304

Post by neo_core »

swiftcoder wrote: post #249
throwaw12 wrote: post #234

Earlier quoted context omitted.

What does it mean, if it is American? Is it censored or will it eventually stop working in Middle Eastern countries? Or is it biased towards powerful political lobby group interests? When weights are open I usually don't care where is it from, as long as it is working for my use cases well

There's a lot of Sinophobia in the tech world, and the AI race seems to be magnifying that. With very little evidence to back it up, I might add - we've had regular releases of quality open-weight models from Chinese firms, and no sign they are more censored/ideological, than, say, Grok

[flagged]

Re: Inkling: Our Open-Weights Model

#305

Post by mark_l_watson »

ascent817 wrote: post #295
mark_l_watson wrote: post #286

Earlier quoted context omitted.

I was blown away by how effective their latest model drop that works with their own coding harness pool is. I tested it extensively with Haskell, Python, and TypeScript for small coding projects. The functionality is good but the inference speed is too slow for most of my work: I would set up a problem, take a walk, then return later to evaluate the results. Note that I have an old mac mini with 32B memory; a fast mo…

Yeah, they’re focused on selling to government and defense contractors. I first encountered poolside at my aerospace internship.

That is a nice business niche, but I would hope that companies might also care about security. There are just a few inference providers who I trust to not save data outside the scope of maintaining inference cache, but I do use untrusted providers sine everything I work on is open source or open content.

Re: Inkling: Our Open-Weights Model

#306

Post by tfehring »

sgt101 wrote: post #251
tfehring wrote: post #160

Earlier quoted context omitted.

Thinky's main commercial product AFAIK is Tinker [0] - companies pay them to host their fine-tuning workloads and then the resulting fine-tuned models. I don't know if this is a good business plan, but I'm sure at least one person there has read Joel on Software [1]. [0] https://thinkingmachines.ai/tinker/ [1] https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/

I don't get this - I can do LORA on my mac... ok I can't do LORA on a 1tn param model, but if I was in the tn parameter model game I would get some kit that I could use to do that... What's their moat / secret sauce?

Like, buy and set up the physical hardware? I cba with that. Plus the hardware you want for LoRA (the type but especially the quantity) is different than what you want for inference, so either you'd under-spec it and wait forever for fine-tuning runs, or over-spec it and have low utilization most of the time. And even then who knows if it would be good enough to LoRA next year's best open source model. AWS gets great margins for renting out commodity hardware as a service because it built the right abstractions and can serve them efficiently at scale, I think the arguments here are basically the same.

Re: Inkling: Our Open-Weights Model

#307

Post by jijji »

AlexCoventry wrote: post #217
jijji wrote: post #85

competition in this space is great, especially with open models/weights. I think the answer is not closed source models. Similar to the Unix versus Linux situation in the 1990's, open source wins out. Yesterdays story about how OpenAI has now began encrypting traffic between model and agent [0], this story brings a breath of fresh air. There is nothing "Open" about hiding the communication between model and agent, es…

Open Source won out because the cost of compute fell through the floor. I'm not sure whether we're going to see a similar dynamic play out this time, although I would greatly prefer it to.

cost of compute, also the less likelyhood of underhanded tactics or vendor lock-in

Re: Inkling: Our Open-Weights Model

#309

Post by Certhas »

alightsoul wrote: post #293
Certhas wrote: post #267

Earlier quoted context omitted.

Here is what Sonnet says on genocide: "Surveys of genocide scholars (e.g., one by the journal Journal of Genocide Research contributors) show meaningful disagreement, though a visible and growing share of specialists in genocide studies specifically have concluded the term applies or is defensible — more so than international law scholars generally, who tend to be more cautious about the intent requirement." You can…

You asked about genocide in general. Not Israeli genocide. Are you astroturfing? No one can make an omission that obvious You can't genuinely argue that the US, for all its problems, is less free than China This is how Americans convince themselves they are at the top of the world when they are not. No one outside of Europe and the US cares about the US anymore. They buy Chinese products and do business with Chinese…

[flagged]

Re: Inkling: Our Open-Weights Model

#310

Post by Saline9515 »

mastermage wrote: post #260
swiftcoder wrote: post #249

Earlier quoted context omitted.

There's a lot of Sinophobia in the tech world, and the AI race seems to be magnifying that. With very little evidence to back it up, I might add - we've had regular releases of quality open-weight models from Chinese firms, and no sign they are more censored/ideological, than, say, Grok

Only actualy censored thing i found so far was Tianmen Square. And depending on what you use it for thats realy not a big issue.

Any discussion about the Chinese Communist Party is censored on Deepseek.
Post reply on HN