Inkling: Our Open-Weights Model • Hacker News Board

Re: Inkling: Our Open-Weights Model

#111

Post by bellowsgulch » Wed, Jul 15, 2026, 9:34 PM UTC

charcircuit wrote: post #39

firasd wrote: post #36

Earlier quoted context omitted.

Just serving the model over API seems like a natural fit and is what many of them are doing. So simply being the cloud provider for your own open weight model can be a source of revenue

What is the moat? The time it takes for AI to rewrite an efficient inference stack for a new model? Considering most LLMs follow a similar architecture, adapting to a new model shouldn't take that much time.

I don't know why people keep saying there's no moat. There's no moat. Having a FUCK ton of money to train these gigantic fucking models and retain the brains to make it happen is a moat.

You're not going to train one using a VPS from LowEndBox.

Re: Inkling: Our Open-Weights Model

#112

Post by veber-alex » Wed, Jul 15, 2026, 9:35 PM UTC

Your first mission should be providing a working dark mode site.

Holy flashbang.

Re: Inkling: Our Open-Weights Model

#113

Post by 2001zhaozhao » Wed, Jul 15, 2026, 9:35 PM UTC

I really respect the epistemtics work here. It might become an accurate, inexpensive open-weight workhorse for high-level prioritization and decision-making work. (Finance bros will also love this)

Re: Inkling: Our Open-Weights Model

#114

Post by hs86 » Wed, Jul 15, 2026, 9:43 PM UTC

RohoSwagger wrote: post #73

why is this website ai slop

Is it really that bad? I always get the impression that their blog posts look especially beautiful with their font choices and overall design. They are typographically pleasing, and if I could, I would use this as the distraction-free reading mode for every web page.

It feels like I’m reading a newspaper, but oddly, without them resorting to any skeuomorphic tricks.

Re: Inkling: Our Open-Weights Model

#115

Post by christinetyip » Wed, Jul 15, 2026, 9:50 PM UTC

Excited to try out its capability, especially audio and video.

It's nice that it has a long context window, but in practice, I find I always have to clear context btw 150k-400k context even if the context window is 1M on paper.

Re: Inkling: Our Open-Weights Model

#116

Post by chrsw » Wed, Jul 15, 2026, 10:00 PM UTC

bostonvaulter2 wrote: post #63

ls_stats wrote: post #2

America needs its own DeepSeek or Z.ai, a lot of people (myself included) root for open chinese models to win because they have no other choice. Thinking Machines might be it.

What is the business model for an open weight model?

In the US, there isn't one, which is why nobody in the US is currently doing it at frontier scale. And the people that were doing it stopped.

Re: Inkling: Our Open-Weights Model

#117

Post by MikeTheGreat » Wed, Jul 15, 2026, 10:00 PM UTC

tyre wrote: post #86

ergocoder wrote: post #76

Earlier quoted context omitted.

The same business model that Deepseek is using. Open-source models + services. This is more attractive because it doesn't lock in the vendors. If I grow larger, I can decide to deploy the open-source models.

So they're constantly hemorrhaging their most valuable clients? Tech history is littered with the corpses of "open source but we sell hosting" services. Models are so expensive to train, you can't be losing the big clients once they get super profitable.

This is genuine, noob question: how is this different from AWS?

I get that they're in very different businesses, but for both don't they have the issue that once a client gets big enough the client might decide to move the services in-house? Based on how much of the internet went down when that AWS data center crashed the answer is clearly "No" for AWS.

Is that because of physical, real-world infrastructure? Are there no open versions of their APIs? Is it too hard to migrate to something else once a client has achieved that size?

Re: Inkling: Our Open-Weights Model

#118

Post by dimgl » Wed, Jul 15, 2026, 10:01 PM UTC

segmondy wrote: post #65

Very nice, multi modal, largest open weight model that supports audio. Would be interesting to see how good the audio capability is. If you want to run locally, checkout https://github.com/danielhanchen/llama.cpp/tree/add-inkling https://unsloth.ai/docs/models/inkling https://huggingface.co/unsloth/inkling-GGUF https://huggingface.co/unsloth/inkling-NVFP4 This supposedly is better than KimiK2.7, as much hype as GLM5.…

What harness do you use for Kimi?

Re: Inkling: Our Open-Weights Model

#119

Post by paxys » Wed, Jul 15, 2026, 10:01 PM UTC

segmondy wrote: post #65

Very nice, multi modal, largest open weight model that supports audio. Would be interesting to see how good the audio capability is. If you want to run locally, checkout https://github.com/danielhanchen/llama.cpp/tree/add-inkling https://unsloth.ai/docs/models/inkling https://huggingface.co/unsloth/inkling-GGUF https://huggingface.co/unsloth/inkling-NVFP4 This supposedly is better than KimiK2.7, as much hype as GLM5.…

Not to mention - it is American. This is the first competitive non-Chinese open weights model since what, Llama 3?

Re: Inkling: Our Open-Weights Model

#120

Post by figomore » Wed, Jul 15, 2026, 10:12 PM UTC

Splatoon LLM