Live data from Hacker News

Open-weight AI is having its Kubernetes moment

tobi.knaup.me

21–30 of 346 posts

Re: Open-weight AI is having its Kubernetes moment

#21
post #14

Earlier quoted context omitted.

I still don't know what it is tbh. Something for docker?

It's for running a massive number of docker containers and automatically managing them and scaling them up and down on demand. It is also so famously brutally complex that basically you need a dedicated Kube expert to handle it.

to be fair, at any large scale you need infra people.

Re: Open-weight AI is having its Kubernetes moment

#22
post #2

One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything. So what open weight models do is at least provide a baseli…

It's basically supply and demand?

That's not really a full explanation unless you have some idea about why supply or demand are going up and down so much.

Re: Open-weight AI is having its Kubernetes moment

#25
In fact more countries should have government funded models. There are some obvious issues in China completely dominating open weights space. Kimi had funding of just $2B and could literally create national security threat. A lot of countries could fund something in the range of few billion for something so important. At the very least US and EU could fund few companies.

Re: Open-weight AI is having its Kubernetes moment

#26

Earlier quoted context omitted.

I still don't know what it is tbh. Something for docker?

You... don't know what Kubernetes is... pretty impressive, honestly. Its 2026 and its the de facto method of deploying software basically everywhere. You gotta really work for it to not know what its for by now.

I don't do much deployment but I'm in the same boat. Something something docker automation?

Re: Open-weight AI is having its Kubernetes moment

#27

Earlier quoted context omitted.

I still don't know what it is tbh. Something for docker?

You... don't know what Kubernetes is... pretty impressive, honestly. Its 2026 and its the de facto method of deploying software basically everywhere. You gotta really work for it to not know what its for by now.

2026 is the year for vercel and Render.

Re: Open-weight AI is having its Kubernetes moment

#28
post #2

One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything. So what open weight models do is at least provide a baseli…

> if you really want Kimi K2 instead of K3 you can still use it.

I think this is a very important aspect, especially after the huge GPT-4o backlash when GTP-5 came out. Each model has certain quirks, and areas where the previous model might be better for some use cases than the latest and greatest, and the labs so far seem to have no desire to offer some kind of "LTS" release.

Re: Open-weight AI is having its Kubernetes moment

#29
post #10

why would any software want to have Kubernetes moment? can't count how devop I know that is confused by it

I still don't know what it is tbh. Something for docker?

I was in this state a few weeks ago. I spent a bit of time familiarizing myself then wrote up my learnings as a series of exercises.

If you think of docker as "kinda like vms except not really" and k8s as "kinda like deploying and composing docker containers but not really", this may be for you:

https://ojensen.net/infra/understanding-k8s-1

It's actually really neat, i wish i had bothered to learn it years ago.

Re: Open-weight AI is having its Kubernetes moment

#30
post #2

One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything. So what open weight models do is at least provide a baseli…

Why do prescription medications cost so much, and generics so little (comparatively)? Artificial inflation to recoup R&D.

Not sure pricing to recoup costs is artificial.
Post reply on HN