why would any software want to have Kubernetes moment? can't count how devop I know that is confused by it
I still don't know what it is tbh. Something for docker?
Open-weight AI is having its Kubernetes moment
11–20 of 346 posts
Re: Open-weight AI is having its Kubernetes moment
#12[flagged]
Re: Open-weight AI is having its Kubernetes moment
#13Re: Open-weight AI is having its Kubernetes moment
#14why would any software want to have Kubernetes moment? can't count how devop I know that is confused by it
I still don't know what it is tbh. Something for docker?
It's for running a massive number of docker containers and automatically managing them and scaling them up and down on demand. It is also so famously brutally complex that basically you need a dedicated Kube expert to handle it.
Re: Open-weight AI is having its Kubernetes moment
#15why would any software want to have Kubernetes moment? can't count how devop I know that is confused by it
I still don't know what it is tbh. Something for docker?
You... don't know what Kubernetes is... pretty impressive, honestly.
Its 2026 and its the de facto method of deploying software basically everywhere.
You gotta really work for it to not know what its for by now.
Re: Open-weight AI is having its Kubernetes moment
#16Is anyone using open weight models for agentic coding?
What is your stack (harness, model) and how much do you pay per month?
How would you compare your experience to a typical subsidized plan like Claude Code + Pro plan?
I’m asking because i keep hearing that open weight models are cheap and efficient - is that really the case in practice?
Re: Open-weight AI is having its Kubernetes moment
#17One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything. So what open weight models do is at least provide a baseli…
Because as per usual it's silicon valley misunderstanding economics. AI is HPC. And how the HPC market worked before:
If you're the best performing "computing cluster" (ie. whatever you call the entity that can complete a massive calculation), you get a blank check from Congress.
Why? Because you need those calculations to "pump" nuclear weapons. They are needed to calculate both the geometry to make fusion bombs possible at all and to calculate the effect of a given geometry. They are the reason US/Russia/China have the biggest and strongest weapons known to humanity. And of course, they were replicated worldwide for this reason. I mean not that anyone will admit this but we don't have the best possible solution, and we don't know either the upper or lower limits for fusion devices (plus the lower limit would be very useful for energy generation, which for the US would effectively mean almost literally unlimited large marine ships that never need refueling. And yes, the solution to that problem is almost literally a 3d shape. Not just that, but mostly)
Now it appears it does not work the same when you democratize computation. Humans want a particular amount of computation and are willing to pay a given price for that. But the accountants still saw the blank check from before and ... do what accountants do. Economics don't change because you make things bigger and accessible, do they? Oh ... wait a second ...
As someone put it recently though, we now have data. 2.3% of humans in the US are willing to pay $20 per month for the support of a model like GPT-5.5/Claude code. If that's true (and after years of having this model, why wouldn't it be?) ... it means AI startups are doomed (because it's not even 10% of what they need it to be to make economic sense).
Re: Open-weight AI is having its Kubernetes moment
#18Earlier quoted context omitted.
I still don't know what it is tbh. Something for docker?
You... don't know what Kubernetes is... pretty impressive, honestly. Its 2026 and its the de facto method of deploying software basically everywhere. You gotta really work for it to not know what its for by now.
> Its 2026 and its the de facto method of deploying software basically everywhere.
That is some really impressive bubble you are living within. Basically everywhere - nowhere near that, no.
[edit]: Maybe containers, but software in general is so much more broad than containers.
Re: Open-weight AI is having its Kubernetes moment
#19Is anyone using open weight models for agentic coding? What is your stack (harness, model) and how much do you pay per month? How would you compare your experience to a typical subsidized plan like Claude Code + Pro plan? I’m asking because i keep hearing that open weight models are cheap and efficient - is that really the case in practice?
I am using GLM-5.2 via Ollama Cloud in the $20/month plan. With the same plan I can get many different API keys that I use to run my OpenWebUI server, my opencode and pi dev sessions. I am usually running 2 to 4 sessions concurrently, and I never hit quota limits. At work I get Claude, and I was getting reports that I was spending $75 per hour of work on Opus.
Re: Open-weight AI is having its Kubernetes moment
#20why would any software want to have Kubernetes moment? can't count how devop I know that is confused by it
Recently my company bought another company, and we kept zero of the original engineers, we just had to run the ghost ship.
We walked in, and it was fine. Because it was all kubernetes and laid out like every other app for the most part.
The kube hate is just sad at this point. You need to know like 15 concepts that are all applied in the same way. It mostly just works.