Earlier quoted context omitted.
I still don't know what it is tbh. Something for docker?
It's for running a massive number of docker containers and automatically managing them and scaling them up and down on demand. It is also so famously brutally complex that basically you need a dedicated Kube expert to handle it.
Open-weight AI is having its Kubernetes moment
21–30 of 346 posts
Re: Open-weight AI is having its Kubernetes moment
#22One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything. So what open weight models do is at least provide a baseli…
It's basically supply and demand?
Re: Open-weight AI is having its Kubernetes moment
#23Re: Open-weight AI is having its Kubernetes moment
#24Re: Open-weight AI is having its Kubernetes moment
#25Re: Open-weight AI is having its Kubernetes moment
#26Earlier quoted context omitted.
I still don't know what it is tbh. Something for docker?
You... don't know what Kubernetes is... pretty impressive, honestly. Its 2026 and its the de facto method of deploying software basically everywhere. You gotta really work for it to not know what its for by now.
Re: Open-weight AI is having its Kubernetes moment
#27Earlier quoted context omitted.
I still don't know what it is tbh. Something for docker?
You... don't know what Kubernetes is... pretty impressive, honestly. Its 2026 and its the de facto method of deploying software basically everywhere. You gotta really work for it to not know what its for by now.
Re: Open-weight AI is having its Kubernetes moment
#28One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything. So what open weight models do is at least provide a baseli…
I think this is a very important aspect, especially after the huge GPT-4o backlash when GTP-5 came out. Each model has certain quirks, and areas where the previous model might be better for some use cases than the latest and greatest, and the labs so far seem to have no desire to offer some kind of "LTS" release.
Re: Open-weight AI is having its Kubernetes moment
#29why would any software want to have Kubernetes moment? can't count how devop I know that is confused by it
I still don't know what it is tbh. Something for docker?
If you think of docker as "kinda like vms except not really" and k8s as "kinda like deploying and composing docker containers but not really", this may be for you:
https://ojensen.net/infra/understanding-k8s-1
It's actually really neat, i wish i had bothered to learn it years ago.
Re: Open-weight AI is having its Kubernetes moment
#30One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything. So what open weight models do is at least provide a baseli…
Why do prescription medications cost so much, and generics so little (comparatively)? Artificial inflation to recoup R&D.