Live data from Hacker News

Kubernetes Failure Stories

k8s.af

201–203 of 203 posts

Re: Kubernetes Failure Stories

#201
post #141

Earlier quoted context omitted.

So, as as a serious answer, yes. The problem isn't deployments, it's that k8s doesn't only do deployments. It does a ton of stuff, and deployments are a small part of it. If you only wanted to use k8s for deploying your code, well, you can't. That's what's was great with the UNIX programs philosophy, and what is lost in kubernetes. You can't pick the feature you need, and the feature you want may well break because o…

What is the unnecessary part, in your opinion? I think the core is very good. You need a pool of machines, you need to be able to schedule workloads, you need the workloads to be able to talk to each other over the network, you need the cluster to reach a consensus about what state it's in, etc. That is complicated, but basically mandatory. Intrinsically, I think you take on a lot of problems by increasing the number…

> You need a pool of machines, you need to be able to schedule workloads, you need the workloads to be able to talk to each other over the network, you need the cluster to reach a consensus about what state it's in

Well, no ? I need to be able to start an app, and when that app says 'I'm ready to run', shutdown the old version. So a the extreme version, I'd just need to ensure all my apps have 2 open endpoint for "readiness" and "kill", and one way to register themselves in some kind of central db of "what's running". That's it, that's an automated deployment solution. Of course, it doesn't really do a lot, but done well, it would be something already !

I don't need a pool of machines, or at least that's not the matter for a "deployment solution".

I don't need scheduling, and I certainly don't want something to interfere with how I handle network in my app.

I don't say that all of this isn't good or often needed, but it's not atomic to the need of "deploying an app".

And then the problem arises that the feature set of k8s that is neither complete wrt some utopic "ultimate end all solution" (because realistically, it can't be), nor atomic at all on what it does. And solutions like k8s end up somewhere in the middle, never finished, always updating, and well, complicated !

Re: Kubernetes Failure Stories

#202

Earlier quoted context omitted.

The first one, but I'm trying not to divulge too many details on the architecture of Amazon - as you can imagine.

Fascinating because I would have thought the whole idea is AWS is dog-fooded by retail. Yet in truth AWS is itself too expensive and / or complex for Amazon itself! (Or at least the original part of it.)

The majority of retail is dog-fooding AWS, but a lot of code was written before AWS existed or before it provided many of the required services.

Re: Kubernetes Failure Stories

#203

Oh good lord, I'm in the middle of one of these right now. My team runs a fair number of K8s clusters, mostly on Azure AKS. Of the pods in our clusters, a few talk to the AKS API server for their cluster. Those pods that do, will, occasionally, lose contact with the API server. API calls will start timing out. It'll usually resolve on its own after some time, but then come back later. It's somewhat affected by load.…

I am also losing nodes, I am guessing the K8s control panel changes DNS and the kubelet does not reconnect (Go/http2)
Post reply on HN