These costs are highly inflated. Not sure why you need 4 people to operate a small 6 node cluster. From my own personal experience, one guy can do that part time. Your cluster has redundancy, so most problems can wait to be dealt with during regular hours.
As a counterpoint from my own personal experience, time spent managing kubernetes is time NOT spent introducing new features. I once had the displeasure of watching an upstart data science team at a boutique portfolio management firm break under the weight of k8s management. The team was great at critical thinking, risk-modeling, and statistical analysis. They knew very little about infrastructure, such as networking…
The True Cost of Kubernetes: People, Time and Productivity
21–23 of 23 posts
Re: The True Cost of Kubernetes: People, Time and Productivity
#22I agree that almost nothing in the article is realistic, even if I have reached a similar conclusion in different ways.
- Kubernetes is easy if you run a big number of stateless applications.There are easier ways to do that in the cloud thought. I like the pattern of running the database in whatever way the DBA is used to (probably in a VM in which they ssh/RDP into).
- Kubernetes is great if you deploy your product for clients in different clouds. You tell them we need a k8s cluster of API version XYZ and their staff provision one for you. That way you can support Azure, GCP, Oracle and AWS without having to learn many of their APIs. That abstraction is leaky, hopefully your clients can setup the ingress controllers and storage correctly.
- If you are running your app for your own org in the cloud and you don't intend to move, you probably don't need the extra layers of complexity. Running managed k8s is a cloud API over a cloud API.
- If you don't run anything stateful in kubernetes its much easier - there is plenty of SaaS you can use, for example: RDS for DB, Datadog for monitoring, email providers, managed redis. Use kubernetes only for code you've written and understand it's behaviour. Don't be tempted to many things with helm, just the bare essentials.
- Kubernetes is great if you are a really large organization, because if you standardise on it you standardise infrastructurele, and you can move engineers between projects. And can have an ops silo again! /s
- If you are a big org with a DevOps team, you can create a custom Paas over kubernetes. I.e. when a dev runs make deploy staging1 that actually wraps kubectl and magically builds,tests and deploys the current code.
Re: The True Cost of Kubernetes: People, Time and Productivity
#23Most clients I encounter have more need to be able to dynamically run their workloads than the problem that it costs to administer their clusters. Tools like crossplane, argo and a lot of other make it simple to - almost - run your clusters on autopilot.
Kubernetes is not cheap, but being your "own hoster" never really was, but i can tell you what is going to be expensive for you: vendor lockin by a none open source service and also putting all of your eggs into one basket. Even if that basket claims to have servers internationally.
Just look what happened whith the creation of the cluster API, we are moving into a future where all you need to truly autopilot your workloads is a little bit of . I just dont get that in a time where everything can easily be automated from your code commit, over testing, to canary deployments and rollbacks, with a community that delivers top of the line code on a constant basis, for free, could even be compared to what i would consider more or less shared hosting.
Stating that you need a 4 person Devops team for a 6 node cluster is just sad. Also you seem to be replacing your nodes anually too so that makes extra sense =)
I get that you like to market your product, but as someone doing freelance devops for while now, please dont be ridiculous.