Live data from Hacker News

Learning to operate Kubernetes reliably

stripe.com

91–100 of 102 posts

Re: Learning to operate Kubernetes reliably

#91

Much as it burns me to admit this, for this usecase, jenkins is king. At previous job, we had migrated from a nasty cron orchestration system to jenkins. It did a number of things including building software, batch generating thumbnails and moving data about on around 30 nodes, of which about 25 were fungible. Jenkins job builder meant that everything was defined in yaml, stored in git and was repeatable. A sane user…

Depends on the nature of the cronjobs you're scheduling. If your cronjobs cannot run in parallel on the same node (or, more likely, you cannot trust that they can safely run in parallel on the same node, because somebody else wrote the job and didn't need your review or approval before deploying to the scheduler), then you need to restrict each Jenkins node to a single executor, and you cannot run more cronjobs in parallel than you have Jenkins nodes, or else those cronjobs will be delayed. Because Kubernetes enforces the use of containers, multiple jobs can be run on each Kubernetes node with no issues (by design).

Remember - if there's a one in a million chance of a collision, it'll happen by next Tuesday.

Re: Learning to operate Kubernetes reliably

#92
post #46

What is the benefit of using Kubernetes over Mesos (or in conjunction with Mesos)?

FTFA: "We’d previously been using Chronos (with Mesos) as a cron job scheduling system, but it was no longer meeting our reliability requirements and it’s mostly unmaintained (1 commit in the last 9 months, and the last time a pull request was merged was March 2016) Because Chronos is unmaintained, we decided it wasn’t worth continuing to invest in improving our existing cluster." Though Chronos has a release recentl…

Take a look at the Mesos releases, a lot of progress is being made and and the project is well maintained. Where are you getting this misinformation?

Re: Learning to operate Kubernetes reliably

#93
post #55
post #51

Earlier quoted context omitted.

Chronos is just an example. There're many bugs in Mesos that don't get fixed for months/years. Mesos core is legacy (pre 11) C++ code nobody wants to maintain.

> Mesos core is legacy (pre 11) C++ code nobody wants to maintain. This is actually very very VERY important. Go is a lot more concise (IMO) that C++, generally when I'm curious about how something works in a project written in Go, its much easier to follow the logic.

There's something to be said about how the code is written. I've seen easy to read C++ and hard to read go (I found go's built in http server source code to be a tough read) and vice versa. In Mesos we strive to write very readable code and so I would hope that despite being modern C++, it is approachable for an uninitiated reader.

Re: Learning to operate Kubernetes reliably

#94
post #85

Earlier quoted context omitted.

I don't see why - I have my GCE cluster running fine with zero maintenance work.

Zero maintenance work implies you are not doing security patches or upgrades, so as soon as you have a problem, not only will you be left holding the now broken pieces, nobody will have any reason to help or support you, unless you pay them $$$$$$'s(and even then.... maybe not). I hope whatever you are running under k8s isn't crucial or important, and I really hope I'm not a customer of whatever you "operate". Mainte…

have you ever used google hosted k8s?

I am a 1 man shop. I manage my cluster in ~10 minutes per month.

Re: Learning to operate Kubernetes reliably

#95
post #85

Earlier quoted context omitted.

Zero maintenance work implies you are not doing security patches or upgrades, so as soon as you have a problem, not only will you be left holding the now broken pieces, nobody will have any reason to help or support you, unless you pay them $$$$$$'s(and even then.... maybe not). I hope whatever you are running under k8s isn't crucial or important, and I really hope I'm not a customer of whatever you "operate". Mainte…

GCE is a hosted k8s. Google does the maintenance for you, to my understanding.

AH! sorry. I didn't realize Google started offering hosted k8s.. That def. keeps maintenance down, since Google does it for you. It's been a while since I've dug into k8s in depth.

Re: Learning to operate Kubernetes reliably

#96
post #85

Earlier quoted context omitted.

Zero maintenance work implies you are not doing security patches or upgrades, so as soon as you have a problem, not only will you be left holding the now broken pieces, nobody will have any reason to help or support you, unless you pay them $$$$$$'s(and even then.... maybe not). I hope whatever you are running under k8s isn't crucial or important, and I really hope I'm not a customer of whatever you "operate". Mainte…

have you ever used google hosted k8s? I am a 1 man shop. I manage my cluster in ~10 minutes per month.

AH! sorry. I didn't realize Google started offering hosted k8s.. That def. keeps maintenance down, since Google does it for you. It's been a while since I've dug into k8s in depth.

Re: Learning to operate Kubernetes reliably

#97
post #95

Earlier quoted context omitted.

GCE is a hosted k8s. Google does the maintenance for you, to my understanding.

AH! sorry. I didn't realize Google started offering hosted k8s.. That def. keeps maintenance down, since Google does it for you. It's been a while since I've dug into k8s in depth.

Google, Amazon, Microsoft and IBM all offer managed kubernetes.

Re: Learning to operate Kubernetes reliably

#98
post #96

Earlier quoted context omitted.

have you ever used google hosted k8s? I am a 1 man shop. I manage my cluster in ~10 minutes per month.

AH! sorry. I didn't realize Google started offering hosted k8s.. That def. keeps maintenance down, since Google does it for you. It's been a while since I've dug into k8s in depth.

Has to be a good year or so? Been a while.

AWS is the new one, just started a few weeks ago.

Re: Learning to operate Kubernetes reliably

#99
post #96

Earlier quoted context omitted.

AH! sorry. I didn't realize Google started offering hosted k8s.. That def. keeps maintenance down, since Google does it for you. It's been a while since I've dug into k8s in depth.

Has to be a good year or so? Been a while. AWS is the new one, just started a few weeks ago.

My systems are all on physical hardware we own, hence I don't really pay a lot of attention to the latest and spiffiest in hosted platforms.

Re: Learning to operate Kubernetes reliably

#100
post #95

Earlier quoted context omitted.

AH! sorry. I didn't realize Google started offering hosted k8s.. That def. keeps maintenance down, since Google does it for you. It's been a while since I've dug into k8s in depth.

Google, Amazon, Microsoft and IBM all offer managed kubernetes.

Cool. This definitely makes it easier to use k8s, but that's very different from running k8s. My comment(s) are geared about running k8s yourself. My systems are all on physical hardware we own, hence I don't really pay a lot of attention to the latest and spiffiest in hosted platforms.
Post reply on HN