Live data from Hacker News

1000 nodes and beyond: updates to Kubernetes performance and scalability

blog.kubernetes.io

21–30 of 59 posts

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#21
post #2

It's exciting to see that Kubernetes is ready for basically any scale. You're more likely to run out of quota (on your cloud provider, particularly IPs) or some other resource (on-prem) before you can't schedule a container quickly enough. Disclaimer: I work on Compute Engine and chat with the Kubernetes folks a lot.

That resource being money. I'm deploying a fairly simple app on GKE and things go out of hand quickly due to confusing pricing. Or maybe I just don't where to look.

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#22
post #21
post #2

It's exciting to see that Kubernetes is ready for basically any scale. You're more likely to run out of quota (on your cloud provider, particularly IPs) or some other resource (on-prem) before you can't schedule a container quickly enough. Disclaimer: I work on Compute Engine and chat with the Kubernetes folks a lot.

That resource being money. I'm deploying a fairly simple app on GKE and things go out of hand quickly due to confusing pricing. Or maybe I just don't where to look.

Disclaimer: I work at Google on Kubernetes.

Can you say more? Did you just spin up too many nodes?

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#23
post #12

Earlier quoted context omitted.

My 'GCE' reference was to Google Container Engine with Kubernetes as the cluster manager, yes.

Funny story -- Google Container Engine was the obvious name for that product but the TLA for it (GCE) conflicted with Google Compute Engine. We broke the tie by deciding the TLA for Container Engine would be GKE. The 'K' is a nod toward the Kubernetes underpinnings. Google Compute Engine itself was difficult to name. There were those that were pushing for Google Compute Cluster. But I veto'd as the TLA would have bee…

Why not go with Alphabet Cloud, or ABC?

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#24
post #2

It's exciting to see that Kubernetes is ready for basically any scale. You're more likely to run out of quota (on your cloud provider, particularly IPs) or some other resource (on-prem) before you can't schedule a container quickly enough. Disclaimer: I work on Compute Engine and chat with the Kubernetes folks a lot.

You probably meant to disclose that information, not disclaim it. I suppose this is one of those cases like "literally" where persistent misuse will cause the word to be its own opposite, but I keep fighting the annoying fight anyway.

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#25
post #2

It's exciting to see that Kubernetes is ready for basically any scale. You're more likely to run out of quota (on your cloud provider, particularly IPs) or some other resource (on-prem) before you can't schedule a container quickly enough. Disclaimer: I work on Compute Engine and chat with the Kubernetes folks a lot.

You probably meant to disclose that information, not disclaim it. I suppose this is one of those cases like "literally" where persistent misuse will cause the word to be its own opposite, but I keep fighting the annoying fight anyway.

In this case, I meant both (so I chose Disclaimer). The full combo is: I work on Compute Engine (Disclosure!), but I don't actually work on Kubernetes (Disclaimer!) though I do hang out with them (both?).

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#26
post #12

Earlier quoted context omitted.

Funny story -- Google Container Engine was the obvious name for that product but the TLA for it (GCE) conflicted with Google Compute Engine. We broke the tie by deciding the TLA for Container Engine would be GKE. The 'K' is a nod toward the Kubernetes underpinnings. Google Compute Engine itself was difficult to name. There were those that were pushing for Google Compute Cluster. But I veto'd as the TLA would have bee…

Why not go with Alphabet Cloud, or ABC?

Hahaha this is awesome! Unfortunately, Alphabet wasn't a thing back then.

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#27
post #25

Earlier quoted context omitted.

You probably meant to disclose that information, not disclaim it. I suppose this is one of those cases like "literally" where persistent misuse will cause the word to be its own opposite, but I keep fighting the annoying fight anyway.

In this case, I meant both (so I chose Disclaimer). The full combo is: I work on Compute Engine (Disclosure!), but I don't actually work on Kubernetes (Disclaimer!) though I do hang out with them (both?).

Fair enough! People certainly seem to do a lot of disclaiming of their credentials these days so I guess everyone is getting the picture anyway.

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#29
post #3

1.2 has a lot of really nice additions such as infrastructure containers, the new config map API, service draining for node replacements, and many more. Unfortunately I would be running it on AWS and HA still hasn't been worked out and manual setup is a bear.

1.2 includes multi-zone support, so your nodes can be in multiple AZs. This means that a failure of a single zone shouldn't interrupt your apps: http://kubernetes.io/docs/admin/multiple-zones/

What is not yet in 1.2, but is planned for 1.3, is HA Master - so that failure of the zone which contains your master won't interrupt the control plane. (i.e. you will be able to update your apps even as zones are failing).

Re: 1000 nodes and beyond: updates to Kubernetes performance and scalability

#30
post #3

1.2 has a lot of really nice additions such as infrastructure containers, the new config map API, service draining for node replacements, and many more. Unfortunately I would be running it on AWS and HA still hasn't been worked out and manual setup is a bear.

1.2 includes multi-zone support, so your nodes can be in multiple AZs. This means that a failure of a single zone shouldn't interrupt your apps: http://kubernetes.io/docs/admin/multiple-zones/ What is not yet in 1.2, but is planned for 1.3, is HA Master - so that failure of the zone which contains your master won't interrupt the control plane. (i.e. you will be able to update your apps even as zones are failing).

Ah, nice! That wasn't super clear to me but now that you mentioned it, perhaps it should have been.
Post reply on HN