So, Kubernetes basically won? Nomad and Swarm don't stand a chance, but what about Mesos or DC/OS?
Kubernetes is the Git of container orchestration. It doesn't matter if any other products are better when k8s has, like, 99% of the mindshare!
DigitalOcean Introduces Kubernetes Product
81–90 of 100 posts
Re: DigitalOcean Introduces Kubernetes Product
#82So, Kubernetes basically won? Nomad and Swarm don't stand a chance, but what about Mesos or DC/OS?
Kubernetes is the Git of container orchestration. It doesn't matter if any other products are better when k8s has, like, 99% of the mindshare!
Sigh.
You like BSD? Let the world have Linux.
You like Hg? Let the world have Git.
You like DC/OS? Let the world have Kubernetes.
But they all lost.
Re: DigitalOcean Introduces Kubernetes Product
#83Pricing is key. Right now I spin up GCE based clusters as the head and version migration is free and I only pay for 2 non-preemptible adequate nodes. The rest scale and preempt somewhat cheaply as needed.
Could you please share the details of your setup ? I am not familiar with Google Cloud but being able to scale up cheaply with pre-emptible instances sounds great.
It is just about six commands to create all the pools.
gcloud container clusters create flk1 \
--cluster-version 1.XX? \ #put your version here
--machine-type g1-small \
--disk-size 20 \
--preemptible \
--enable-autoupgrade \
--num-nodes 1 \
--network flk1 \
--scopes storage-rw,compute-rw,monitoring,logging-write
gcloud config set container/cluster flk1
gcloud container clusters get-credentials flk1
gcloud container node-pools create small-pool-p \
--cluster=flk1 \
--machine-type n1-standard-1 \
--disk-size 20 \
--preemptible \
--enable-autoupgrade \
--num-nodes 1
gcloud container node-pools create small-pool \
--cluster=flk1 \
--machine-type n1-standard-1 \
--disk-size 20 \
--enable-autoupgrade \
--num-nodes 2
And then other pools for higher usage nodes.. The smallest cluster I have is about $75/month.
Pre-emptible nodes seem to recover quite well and I always keep at least one container per pod/etc. on the non-pre-emptible just in case.
Re: DigitalOcean Introduces Kubernetes Product
#84This is a great development, but I'll have to wait and see how reliable it actually is. I've had a few droplets running with them over the years, and that has been rock solid (years of uptime on one droplet, no problems whatsoever), but we recently started using Spaces for a commercial product and it has been a catastrophe. There are connectivity issues leaving the service mostly unavailable on a regular basis, and t…
Ditto, droplets are great and stable (and, somewhat surprisingly, CPU-optimized ones seems to perform better on average than the equivalent from AWS). I've tried to make it work with Spaces for the last 6 months (NYC3), but it's just a disaster, I could barely sync the data back to AWS S3 last week (you have to do it from a droplet in the same region, otherwise your chances are close to 0%). Downloading/uploading large objects is perfectly fine, but something's inherently broken at the metadata layer, so listing objects is either ridiculously slow or you get timeouts and weird errors like 'limit rate exceeded'.
TL;DR: droplets are good; avoid Spaces like the plague.
Re: DigitalOcean Introduces Kubernetes Product
#85Earlier quoted context omitted.
That's very interesting, thanks for sharing. $50/mo is a bit for a hobbyist, but not much if you're operating at any serious kind of scale! But I mean, in addition to the StackPoint subscription, you do also pay for the master node droplets when you use it, as well as paying for the worker droplets, right? You won't be paying for those masters anymore with the managed offering, from any of the cloud vendors I've hear…
> But I mean, in addition to the StackPoint subscription, you do also pay for the master node droplets when you use it, as well as paying for the worker droplets, right? Yes, you pay for all of them, but therefor you get full control of the entire cluster. > You won't be paying for those masters anymore with the managed offering, from any of the cloud vendors I've heard of announcing a managed offering. Interesting,…
> > You won't be paying for those masters anymore with the managed offering, from any of the cloud vendors I've heard of announcing a managed offering.
> Interesting, I didn't know about that. Not sure if I prefer this though. Might be another "surface" for the cloud providers to lock you in.
If you want a serious HA-FT kubernetes cluster that is spread across and resilient against failures in a single AZ, and you don't have something like Stackpoint or a managed K8S offering to configure it for you, there is a pretty serious amount of work (and decent number of computers required) in order for you to get your cluster there.
That being said, I don't know how many "hosted, managed" K8S offerings there really are in GA right now to compare.
I'm counting GKE on GCP, AKS on Azure, IBM's new managed k8s offering, AWS/EKS (which is still in preview) and Digital Ocean's offering announced yesterday (which is still pre-beta.) As far as I know, all of those offerings will give you as many masters as you need to make a resilient cluster for free, and you only pay for the workers.
(Except for the offerings that are in preview mode, then I guess you just don't pay for any of it for now...)
> Platform - Certified Kubernetes - Hosted (21)
I guess there are also quite a few I haven't looked at yet. Those are just the platforms with hosted offerings.
https://www.cncf.io/certification/software-conformance/
I personally used kubeadm for my toy-sized single node cluster, and it's great, but I'm also still on 1.5!
Re: DigitalOcean Introduces Kubernetes Product
#86This is a great development, but I'll have to wait and see how reliable it actually is. I've had a few droplets running with them over the years, and that has been rock solid (years of uptime on one droplet, no problems whatsoever), but we recently started using Spaces for a commercial product and it has been a catastrophe. There are connectivity issues leaving the service mostly unavailable on a regular basis, and t…
Yeah, DO Spaces is all around awful. Deleting is extremely slow as well. We had to write special code because DO cannot delete 1000 objects at a time (takes like 2 minutes for the api call to succeed, if it succeeds at all). To the extent that we had to just resort to delete entire buckets. The UI also keep crashing when there are many objects :(
I’ll assume Spaces works like S3 in where updates and deletes are eventually consistent, not immediately consistent:
https://docs.aws.amazon.com/AmazonS3/latest/dev/Introduction...
Re: DigitalOcean Introduces Kubernetes Product
#87This is a great development, but I'll have to wait and see how reliable it actually is. I've had a few droplets running with them over the years, and that has been rock solid (years of uptime on one droplet, no problems whatsoever), but we recently started using Spaces for a commercial product and it has been a catastrophe. There are connectivity issues leaving the service mostly unavailable on a regular basis, and t…
Yeah, DO Spaces is all around awful. Deleting is extremely slow as well. We had to write special code because DO cannot delete 1000 objects at a time (takes like 2 minutes for the api call to succeed, if it succeeds at all). To the extent that we had to just resort to delete entire buckets. The UI also keep crashing when there are many objects :(
I recently had to delete a multi-TB S3 bucket and learned that S3 isn't great at deleting tons of files either. The AWS Console just hangs forever. I let it go for hours before finding another solution.
Re: DigitalOcean Introduces Kubernetes Product
#88Good for them! They beat AWS to it. Amazon's managed Kubernetes service is in the preview stage but should also be launched soon. How do people like Kubernetes as a production ready solution to deploy containers? I've been using Docker for a while now, just starting to mess with k8s.
> Amazon's managed Kubernetes service is in the preview stage but should also be launched soon. Same as DO? "DigitalOcean Kubernetes will be available through an early access program starting in June with general availability planned for later this year." I'm not sure which will be first.
I had originally heard Q2 for public launch of EKS Fargate, but officially Amazon is just saying:
> * AWS Fargate support for Amazon EKS will be available in 2018.
Re: DigitalOcean Introduces Kubernetes Product
#89So, Kubernetes basically won? Nomad and Swarm don't stand a chance, but what about Mesos or DC/OS?
Mesosphere is still a player, but they have also recently added Kubernetes support in DC/OS.