Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Running 1000 containers in Docker Swarm

blog.codeship.com

Post reply on HN
Print view View original

1–10 of 37 posts

Re: Running 1000 containers in Docker Swarm

#3

Post by eblanshey »

Does anyone know how easy it is to set up autoscaling with Docker Swarm running on Google Cloud or AWS? We're looking to get starting with Docker Swarm or Kubernetes soon, and are considering using Docker Swarm because of its simplicity and developer familiarity with Docker Compose (we use it for our dev environment). We just want to add nodes to a cluster as traffic spikes and subsides.

Re: Running 1000 containers in Docker Swarm

#6

Post by KenCochrane »

eblanshey wrote: post #3

Does anyone know how easy it is to set up autoscaling with Docker Swarm running on Google Cloud or AWS? We're looking to get starting with Docker Swarm or Kubernetes soon, and are considering using Docker Swarm because of its simplicity and developer familiarity with Docker Compose (we use it for our dev environment). We just want to add nodes to a cluster as traffic spikes and subsides.

Have you looked at Docker for AWS yet? https://www.docker.com/aws

It will setup your swarm, which uses auto scaling groups for the worker nodes. You can then configure the auto scaling groups how ever you want, to scale based on your cloudwatch metrics, etc.

There is also a Docker for GCP product in beta. https://beta.docker.com but I don't know how auto scaling works for it.

Disclaimer: I work at Docker on the Docker for AWS product.

Re: Running 1000 containers in Docker Swarm

#7

Post by kingrolo »

eblanshey wrote: post #3

Does anyone know how easy it is to set up autoscaling with Docker Swarm running on Google Cloud or AWS? We're looking to get starting with Docker Swarm or Kubernetes soon, and are considering using Docker Swarm because of its simplicity and developer familiarity with Docker Compose (we use it for our dev environment). We just want to add nodes to a cluster as traffic spikes and subsides.

Google Container Engine supports cluster autoscaling to automatically add nodes with load. It's listed as a beta feature though.

I've tried most of the Docker orchestration offerings and Container Engine seems by far the nicest. Swarm and Compose are really simple for getting up and running, but when we evaluated them there was still a missing piece required in that there was no neat way to do zero downtime deployments.

There's a tool called Kompose to convert docker-compose config to kubernetes manifests (https://github.com/kubernetes-incubator/kompose) although whilst it's nice to get you started we tend to maintain them separately now.

Re: Running 1000 containers in Docker Swarm

#8

Post by acejam »

xchaotic wrote: post #4

I always wonder, why not isolate on a process level, or even withing a single, multi-threaded app. Sure you can run some sort of web service on hundreds of docker containers or you can run a single, fast web server that scales?

When that single web server goes down, it's not so "fast" anymore.

Re: Running 1000 containers in Docker Swarm

#9

Post by acejam »

eblanshey wrote: post #3

Does anyone know how easy it is to set up autoscaling with Docker Swarm running on Google Cloud or AWS? We're looking to get starting with Docker Swarm or Kubernetes soon, and are considering using Docker Swarm because of its simplicity and developer familiarity with Docker Compose (we use it for our dev environment). We just want to add nodes to a cluster as traffic spikes and subsides.

I suggest looking into Amazon ECS. They have auto scaling features that can trigger based on container-level alerts and thresholds.
Post reply on HN