Domesticating Kubernetes • Hacker News Board

Re: Domesticating Kubernetes

#51

Post by v77 » Fri, May 01, 2020, 2:04 PM UTC

tuananh wrote: post #50

question: if not k8s, what everyone has been using to orchestrate containers at home? Ideally, I just want something easy to setup, low maintenance cost and easy to backup and restore if sth went wrong. i've been using k8s at work for over 4 years but for home usage, it's just too much.

docker-compose

Re: Domesticating Kubernetes

#52

Post by tuananh » Fri, May 01, 2020, 2:07 PM UTC

v77 wrote: post #51

tuananh wrote: post #50

question: if not k8s, what everyone has been using to orchestrate containers at home? Ideally, I just want something easy to setup, low maintenance cost and easy to backup and restore if sth went wrong. i've been using k8s at work for over 4 years but for home usage, it's just too much.

docker-compose

but docker swarm is kind of dead, isn't it? i need to orchestrate on multiple hosts.

Re: Domesticating Kubernetes

#53

Post by brianwawok » Fri, May 01, 2020, 2:07 PM UTC

StreamBright wrote: post #45

rb808 wrote: post #40

I've given up running my own k8s at home a couple of times. It does seem to be getting easier, but then upgrading and maintaining breaks me again. + the other stuff like running your own container registry. Then with new centos podman breaks everything that worked OK in docker. I hate this stuff, so many problems its worth ignoring the whole stack.

I do not blame you. I try to avoid it as long as it is possible. The amount of time, energy and effort wasted on this is just insane.

Hosted k8s has changed my life. Let me focus on my business and not my infra.

Re: Domesticating Kubernetes

#54

Post by dantheman0207 » Fri, May 01, 2020, 2:12 PM UTC

tuananh wrote: post #50

question: if not k8s, what everyone has been using to orchestrate containers at home? Ideally, I just want something easy to setup, low maintenance cost and easy to backup and restore if sth went wrong. i've been using k8s at work for over 4 years but for home usage, it's just too much.

Nomad

Re: Domesticating Kubernetes

#55

Post by StavrosK » Fri, May 01, 2020, 2:25 PM UTC

tuananh wrote: post #46

rb808 wrote: post #40

I've given up running my own k8s at home a couple of times. It does seem to be getting easier, but then upgrading and maintaining breaks me again. + the other stuff like running your own container registry. Then with new centos podman breaks everything that worked OK in docker. I hate this stuff, so many problems its worth ignoring the whole stack.

what do you end up using instead of k8s?

docker run -d --restart=unless-stopped

Re: Domesticating Kubernetes

#56

Post by emanlin » Fri, May 01, 2020, 2:25 PM UTC

tuananh wrote: post #46

rb808 wrote: post #40

I've given up running my own k8s at home a couple of times. It does seem to be getting easier, but then upgrading and maintaining breaks me again. + the other stuff like running your own container registry. Then with new centos podman breaks everything that worked OK in docker. I hate this stuff, so many problems its worth ignoring the whole stack.

what do you end up using instead of k8s?

Plain old systemd unit files work great. If you really need containers for some reason and love UID and GID mapping then podman in systemd is great.

The only reason I’ve found to run k8s at home is if your full time job is operating k8s at work.

Re: Domesticating Kubernetes

#57

Post by StavrosK » Fri, May 01, 2020, 2:25 PM UTC

tuananh wrote: post #50

question: if not k8s, what everyone has been using to orchestrate containers at home? Ideally, I just want something easy to setup, low maintenance cost and easy to backup and restore if sth went wrong. i've been using k8s at work for over 4 years but for home usage, it's just too much.

http://dokku.viewdocs.io/dokku/

Re: Domesticating Kubernetes

#58

Post by StavrosK » Fri, May 01, 2020, 2:26 PM UTC

dantheman0207 wrote: post #54

tuananh wrote: post #50

question: if not k8s, what everyone has been using to orchestrate containers at home? Ideally, I just want something easy to setup, low maintenance cost and easy to backup and restore if sth went wrong. i've been using k8s at work for over 4 years but for home usage, it's just too much.

Nomad

Can you post a short, high-level overview of how you use Nomad? What does it do for you exactly?

Re: Domesticating Kubernetes

#59

Post by NickBusey » Fri, May 01, 2020, 2:33 PM UTC

tuananh wrote: post #50

question: if not k8s, what everyone has been using to orchestrate containers at home? Ideally, I just want something easy to setup, low maintenance cost and easy to backup and restore if sth went wrong. i've been using k8s at work for over 4 years but for home usage, it's just too much.

HomelabOS

Re: Domesticating Kubernetes

#60

Post by ClumsyPilot » Fri, May 01, 2020, 2:39 PM UTC

sandGorgon wrote: post #3

you can run a kubernetes stack using k3s on a rpi stack within minutes. and it runs far better than all of these. https://blog.alexellis.io/test-drive-k3s-on-raspberry-pi/ here's a live walkthrough - https://www.youtube.com/watch?v=DjpVtNjiXSU

Hello, it's a fine tutorial, but what you stand stand up in minutes is mostly an empty cluster. You still need to deal with exposing your services to the network, etc. That's why I drew the layered diagram, and tried to cover installing what I consider basics services. You have to have them the cluster to be of practical use.

Also, K3S is not just faster - storage solutions don't even work on K3S, or at least i don't see how you can make them work. If you try to install EdgeFS, it's integrated CSI driver requires you to deal with feature gates.