Having a RaspberryPi laying idle in a drawer somewhere, I wonder if others have installed microk8s or k3s on it. What kind of workloads are you running on it? Whoever has OpenFaas installed on your rpi, what type of functions are you running?
I mostly gave up on containers on Pis due to the overhead (disk space, deployment hassles with private registries, etc.). Built my own mini-Heroku and run all my services/functions there: https://github.com/piku
MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
41–50 of 138 posts
Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#42Plain k8s has a fearsome reputation as being complex to deploy, which I don't think is quite deserved. It isn't totally straightforward, but the documentation does tend to make it sound a bit worse than it actually is. I run a couple of small clusters and my Ansible script for installing them is pretty much: * Set up the base system. Set up firewall. Add k8s repo. Keep back kubelet & kubeadm. * Install and configure…
I haven't done a manual deployment since. I hope it got significantly better and I may be an idiot but the reputation isn't fully undeserved.
The problem back then was also that this was usually the first thing you had to do to try it out. Doing a complicated deployment without knowing much about it doesn't make it any easier.
Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#43Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#44Another vote for K3s. Easy to set up on a Pi cluster. Pity Istio doesn’t offer an ARM build
- istio SC member
Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#45Earlier quoted context omitted.
I thought minikibe would not cluster multiple machine ?
Yes, it seems not possibile. You can EMULATE a multi mode cluster but inside a big host machine. Minikube is very effective on my huble opinion to STUDY K8s becauese it is always strong aligned with K8s releases. I do not think minikube is a good choice for production but hey, I could be wrong... someone want to share any experience?
Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#46Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#47Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#48After shipping a number of MQTT backends for deployments of few million devices each, I'd say the most troublesome part was getting the anycast network setup, uplinks, routing, and getting the "messaging CDN" second to it.
It's very hard to do without having an own ASN in which you have complete freedom.
Even in the case of 8 million shipped units fire/burglary alarm client, with ~4M constantly on units, which all have to send frequent pings to signal that they are online, I haven't seen any need in any kind of sophisticated clustering.
Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#49Earlier quoted context omitted.
Sure, if it works, upgrades are somewhat fraught though (I mean, upgrading a 20 node cluster is an hour long ansible run, or it was when we were using it) We switched to rke, it’s much better.
An hour to upgrade a 20 node cluster doesn't seem unreasonable for me - when you are doing a graceful upgrade that includes moving workloads between nodes. I don't know anything about rke. Might be interesting but it seems different enough from upstream Kubernetes that you have to learn new things. Seems to me a bit similar to Openshift 4 where the cluster manages the underlying machines.
Re: MicroK8s – Low-ops, minimal Kubernetes, for cloud, clusters, Edge and IoT
#50How is persistent storage handled on microk8s (or k3s)?