Rolling your own servers with Kubernetes

Post by YawningAngel » Tue, May 07, 2019, 8:10 AM UTC

ljm wrote: post #48

acd wrote: post #42

There is also kubespray Ansible provisioning of Kubernetes, kops and kubeadm. Rolling Kubernetes on your own is quite hard though especially the networking part so there should be a market for a company helping out with provisioning. Using public cloud can be very expensive for some work loads which were not written for the cloud due to higher resource usage. It is still quite hard to forecast cost of the cloud due t…

From my limited experience, you'd save a lot on the cloud if you replaced the default IngressController. Google Cloud, for instance, will spin up a fresh load balancer for every service by default and those cost money. Of course, it's not an easy task as a beginner to use nginx or traefik in its place, and to handle the complexity of that deploy.

Post by darkwater » Tue, May 07, 2019, 8:46 AM UTC

snuxoll wrote: post #142

mlrtime wrote: post #138

Earlier quoted context omitted.

It mostly goes by power not rack units, if you have 48U and only 15amps, you're not going to fill it up. 15A is not a lot.

15A is more than you think these days, still probably need more for a full rack but a modern server can draw around 150W under full load these days. Hell, my entire rack at home hangs around ~.3A during normal usage (2x Dell R210 II's, Dell R320, Dell R520, Lenovo SA120 with 4 bays filled, Juniper EX2200-48T, Mikrotik CRS317).

Post by acjacobson » Tue, May 07, 2019, 9:20 AM UTC

dhruvkar wrote: post #183

latch wrote: post #176

Earlier quoted context omitted.

What seems to often go unsaid in these discussions is that the choice isn't between cloud and colo. There's a third, hugely popular and mature option: dedicated providers - which address all of your issues. It's convenient for cloud vendors to have people believe the choice is between them or having to deal with hardware.

what's an example of a dedicated provider? I also worked in ITOps at a medium-ish company and we were moving our colo to Azure, when I left.

Post by ericd » Tue, May 07, 2019, 10:07 AM UTC

olavgg wrote: post #181

ericd wrote: post #109

Earlier quoted context omitted.

Nice! OT, but have you seen any reasonably priced RJ45 10GBe out there? Preferably without screaming fans :-)

You really do not want RJ45 / 10GBase-T for higher network speeds. They consume A LOT more power and has significantly higher latency than SFP+/SFP28 and fiber cables. I have a Brocade ICX 6450 with 4 10G ports in my homelab, replaced the fan with a whisper silent one. Cannot hear and is right next to me. Brocade ICX 6610 has 16 10G ports and 2 40G ports, not super quiet, but not that noisy either.

Post by dijit » Tue, May 07, 2019, 11:28 AM UTC

dhruvkar wrote: post #183

latch wrote: post #176

Earlier quoted context omitted.

What seems to often go unsaid in these discussions is that the choice isn't between cloud and colo. There's a third, hugely popular and mature option: dedicated providers - which address all of your issues. It's convenient for cloud vendors to have people believe the choice is between them or having to deal with hardware.

what's an example of a dedicated provider? I also worked in ITOps at a medium-ish company and we were moving our colo to Azure, when I left.