Live data from Hacker News

Kubernetes Is Your Private Cloud

oneuptime.com

71–80 of 92 posts

Re: Kubernetes Is Your Private Cloud

#71

Been using Nomad and different sorts of K8S for the last 6+ years at home/work. Nomad is easier to bootstrap, lighter on resources and so so so much easier wrap your head around. Just Nomad + NFS server, from my perspective, is a perfect start for a homelab/small project. You can add complexity to it as you go. It is a real joy work with once you after a day of tinkering. Want to run on windows? Sure. BSD, there is a…

In my experience Nomad is a much better system. People avoid it because they fear vendor lock-in, but the fact that Hashicorp controls it also means that it is well-designed and interoperates easily with other Hashicorp tools.

Re: Kubernetes Is Your Private Cloud

#72

Been using Nomad and different sorts of K8S for the last 6+ years at home/work. Nomad is easier to bootstrap, lighter on resources and so so so much easier wrap your head around. Just Nomad + NFS server, from my perspective, is a perfect start for a homelab/small project. You can add complexity to it as you go. It is a real joy work with once you after a day of tinkering. Want to run on windows? Sure. BSD, there is a…

In my experience Nomad is a much better system. People avoid it because they fear vendor lock-in, but the fact that Hashicorp controls it also means that it is well-designed and interoperates easily with other Hashicorp tools.

People also avoid it because it is a fringe system and there's much more knowledge and tools around Kubernetes.

Re: Kubernetes Is Your Private Cloud

#73
post #51
post #45

Earlier quoted context omitted.

Most products barely need 1 server.

And if you ever outgrow that it's going to be a huge pain. Or a hardware failure. If you start on Kubernetes early you'll be able to add more servers for capacity very easily. Not to mention out of the box you get failover and HA. And you can deploy managed services and have database deployments, or object stores, etc.

But 99% of the time you don't outgrow it and don't have SLA's requiring them to have failover or HA. This is why so many sites can get away with using PostgreSQL with it's complete lack of good/native HA.

Re: Kubernetes Is Your Private Cloud

#74
post #51

Earlier quoted context omitted.

And if you ever outgrow that it's going to be a huge pain. Or a hardware failure. If you start on Kubernetes early you'll be able to add more servers for capacity very easily. Not to mention out of the box you get failover and HA. And you can deploy managed services and have database deployments, or object stores, etc.

But 99% of the time you don't outgrow it and don't have SLA's requiring them to have failover or HA. This is why so many sites can get away with using PostgreSQL with it's complete lack of good/native HA.

You could always run a VM / VPS against a managed DB. Many small cloud / VPS providers, like Digital Ocean or Vultr, also offer managed DB services that are cheaper than AWS RDS.

Re: Kubernetes Is Your Private Cloud

#75
post #51

Earlier quoted context omitted.

And if you ever outgrow that it's going to be a huge pain. Or a hardware failure. If you start on Kubernetes early you'll be able to add more servers for capacity very easily. Not to mention out of the box you get failover and HA. And you can deploy managed services and have database deployments, or object stores, etc.

But 99% of the time you don't outgrow it and don't have SLA's requiring them to have failover or HA. This is why so many sites can get away with using PostgreSQL with it's complete lack of good/native HA.

HA and failover, to me-in these small deploys, is more about hardware maintenance rather than maintaining SLAs. Being able to shutdown the computer hosting your containers to scale vertically.

Re: Kubernetes Is Your Private Cloud

#76
post #10

Kubernetes is powerful, yes. it is also a feckless rats nest of bolt-ons and ride-alongs. its sharepoint levels of byzantine tuning so complex that, like sharepoint, it comes with its own bespoke administrators that often have little or no knowledge of basic networking or operating systems --only kubernetes--. - Upgrading a kubernetes cluster may as well be an olympic sport. its so draconian most best practice docume…

> MetalLB is an option, but your admin doesnt understand subnets let alone BGP Maybe get someone competent then? Why are you tasking running onprem setup someone who doesn’t understand basic networking?

To be fair, BGP is definitely beyond "basic" networking. There is a learning curve.

Re: Kubernetes Is Your Private Cloud

#77
post #72

Earlier quoted context omitted.

In my experience Nomad is a much better system. People avoid it because they fear vendor lock-in, but the fact that Hashicorp controls it also means that it is well-designed and interoperates easily with other Hashicorp tools.

People also avoid it because it is a fringe system and there's much more knowledge and tools around Kubernetes.

You say that like it's a good thing https://www.netlify.com/v3/img/blog/cncf-landscape-map-2020....

Re: Kubernetes Is Your Private Cloud

#78

Earlier quoted context omitted.

> MetalLB is an option, but your admin doesnt understand subnets let alone BGP Maybe get someone competent then? Why are you tasking running onprem setup someone who doesn’t understand basic networking?

To be fair, BGP is definitely beyond "basic" networking. There is a learning curve.

The subset of it you need to grok to setup metallb is in fact pretty basic

Re: Kubernetes Is Your Private Cloud

#79
No, what I need is NixOS, a configuration with a language that's a bit hard to digest but effective, which I can build and read, allowing me to replicate my infrastructure, create custom ISOs etc, in an almost totally automatic and manageable way on domestic hardware at a domestic scale.

What's needed isn't a rambling YAML and immense resource consumption; it's IaC, built-in to the system, that can do what's necessary not for an IT giant that lives off others' services run in-house, but for me, a private citizen with just a few of my own services, little time to manage them, a need to quickly replicate the infrastructure because I don't have infinite data centers, so if the homeserver dies, I need to buy another cheap desktop and set it up, restoring it on the fly. So if I'm offline for a few hours, nothing happens, but hardware costs money, so I need to use it well, and so on.

The giants' solutions are not one-size-fits-all.

Re: Kubernetes Is Your Private Cloud

#80

Earlier quoted context omitted.

To be fair, BGP is definitely beyond "basic" networking. There is a learning curve.

The subset of it you need to grok to setup metallb is in fact pretty basic

I actually do agree. I've setup MetalLB in my home lab and it was super simple. I've doing networking since the 90's though, both professionally and as a hobby where I operate my own AS for fun, so I can see how someone else could be intimidated.
Post reply on HN