Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Running Nomad for a Home Server

mrkaran.dev

Post reply on HN
Print view View original

31–40 of 153 posts

Re: Running Nomad for a Home Server

#31

Post by znpy »

outime wrote: post #3

The biggest problem with these posts is that authors seem to fail to see how K8s isn't targeting home servers or small companies. Sure, there's K3s which allows you to have a more minimalistic experience but it's still K8s. K8s is enterprise stuff and should be seen as such. It's complex because the problems that are being attempted to solve are complex and varied. That doesn't discount that Nomad is a great piece of…

> The biggest problem with these posts is that authors seem to fail to see how K8s isn't targeting home servers or small companies.

Indeed.

On the same bus one should be reading posts like "how I switched to a minivan for my family and dropped the complexity of enterprise-grade multi-carriage trains".

Re: Running Nomad for a Home Server

#32

Post by 3np »

bithavoc wrote: post #2

Nomad is good at running all sort of workloads, not just container workloads. Also there is a plugin[0] to run containers without docker so Nomad is headed in the right direction for scenarios where you only need a scheduler. [0] https://github.com/Roblox/nomad-driver-containerd

Nomad already has a first-party driver for podman, doesn't that do it?

Re: Running Nomad for a Home Server

#33

Post by sofixa »

outime wrote: post #7
flyinprogrammer wrote: post #5

Earlier quoted context omitted.

Nomad's support for CNI and CSI is improving with just about every release, and they just proved you can run over 2 million containers in a globally distributed cluster. https://www.hashicorp.com/blog/hashicorp-nomad-meets-the-2-m... So what's an example of "enterprise" and "complex" problems you think it can't do?

K8s targets a long list of things that Nomad just doesn't want to deal with in the name of simplicity - and that's ok, if that suits your use case. Some are mentioned in the post but I can think of secret management, load balancing, config management, routing, orchestration beyond workloads (e.g. storage), rollbacks/rollouts and many more. Perhaps in few areas there are some support but it's not what Nomad intends to…

> of secret management, load balancing, config management, routing, orchestration beyond workloads (e.g. storage), rollbacks/rollouts

Nomad does all of these either natively ( rollbacks/rollouts) or via external tooling ( Vault, Consul, a load balancer). Unix philosophy and all that, and besides, Kubernetes doesn't do load balancing, and secret management is a joke.

Re: Running Nomad for a Home Server

#34

Post by RulerOf »

chrizel wrote: post #20
parhamn wrote: post #9

Hashicorp has very cool stuff but I am not a fan of the config language they use on all their projects. It’s fine when I’m in an infrastructure type role and recency recall is fine but when Hashicorps tools are in my periphery it is a pain. Anyone share this? I guess the alternative is templated tomls/yamls/pseudo-jsons. Wish we’d all agree to one templated configuration format.

I myself would love to see more usage of HCL... after writing a lot of Terraform configurations, it feels so much nicer for me than any JSON or YAML/Helm configuration I have written to this day. We should agree on some kind of HCL-based industry standard and leave all these workarounds via JSON/YAML behind us... e.g. doing Helm logic with these Go templates just looks like a step backwards after writing Terraform HC…

The thing I dislike about YAML is how unwieldy it gets and how quickly that happens. "Simple" YAML files tend to be half a dozen pages long.

HCL is more information-dense.

Re: Running Nomad for a Home Server

#36

Post by zomglings »

From the article: > I always maintain "Day 0 is easy, Day N is the real test of your skills".

Would be interesting to see how this applies to the author's use of Nomad. It's easy to shit on Kubernetes because of its complexity, but this article seems to be comparing the Nomad Day 0 experience with the Kubenrnetes Day N experience.

I'm firmly of the opinion that you don't need much more than systemd (or equivalent) + SSH for your home server.

Re: Running Nomad for a Home Server

#37

Post by marvinblum »

3np wrote: post #29

We moved from k8s to Nomad at my workplace, and I'm currently running almost all my self-hosted software on a 10-node Nomad cluster (with Consul and Vault) as well. The servers for each of the three gives plenty of headroom resource-wise when run on any recentish arm64 SBC, so you can get an HA cluster for not expensive. If you integrate properly with them (which does take quite a bit of work with the ACL policies an…

I'm running a Traefik instance on each node, so that I can expose a service by adding a bunch of labels. The load balancer is not part of the cluster and routes the traffic to the nodes. You might want to consider that too :)

Re: Running Nomad for a Home Server

#38

Post by omneity »

We're using Nomad to power several clusters at Monitoro[0].

We're a super small team and I have to say our experience operating Nomad in production has been extremely pleasant - we're big fans of Hashicorp's engineering and the quality of their official docs.

Our biggest gripe is the lack of managed Nomad offerings such as GKE (on google cloud). However once things are set up and running it requires minimal to no maintenance.

I also run it locally for all sorts of services with a very similar experience.

As another comment mentioned, it's more of a better / distributed scheduler such as systemd. The ecosystem of tools around it is the cherry on top (terraform, consul, fabio ...)

[0]: https://monitoro.xyz

Re: Running Nomad for a Home Server

#39

Post by RulerOf »

alias_neo wrote: post #18
parhamn wrote: post #9

Hashicorp has very cool stuff but I am not a fan of the config language they use on all their projects. It’s fine when I’m in an infrastructure type role and recency recall is fine but when Hashicorps tools are in my periphery it is a pain. Anyone share this? I guess the alternative is templated tomls/yamls/pseudo-jsons. Wish we’d all agree to one templated configuration format.

I find it particularly hard to manage Vault from the CLI. I deployed it some time ago and set up a bunch of backends, I don't recall the names of things or how I configured them and I want to backup that config to replicate it. The auto complete will give you the top level command and that's it. I haven't looked too hard because I got fed up, but i just want to dump the entire config so I can replicate it without hav…

I've been there. You basically want to be able `cd` into vault and list the contents interactively, but you can't.

While the Web UI is probably the best vault explorer available, you might want to take a look at Vaku[1].

[1]: https://github.com/lingrino/vaku/blob/main/docs/cli/vaku.md#...

Re: Running Nomad for a Home Server

#40

Post by ericbarrett »

omneity wrote: post #38

We're using Nomad to power several clusters at Monitoro[0]. We're a super small team and I have to say our experience operating Nomad in production has been extremely pleasant - we're big fans of Hashicorp's engineering and the quality of their official docs. Our biggest gripe is the lack of managed Nomad offerings such as GKE (on google cloud). However once things are set up and running it requires minimal to no mai…

The selling point of GKE etc. is “minimal to no maintenance,” but of course somebody else is doing the maintenance and the customer is paying a premium for it. Says great things about Nomad.
Post reply on HN