Live data from Hacker News

Kubernetes Is Your Private Cloud

oneuptime.com

31–40 of 92 posts

Re: Kubernetes Is Your Private Cloud

#31
post #15

Earlier quoted context omitted.

I dont have any of this experience. I only have to change the version number and the upgrades roll themselves out. MetalLB is good yes, and admins should have IP knowledge. I ask this in interview questions. Yes, sheep not pets is the term here. Self healing is wonderful. There's plenty to dig into if you run into the same problem repeatedly. Being able to yank a node out that's misbehaving is very nice from a mainte…

Nix manages to be immutable without restarting everything from scratch. The complaint isn't immutability, the complaint is that k8s does immutability is a broken, way too granular fashion.

I'm not really clear on the complaint. Is it immutability or not? I'm not saying delete the cluster and start over, I'm saying i can yank a node or destroy a container without (much of) a consequence. Talos is immutable similarly to nix afaik

Re: Kubernetes Is Your Private Cloud

#32
post #25
post #20

Earlier quoted context omitted.

You have to pick your battles. Most of this stuff isn't necessary to babysit until you're scaling your app tremendously. And by the time you're doing that I'm sure you've got the people to do these things.

And then why would you need koob at all? All that setup and learning on a platform you don't understand and won't need to manage and you will do it wrong, so a completely wasted set of time and money afaict.

IMO, there's no alternative private cloud.

Re: Kubernetes Is Your Private Cloud

#34

Managed Ceph in the past. I cannot comprehend someone putting up with the headache that is Ceph in their home lab. To each their own!

as much as i'm glazing k8s in this thread I haven't managed to get ceph working. I wish it too since I dont want to use minio anymore.

Longhorn just kinda worked out of the box though with a couple kernel/system settings. No s3 api though.

But this isn't k8s fault out all.

Re: Kubernetes Is Your Private Cloud

#35
post #10

Kubernetes is powerful, yes. it is also a feckless rats nest of bolt-ons and ride-alongs. its sharepoint levels of byzantine tuning so complex that, like sharepoint, it comes with its own bespoke administrators that often have little or no knowledge of basic networking or operating systems --only kubernetes--. - Upgrading a kubernetes cluster may as well be an olympic sport. its so draconian most best practice docume…

> MetalLB is an option, but your admin doesnt understand subnets let alone BGP

Maybe get someone competent then? Why are you tasking running onprem setup someone who doesn’t understand basic networking?

Re: Kubernetes Is Your Private Cloud

#36
post #9

Earlier quoted context omitted.

All things people used to own 10 years ago. It’s not like the people doing that stuff have vanished. Cloud’s big promise was speed to market and price, and let’s be honest, price is no longer there compared to a decent operation. The one thing where clouds remain kings is speed for small teams. Any large enough company should probably Ask themselves whether running their own operation using ias would be a better choi…

My company is on prem, spending north of 1 billion per year. Cloud is actually cheaper when considering total cost of ownership. Thats salaries, opex, capex costs. Worse, our speed to delivery is generally worse. Because on prem is inelastic, we are at sub 10% peak utilization of compute resources. If we added in the likely higher cloud utilization rate we are talking of 30%+ savings from on prem.

Peak Utilization is a tough one for on prem and is a decent argument for cloud. I was at a company that was also at <10% peak utilization most of the time. It was finance, so it was mostly doing nothing, except for the couple days a year where we shot up 10000x, so we had to build for that case. So yeah losing the data centers, and cloud was a cost savings.

Re: Kubernetes Is Your Private Cloud

#37

IMO an article like this shouldn't just make the claim - it should show how to do it at the home lab level.

> This autonomy is a superpower for small teams. We detailed the financial side of this journey in How moving from AWS to Bare-Metal saved us $230,000 /yr. The cultural unlock has been even bigger.

This doesn't seem to be aimed at homelab but small teams.

Re: Kubernetes Is Your Private Cloud

#39

“Everything You Expect from a Cloud, Running on Your Terms“* Except you own ops, management, extension, interoperability, access, security, scalability, redundancy… words cannot express how ridiculous all of the koober propaganda is

[deleted]

Re: Kubernetes Is Your Private Cloud

#40

“Everything You Expect from a Cloud, Running on Your Terms“* Except you own ops, management, extension, interoperability, access, security, scalability, redundancy… words cannot express how ridiculous all of the koober propaganda is

The way I've described this for years: Kubernetes makes managing 1000 servers as easy as managing 20 servers, and makes managing 3 servers as easy as managing 20 servers.
Post reply on HN