Live data from Hacker News

Kubernetes Is Your Private Cloud

oneuptime.com

21–30 of 92 posts

Re: Kubernetes Is Your Private Cloud

#22
post #9

“Everything You Expect from a Cloud, Running on Your Terms“* Except you own ops, management, extension, interoperability, access, security, scalability, redundancy… words cannot express how ridiculous all of the koober propaganda is

All things people used to own 10 years ago. It’s not like the people doing that stuff have vanished. Cloud’s big promise was speed to market and price, and let’s be honest, price is no longer there compared to a decent operation. The one thing where clouds remain kings is speed for small teams. Any large enough company should probably Ask themselves whether running their own operation using ias would be a better choi…

My company is on prem, spending north of 1 billion per year. Cloud is actually cheaper when considering total cost of ownership. Thats salaries, opex, capex costs. Worse, our speed to delivery is generally worse.

Because on prem is inelastic, we are at sub 10% peak utilization of compute resources. If we added in the likely higher cloud utilization rate we are talking of 30%+ savings from on prem.

Re: Kubernetes Is Your Private Cloud

#24
post #15
post #10

Kubernetes is powerful, yes. it is also a feckless rats nest of bolt-ons and ride-alongs. its sharepoint levels of byzantine tuning so complex that, like sharepoint, it comes with its own bespoke administrators that often have little or no knowledge of basic networking or operating systems --only kubernetes--. - Upgrading a kubernetes cluster may as well be an olympic sport. its so draconian most best practice docume…

I dont have any of this experience. I only have to change the version number and the upgrades roll themselves out. MetalLB is good yes, and admins should have IP knowledge. I ask this in interview questions. Yes, sheep not pets is the term here. Self healing is wonderful. There's plenty to dig into if you run into the same problem repeatedly. Being able to yank a node out that's misbehaving is very nice from a mainte…

Nix manages to be immutable without restarting everything from scratch.

The complaint isn't immutability, the complaint is that k8s does immutability is a broken, way too granular fashion.

Re: Kubernetes Is Your Private Cloud

#25
post #20

“Everything You Expect from a Cloud, Running on Your Terms“* Except you own ops, management, extension, interoperability, access, security, scalability, redundancy… words cannot express how ridiculous all of the koober propaganda is

You have to pick your battles. Most of this stuff isn't necessary to babysit until you're scaling your app tremendously. And by the time you're doing that I'm sure you've got the people to do these things.

And then why would you need koob at all? All that setup and learning on a platform you don't understand and won't need to manage and you will do it wrong, so a completely wasted set of time and money afaict.

Re: Kubernetes Is Your Private Cloud

#26

“Everything You Expect from a Cloud, Running on Your Terms“* Except you own ops, management, extension, interoperability, access, security, scalability, redundancy… words cannot express how ridiculous all of the koober propaganda is

And particularly the upgrades every 3 months. Not just your nodes and masters, but every operator you use, and your manifests each time they deprecate a manifest beta version.

Ive found nomad to be a much simpler replacement for smaller scale deployments.

Re: Kubernetes Is Your Private Cloud

#27
post #9

Earlier quoted context omitted.

All things people used to own 10 years ago. It’s not like the people doing that stuff have vanished. Cloud’s big promise was speed to market and price, and let’s be honest, price is no longer there compared to a decent operation. The one thing where clouds remain kings is speed for small teams. Any large enough company should probably Ask themselves whether running their own operation using ias would be a better choi…

My company is on prem, spending north of 1 billion per year. Cloud is actually cheaper when considering total cost of ownership. Thats salaries, opex, capex costs. Worse, our speed to delivery is generally worse. Because on prem is inelastic, we are at sub 10% peak utilization of compute resources. If we added in the likely higher cloud utilization rate we are talking of 30%+ savings from on prem.

> we are at sub 10% peak utilization of compute resources

so... you bought way too much hardware?

Re: Kubernetes Is Your Private Cloud

#28

Managed Ceph in the past. I cannot comprehend someone putting up with the headache that is Ceph in their home lab. To each their own!

I've used Ceph together with Proxmox VE excessively. No problems whatsoever.

And in related news, Proxmox VE is often probably a more sensible thing to use for a private cloud environment, because it is far more flexible and easier to use than Kubernetes.

Re: Kubernetes Is Your Private Cloud

#29

IMO an article like this shouldn't just make the claim - it should show how to do it at the home lab level.

> it should show how to do it at the home lab level

I dont need to autoscale my home lab...

I want a better UI/DX/Interface than Kubernetes...

I need to be able to do things "by hand" as well as "automated" at home...

There is a reason that I use Proxmox at home. Because it is a joy to work with for the simple needs of my home lab.

Re: Kubernetes Is Your Private Cloud

#30

“Everything You Expect from a Cloud, Running on Your Terms“* Except you own ops, management, extension, interoperability, access, security, scalability, redundancy… words cannot express how ridiculous all of the koober propaganda is

It’s a well known thing that if you run on ec2 they handle all those things for you (especially the security part)
Post reply on HN