Live data from Hacker News

Kubernetes on Hetzner: cutting my infra bill by 75%

bilbof.com

81–90 of 229 posts

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#81

I’m planning on doing something similar but want to use Talos with bare metal machines. I suspect to see similar price reductions from our current EKS bill.

I set up a Talos bare metal cluster about a year ago, and documented the whole process on my website. Feel free to reach out if you have any questions!

Any thoughts/feelings about Talos vs Bottlerocket?

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#82

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

I've never operated a kubernetes cluster except for a toy dev cluster for reproducing support issues.

One day it broke because of something to do with certificates (not that it was easy to determine the underlying problem). There was plenty of information online about which incantations were necessary to get it working again, but instead I nuked it from orbit and rebuilt the cluster. From then on I did this every few weeks.

A real kubernetes operator would have tooling in place to automatically upgrade certs and who knows what else. I imagine a company would have to pay such an operator.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#83
post #49
post #41

Earlier quoted context omitted.

Reading comments from the past few days makes it seem like dealing with Hetzner is a pain (and as far as I can tell, they aren't really that cheaper than the competitors).

What competitors are similar to Hetzner in pricing? Last I checked, they seemed quite a bit cheaper than most.

Forum for cheap hosts:

https://lowendtalk.com/

Wouldn't reccomend any of these outside of personal use though.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#84
post #68

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

> Determining which option is more cost-effective requires a thorough TCO (Total Cost of Ownership) analysis. While Hetzner may seem cheaper upfront, the additional hours required for DevOps work can offset those savings. Sure, but the TLDR is going to be that if you employ n or more sysadmins, the cost savings will dominate. With 2 Second if you have a "big" cost, whatever it is, bandwidth, disk space (essentially a…

Even a short outage can completely wipe out any savings.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#85

When I worked in web hosting (more than 10 years ago), we would constantly be blackholeing Hetzner IPs due to bad behavior. Same with every other budget/cheap vm provider. For us, it had nothing to do with geo databases, just behavior. You get what you pay for, and all that.

AWS tries hard to keep its public IPs from getting on banlists.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#86
post #77

Earlier quoted context omitted.

even free servers are of no use if it’s not usable during a product launch. :) You get what you pay for i guess. But i do agree, it is much cheaper.

To be fair what use is a server if you can’t afford to keep it running. This is especially true for very bootstrapped startups.

We all start somewhere. :) Hetzner can be a good fit for many small companies.

But let’s also be honest, if you’re THAT bootstrapped, you probably have no business running kubernetes to begin with. If the company has a short runway, it doesn’t make sense to work on a complex architecture from the start. Focus on shipping something and getting revenue.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#87
Funnily enough, we made the exact same transition from heroku to DigitalOceans managed Kubernetes service, and saved about 75%. Presumably this means that had we moved from heroku to hetzner, it would have been 93% savings!

The costs of cloud hosting are totally out of control, would love to see more efforts that lets developers move down the stack.

I’ve been humbly working on https://canine.sh which basically provides a Heroku like interface to any K8 cluster

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#88
post #68

Earlier quoted context omitted.

> Determining which option is more cost-effective requires a thorough TCO (Total Cost of Ownership) analysis. While Hetzner may seem cheaper upfront, the additional hours required for DevOps work can offset those savings. Sure, but the TLDR is going to be that if you employ n or more sysadmins, the cost savings will dominate. With 2 Second if you have a "big" cost, whatever it is, bandwidth, disk space (essentially a…

Not always. Employing Sysadmins doesn't mean Hetzner is cheaper because those "Sysadmin/Ops type people" are being hired to managed the Kubernetes cluster. And Ops type people who truly know Kubernetes are not cheap. Sure, you can get away with legoing some K3S stuff together for a while but one major outage later, and that cost saving might have entirely disappeared.

More than that: the more you use, the more discounts you can get from a major CSP, which would also reduce the TCO for using a managed service.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#89

When I worked in web hosting (more than 10 years ago), we would constantly be blackholeing Hetzner IPs due to bad behavior. Same with every other budget/cheap vm provider. For us, it had nothing to do with geo databases, just behavior. You get what you pay for, and all that.

depending on the prices, maybe a valid strategy would be to have servers at hetzner and then tunnel ingress/egress somewhere more prominent. Maybe adding the network traffic to the calculation still makes financial sense?

At 0.02$/GB, it rarely does.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#90

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

Is it just me or do the last 3 paragraphs feel like ChatGPT output?
Post reply on HN