I’m planning on doing something similar but want to use Talos with bare metal machines. I suspect to see similar price reductions from our current EKS bill.
I set up a Talos bare metal cluster about a year ago, and documented the whole process on my website. Feel free to reach out if you have any questions!
Kubernetes on Hetzner: cutting my infra bill by 75%
81–90 of 229 posts
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#82I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…
One day it broke because of something to do with certificates (not that it was easy to determine the underlying problem). There was plenty of information online about which incantations were necessary to get it working again, but instead I nuked it from orbit and rebuilt the cluster. From then on I did this every few weeks.
A real kubernetes operator would have tooling in place to automatically upgrade certs and who knows what else. I imagine a company would have to pay such an operator.
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#83Earlier quoted context omitted.
Reading comments from the past few days makes it seem like dealing with Hetzner is a pain (and as far as I can tell, they aren't really that cheaper than the competitors).
What competitors are similar to Hetzner in pricing? Last I checked, they seemed quite a bit cheaper than most.
Wouldn't reccomend any of these outside of personal use though.
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#84I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…
> Determining which option is more cost-effective requires a thorough TCO (Total Cost of Ownership) analysis. While Hetzner may seem cheaper upfront, the additional hours required for DevOps work can offset those savings. Sure, but the TLDR is going to be that if you employ n or more sysadmins, the cost savings will dominate. With 2 Second if you have a "big" cost, whatever it is, bandwidth, disk space (essentially a…
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#85When I worked in web hosting (more than 10 years ago), we would constantly be blackholeing Hetzner IPs due to bad behavior. Same with every other budget/cheap vm provider. For us, it had nothing to do with geo databases, just behavior. You get what you pay for, and all that.
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#86Earlier quoted context omitted.
even free servers are of no use if it’s not usable during a product launch. :) You get what you pay for i guess. But i do agree, it is much cheaper.
To be fair what use is a server if you can’t afford to keep it running. This is especially true for very bootstrapped startups.
But let’s also be honest, if you’re THAT bootstrapped, you probably have no business running kubernetes to begin with. If the company has a short runway, it doesn’t make sense to work on a complex architecture from the start. Focus on shipping something and getting revenue.
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#87The costs of cloud hosting are totally out of control, would love to see more efforts that lets developers move down the stack.
I’ve been humbly working on https://canine.sh which basically provides a Heroku like interface to any K8 cluster
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#88Earlier quoted context omitted.
> Determining which option is more cost-effective requires a thorough TCO (Total Cost of Ownership) analysis. While Hetzner may seem cheaper upfront, the additional hours required for DevOps work can offset those savings. Sure, but the TLDR is going to be that if you employ n or more sysadmins, the cost savings will dominate. With 2 Second if you have a "big" cost, whatever it is, bandwidth, disk space (essentially a…
Not always. Employing Sysadmins doesn't mean Hetzner is cheaper because those "Sysadmin/Ops type people" are being hired to managed the Kubernetes cluster. And Ops type people who truly know Kubernetes are not cheap. Sure, you can get away with legoing some K3S stuff together for a while but one major outage later, and that cost saving might have entirely disappeared.
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#89When I worked in web hosting (more than 10 years ago), we would constantly be blackholeing Hetzner IPs due to bad behavior. Same with every other budget/cheap vm provider. For us, it had nothing to do with geo databases, just behavior. You get what you pay for, and all that.
depending on the prices, maybe a valid strategy would be to have servers at hetzner and then tunnel ingress/egress somewhere more prominent. Maybe adding the network traffic to the calculation still makes financial sense?
Re: Kubernetes on Hetzner: cutting my infra bill by 75%
#90I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…