Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kubernetes on Hetzner: cutting my infra bill by 75%

bilbof.com

Post reply on HN
Print view View original

61–70 of 229 posts

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#61

Post by chipdart »

juiyhtybr wrote: post #27
ffsm8 wrote: post #23

Earlier quoted context omitted.

And if you wanna be lazy, there is a tailscale integration to run the cluster communication over it. https://tailscale.com/kb/1236/kubernetes-operator They've even improved it, so you can now actually resolve the services etc via the tailnet dns https://tailscale.com/learn/managing-access-to-kubernetes-wi... I haven't tried that second part though, only read about it.

yes, like i said, throw an overlay on that motherfucker and ignore the fact that when a customer request enters the network it does so at the cloud provider, then is proxied off to the final destination, possibly with multiple hops along the way. you can't just slap an overlay on and expect everything to work in a reliable and performant manner. yes, it will work for your initial tests, but then shit gets real when y…

> yes, like i said, (...)

I'm sorry, you said absolutely nothing. You just sounded like you were confused and for a moment thought you were posting on 4chan.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#62

Post by chipdart »

mhuffman wrote: post #17
chipdart wrote: post #11

I loved the article. Insightful, and packed with real world applications. What a gem. I have a side-question pertaining to cost-cutting with Kubernetes. I've been musing over the idea of setting up Kubernetes clusters similar to these ones but mixing on-premises nodes with nodes from the cloud provider. The setup would be something like: - vCPUs for bursty workloads, - bare metal nodes for the performance-oriented wo…

For dedicated they say this: >All root servers have a dedicated 1 GBit uplink by default and with it unlimited traffic. >Inclusive monthly traffic for servers with 10G uplink is 20TB. There is no bandwidth limitation. We will charge € 1/TB for overusage. So it sounds like it depends. I have used them for (I'm guessing) 20 years and have never had a network problem with them or a surprise charge. Of course I mostly wo…

> We will charge € 1/TB for overusage.

It sounds like a good tradeoff. The monthly cost of a small vCPU is equivalent to a few TB of bandwidth.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#63

Post by victorbjorklund »

ronsor wrote: post #41
hipadev23 wrote: post #19

Be careful with Hetzner, they null routed my game server on launch day due to false positives from their abuse system, and then took 3 days for their support team to re-enable traffic. By that point I had already moved to a different provider of course.

Reading comments from the past few days makes it seem like dealing with Hetzner is a pain (and as far as I can tell, they aren't really that cheaper than the competitors).

I don't think so. We see the outliers. Those happens at Linode, Digital Ocean, etc also. And yes even at Google Cloud and AWS you sometimes get either unlucky or unfairly treated.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#64

Post by chipdart »

threeseed wrote: post #30
chipdart wrote: post #11

I loved the article. Insightful, and packed with real world applications. What a gem. I have a side-question pertaining to cost-cutting with Kubernetes. I've been musing over the idea of setting up Kubernetes clusters similar to these ones but mixing on-premises nodes with nodes from the cloud provider. The setup would be something like: - vCPUs for bursty workloads, - bare metal nodes for the performance-oriented wo…

> Has anyone ever toyed around with the idea? Sidero Omni have done this: https://omni.siderolabs.com They run a Wireguard network between the nodes so you can have a mix of on-premise and cloud within one cluster. Works really well but unfortunately is a commercial product with a pricing model that is a little inflexible. But at least it shows it's technically possible so maybe open source options exist.

> They run a Wireguard network between the nodes so you can have a mix of on-premise and cloud within one cluster.

Interesting.

A quick search shows that some people already toyed with the idea of rolling out something similar.

https://github.com/ivanmorenoj/k8s-wireguard

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#65

Post by o11c »

usrme wrote: post #39

This is probably out of left field, but what is the benefit of having a naming scheme for nodes without any delimiters? Reading at a glance and not knowing the region name convention of a given provider (i.e. Hetzner), I'm at a loss to quickly decipher the " " to "euc1pmgr1". I feel like I'm missing something because having delimiters would make all sorts of automated parsing much easier.

You can treat the numeric parts as self-delimiting ... that leaves only the assumption that "environment" is a single letter.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#67

Post by hipadev23 »

teitoklien wrote: post #21
hipadev23 wrote: post #19

Be careful with Hetzner, they null routed my game server on launch day due to false positives from their abuse system, and then took 3 days for their support team to re-enable traffic. By that point I had already moved to a different provider of course.

where did you move, asking to keep a list of options for my game servers, i’m using ovh game servers atm

I went back to AWS. Expensive but reliable and support I can get ahold of. I’d still like to explore OVH someday though.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#68

Post by spwa4 »

tutfbhuf wrote: post #56

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

> Determining which option is more cost-effective requires a thorough TCO (Total Cost of Ownership) analysis. While Hetzner may seem cheaper upfront, the additional hours required for DevOps work can offset those savings.

Sure, but the TLDR is going to be that if you employ n or more sysadmins, the cost savings will dominate. With 2 Second if you have a "big" cost, whatever it is, bandwidth, disk space (essentially anything but compute), cost savings will dominate faster.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#70

Post by teitoklien »

hipadev23 wrote: post #67
teitoklien wrote: post #21

Earlier quoted context omitted.

where did you move, asking to keep a list of options for my game servers, i’m using ovh game servers atm

I went back to AWS. Expensive but reliable and support I can get ahold of. I’d still like to explore OVH someday though.

Nothing beats aws tbh, the level of extra detail aws adds, like emailing and alerting a gazillion times before making any changes to underlying hardware, even if non disruptive. Robust I use OVH because the cost reduction supremely adds up for my workloads (remote video editing/ custom rendering farm at scale with a lot more cheaper OVH s3 suitable for my temporary but too many asset workload with high egress requirements) but otherwise I miss AWS and get now, just how much superior their support and attention to detail is.
Post reply on HN