Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kubernetes on Hetzner: cutting my infra bill by 75%

bilbof.com

Post reply on HN
Print view View original

111–120 of 229 posts

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#111

Post by merpkz »

surrTurr wrote: post #110

> Hetzner volumes are, in my experience, too slow for a production database. While you may in the past have had a good experience running customer-facing databases on AWS EBS, with Hetzner's volumes we were seeing >50ms of IOWAIT with very low IOPS. See https://github.com/rook/rook/issues/14999 for benchmarks. I set up rook ceph on a talos k8s cluster (with vm volumes) and experienced similar low performance; however…

In my limited experience with rook-ceph it is strictly bare metal technology to deploy. On virtualization it will basically replicate your data to VM disks which usually are already replicated, so quite a bit of replication amplification will happen and tank your performance.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#112

Post by 0xFF0123 »

supriyo-biswas wrote: post #102
tutfbhuf wrote: post #56

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

This is definitely some ChatGPT output being posted here and your post history also has a lot of this "While X, Y also does Z. Y already overlaps with X" output. I'd like to see your breakdowns as well, given that the cost difference between a 2 vCPU, 4GB configuration (as an example) and a similar configuration on AWS is priced much higher. There's also https://github.com/kube-hetzner/terraform-hcloud-kube-hetzne...…

While I agree that your characterisation is true for a lot of chatgpt output, it can also be true for a human explaining their nuanced point of view.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#113

Post by murderfs »

runeks wrote: post #105
kshri24 wrote: post #90

Earlier quoted context omitted.

Is it just me or do the last 3 paragraphs feel like ChatGPT output?

Isn't the point of ChatGPT to mimic sentences written by humans?

GPT-4 is, but ChatGPT is fine-tuned to emit sentences that get rated well (by humans, and by raters trained to mimic human evaluation) in a conversational agent context.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#114

Post by tutfbhuf »

kshri24 wrote: post #90
tutfbhuf wrote: post #56

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

Is it just me or do the last 3 paragraphs feel like ChatGPT output?

I used GPT4o to fix all my spelling and grammar mistakes, maybe it went a little too far, but this is 100% my comment

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#115

Post by mkesper »

ArtTimeInvestor wrote: post #108
thenaturalist wrote: post #54

Earlier quoted context omitted.

I'd say stay clear of Ionos. Bonkers first experience in the last two weeks. Graphical "Data center designer", no ability to open multiple tabs, instead always rerouting to the main landing page. Attached 3 IGWs to a box, all public IPs, GUI shows "no active firewall rules". IGW 1: 100% packet loss over 1 minute. IGW 2: 85% packet loss over 1 minute. IGW3: 95% packet loss over 1 minute. Turns out "no active Firewall…

It is not possible to configure the setup without the graphical interface? Are there cloud providers you prefer?

You could use their cloud API https://api.ionos.com/docs/cloud/v6/ or e.g. terraform provider: https://docs.ionos.com/reference/config-management-tools/con... I don't have any practical experience with this provider, though.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#116

Post by tutfbhuf »

supriyo-biswas wrote: post #102
tutfbhuf wrote: post #56

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

This is definitely some ChatGPT output being posted here and your post history also has a lot of this "While X, Y also does Z. Y already overlaps with X" output. I'd like to see your breakdowns as well, given that the cost difference between a 2 vCPU, 4GB configuration (as an example) and a similar configuration on AWS is priced much higher. There's also https://github.com/kube-hetzner/terraform-hcloud-kube-hetzne...…

It is my ouput, but I use ChatGPT to fix my spelling and grammar. Maybe my prompt for that should be refined in order to not alter the wording too much.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#117

Post by freedomben »

tutfbhuf wrote: post #56

I have experience running Kubernetes clusters on Hetzner dedicated servers, as well as working with a range of fully or highly managed services like Aurora, S3, and ECS Fargate. From my experience, the cloud bill on Hetzner can sometimes be as low as 20% of an equivalent AWS bill. However, this cost advantage comes with significant trade-offs. On Kubernetes with Hetzner, we managed a Ceph cluster using NVMe storage,…

I mostly agree, but it surprises me that people don't often consider a solution right in the center, such as openshift. Have a much, much less burden for devops and have all the power and flexibility of running on bare metal. It's a great hybrid between a fully managed and expensive service versus a complete build your own. It's expensive enough. Todd, for startups it is not likely a good option, but if you have a cluster with at least 72 GB of RAM or 36 CPUs going (about 9 mid size nodes), you should definitely consider something like openshift.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#118

Post by mkesper »

MuffinFlavored wrote: post #34

https://github.com/puppetlabs/puppetlabs-kubernetes What do the fine people of HN think about the size/scope/amount of technology of this repo? It is referenced in the article here: https://github.com/puppetlabs/puppetlabs-kubernetes/compare/...

Honestly I was surprised to hear about puppet at all. Thought that was dead and buried, like chef.

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#119

Post by esher »

huijzer wrote: post #109
esher wrote: post #103

As far as I see, no one is mentioning sustainability AKA environmental impact or 'green hosting' here. Don't you care about that? I believe that Hetzner data centers in Europe (Germany, Finland) are powered by green energy, but not the locations in US.

Data centers used 460 TWh, or about 2% of total worldwide electricity use, according to IEA in 2022. In comparison, 30% of total energy (energy! Not electricity) goes to transport! As another point of comparison, transport in Sweden in 2022 used 137 TWh [1]. So the same order of magnitude as total datacenter energy use. And datacenters are powered by electricity which increases the chance that it comes from renewable…

Thanks for sharing. I care about it. I run a small hosting company. Sure, there are many low hanging fruits for fighting CO2 emissions that should be tackled first. I am also hopeful that energy from directly available renewables will be the most economic choice for building data centers anyhow, so that this is not a matter of believes any more.

But on the other side, to bring down CO2 levels, fast change everywhere is required. As far as I see data center energy consumption continues to grow, specifically with AI.

If I am not mistaken, data centers produce more CO2 than aviation.

And sure, most 'green hosting' is probably 'green washing', yet I would still support and link initiatives such as: https://www.thegreenwebfoundation.org/

Re: Kubernetes on Hetzner: cutting my infra bill by 75%

#120

Post by mythz »

Been a happy Hetzner customer for over a decade, previously using their dedicated servers in their German DC's before migrating to their Cloud US VMs for better latency with the US. Slightly disappointed with their recent cuts of their generous 20TB free traffic down to 3TB (€1.19 per additional TB), but they still look to be a lot better value than all other US cloud providers we've evaluated.

Whilst I wouldn't run Kubernetes by choice, we've had success moving our custom SSH / Docker compose deployments over to use GitHub Actions with kamal-deploy.org, easy to setup and nice UX tools for monitoring remote deployed apps [1]

[1] https://servicestack.net/posts/kamal-deployments

Post reply on HN