Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: How can I quickly trim my AWS bill?

news.ycombinator.com

Post reply on HN
Print view View original

41–50 of 134 posts

Re: Ask HN: How can I quickly trim my AWS bill?

#41

Post by philliphaydon »

rumanator wrote: post #40
philliphaydon wrote: post #35

Earlier quoted context omitted.

Nope. We have no information of the OPs setup, bill, or anything. This entire thread is based on assumptions. I common examples of developers screwing up and generating large bills. Explain to me how machine learning is any different. Do we know if the instances used for MLing are running 24/7 idle until customers use them? Do we know if the utilisation is optimal for the workloads? We know nothing. So claiming that…

> So claiming that cloud providers are not good The statement is not that AWS is "not good". The statement is that AWS is very expensive, specially for computational tasks, and there are cheaper alternatives around. AWS is notorious for positioning their services as a way to convert capex into opex, specially if your scenario involves a SaaS that might experience unexpected growth and must be globally available. Trai…

I never defended AWS as being the absolute best. I said high bills are almost always due to developers and not the cloud provider. Which you haven’t argued against.

As I said I have examples of how Developers often cause large bills.

And I explained why we can’t help with the OPs large bill.

You’re saying that with ML there is absolutely 0 way to reduce costs on AWS which is absolute rubbish.

Re: Ask HN: How can I quickly trim my AWS bill?

#42

Post by red0point »

For the ML models you can also switch to dedicated server providers, such as: https://www.dedispec.com/gpu.php

For storage, there‘s always Wasabi / B2 with S3 compatible interfaces. If the data itself is not changing that much, so regular backups are possible, just use some dedicated storage servers with hard drives and install MinIO. Do not rely on S3 for outgoing data (much too expensive), use a caching layer on another provider (OVH , Hetzner, ...), or if it fits your workload, Wasabi („free“ egress).

Re: Ask HN: How can I quickly trim my AWS bill?

#43

Post by dautovri »

open source tools:

- https://github.com/antonbabenko/terraform-cost-estimation

- https://github.com/cloud-custodian/cloud-custodian

- https://github.com/aws/amazon-ec2-instance-selector

- https://github.com/rdkls/aws_infra_map_neo4j

commercial:

- https://www.cloudhealthtech.com

- http://densify.com/

- https://spot.io

- https://www.hpcdlab.com

Re: Ask HN: How can I quickly trim my AWS bill?

#44

Post by alFReD-NSH »

If you have the time to fix them asap you can follow this route:

- use spot or reserved instances or saving plans. - have a look at compute optimizer - understand aws networking costs are and try to optimise it (cross az and internet egress can be costly) - go through the trusted advisor checks: https://aws.amazon.com/premiumsupport/technology/trusted-adv...

You can enable trusted adviser checks by enabling business or enterprise support. - try using one of these cost optimisation tools: https://aws.amazon.com/products/management-tools/partner-sol...

- contact aws for well architected review

If you don't have the time, then I suggest contacting AWS to introduce you to a consulting partner. They can come and actually fix whatever is needed.

Re: Ask HN: How can I quickly trim my AWS bill?

#45

Post by vmurthy »

At a startup I worked earlier, we tried two things that helped : 1. Reserved instances (you commit for a year and you can save 20% - charged monthly. AFAIK no upfront costs)

2. Like another reader suggested here, there are accelerators/foundations which give away $10k for the 1st year towards cloud usage. We were in healthcare and had a big chip company pay about $10k in credits for a year of AWS. Depending on the domain you are in, there may be a few. If you let me know which domain you work in ( healthcare , media etc.) someone here might be able to point to the right resource

Re: Ask HN: How can I quickly trim my AWS bill?

#47

Post by aclelland »

If you can handle some interruption to your work then spot instances are probably going to be the biggest immediate change you can make.

Right now a g4dn.xlarge is $0.526/h on demand but only $0.1578/h as a spot instance.

You might also be eligible for a 10k grant from AWS - https://pages.awscloud.com/GLOBAL-other-LN-accelerated-compu...

Re: Ask HN: How can I quickly trim my AWS bill?

#48

Post by A21z »

Blog article about real-life AWS cost optimization strategy :

https://medium.com/teads-engineering/real-life-aws-cost-opti...

TL;DR:

- Monitor your daily costs

- Cloudify your workloads

- Use reservations, Spot instances, saving plans

- Look around for unused infrastructure

- Optimize S3 consumption

Post reply on HN