How to Save 90% on your S3 Bill
appneta.com
How to Save 90% on your S3 Bill
1–10 of 103 posts
Re: How to Save 90% on your S3 Bill
#2thats a good catch! thanks man :)
Re: How to Save 90% on your S3 Bill
#3interestingly enough, here's the original commit that defaulted `validate=True`:
https://github.com/boto/boto/commit/95939debc3813468264159d5...
EDIT: Looks like the original committer is an Amazon employee.
Re: How to Save 90% on your S3 Bill
#4The interesting thing is that the Boto S3 tutorial (http://docs.pythonboto.org/en/latest/s3_tut.html) uses s3.get_bucket() with impunity and never mentions you're paying 13.5x more for your usage if you use that bucket object for just one GET and don't pass validate=False. (Perhaps someone from AWS wrote that tutorial? :P) Probably deserves a mention there, though.
Re: How to Save 90% on your S3 Bill
#5Idea: A tool which give you some improvements advises on your code to save up money on your AWS bills
Re: How to Save 90% on your S3 Bill
#6Good news for django-storages users – this is off by default:
https://bitbucket.org/david/django-storages/src/cb7366693ce1...
Re: How to Save 90% on your S3 Bill
#7Also see MimicDB [0]. Runs a transparent cache that responds to most S3 API calls locally using Redis to store metadata. Besides the cost savings, it's extremely fast. Listing an entire bucket with millions of objects is close to instantaneous.
Re: How to Save 90% on your S3 Bill
#8This is one of the reasons why Rackspace simplified pricing of Cloud Files from the start. No fees for PUT, POST, LIST, HEAD, GET, DELETE...no extra fees for Akamai CDN requests. Very simple with no hidden fees that surprise you at the end of the month.
Re: How to Save 90% on your S3 Bill
#9Good news for django-storages users – this is off by default: https://bitbucket.org/david/django-storages/src/cb7366693ce1...
To further add: the PyPI version hasn't been updated since March 2013 but the last time the relevant lines were changed was January 2013, so you should still be good with the PyPi version (assuming changes from then went out in the last release).
The setting in question is: AWS_AUTO_CREATE_BUCKET.
Re: How to Save 90% on your S3 Bill
#10This is one of the reasons why Rackspace simplified pricing of Cloud Files from the start. No fees for PUT, POST, LIST, HEAD, GET, DELETE...no extra fees for Akamai CDN requests. Very simple with no hidden fees that surprise you at the end of the month.
What are the hidden fees in the S3 use case?