Live data from Hacker News

How to Save 90% on your S3 Bill

appneta.com

11–20 of 103 posts

Re: How to Save 90% on your S3 Bill

#11
post #3

interestingly enough, here's the original commit that defaulted `validate=True`: https://github.com/boto/boto/commit/95939debc3813468264159d5... EDIT : Looks like the original committer is an Amazon employee.

Before you jump on the conspiracy train, most Boto contributors are Amazon employees.

Re: How to Save 90% on your S3 Bill

#12
post #3

interestingly enough, here's the original commit that defaulted `validate=True`: https://github.com/boto/boto/commit/95939debc3813468264159d5... EDIT : Looks like the original committer is an Amazon employee.

So the committer added an option to avoid the expensive behavior and that's a sign of evil?

Re: How to Save 90% on your S3 Bill

#13
post #3

interestingly enough, here's the original commit that defaulted `validate=True`: https://github.com/boto/boto/commit/95939debc3813468264159d5... EDIT : Looks like the original committer is an Amazon employee.

Before you jump on the conspiracy train, most Boto contributors are Amazon employees.

Agreed, I doubt Amazon had any evil intentions with this change.

I wonder more if this was a product of Amazon developers using S3 (i.e. dogfooding) and not noticing the cost side effect because I'm assuming they don't get billed?

Re: How to Save 90% on your S3 Bill

#15
post #13

Earlier quoted context omitted.

Before you jump on the conspiracy train, most Boto contributors are Amazon employees.

Agreed, I doubt Amazon had any evil intentions with this change. I wonder more if this was a product of Amazon developers using S3 (i.e. dogfooding) and not noticing the cost side effect because I'm assuming they don't get billed?

The change is the opposite of what you're implying, it adds the option to turn it off. Before this commit it was on by default. My guess is, when the option was added, it defaulted to validate=True to maintain backward compatibility.

Re: How to Save 90% on your S3 Bill

#16
> One utility in general that’s provided us with an easy way to slice up and investigate our AWS spending is the awesome Asgard.

The tool they're actually referring to is Ice (also by netflix) [1]. Asgard is another AWS-based tool for managing deployments and auto-scaling.

[1] https://github.com/Netflix/ice

Re: How to Save 90% on your S3 Bill

#17
post #16

> One utility in general that’s provided us with an easy way to slice up and investigate our AWS spending is the awesome Asgard. The tool they're actually referring to is Ice (also by netflix) [1]. Asgard is another AWS-based tool for managing deployments and auto-scaling. [1] https://github.com/Netflix/ice

Now mentioned in the article.

Re: How to Save 90% on your S3 Bill

#18
post #16

> One utility in general that’s provided us with an easy way to slice up and investigate our AWS spending is the awesome Asgard. The tool they're actually referring to is Ice (also by netflix) [1]. Asgard is another AWS-based tool for managing deployments and auto-scaling. [1] https://github.com/Netflix/ice

Now mentioned in the article.

I'm the article author, and yes, we're using or evaluating both services. I find myself swapping the two all the time in conversation. Pretty silly typo on my part :)

Re: How to Save 90% on your S3 Bill

#19
post #13

Earlier quoted context omitted.

Before you jump on the conspiracy train, most Boto contributors are Amazon employees.

Agreed, I doubt Amazon had any evil intentions with this change. I wonder more if this was a product of Amazon developers using S3 (i.e. dogfooding) and not noticing the cost side effect because I'm assuming they don't get billed?

We actually do get billed, but we don't have to pay. I always check my bill to make sure that I am not using any resources that I don't need.

I also pay for my own personal EC2 instance and about 350 GB of S3 storage. Begin a genuine user and customer of AWS helps me to be a better employee.

Re: How to Save 90% on your S3 Bill

#20
post #8

This is one of the reasons why Rackspace simplified pricing of Cloud Files from the start. No fees for PUT, POST, LIST, HEAD, GET, DELETE...no extra fees for Akamai CDN requests. Very simple with no hidden fees that surprise you at the end of the month.

The problem was people implemented a file system on top of s3. From what I understand, Amazon added the charges, which are pretty nominal, to prevent people from hammering s3 as a block storage system.
Post reply on HN