Live data from Hacker News

Amazon Glacier

aws.amazon.com

21–30 of 393 posts

Re: Amazon Glacier

#21

What does "99.999999999% durability" mean? Does it mean they allow themselves to lose one byte per terabyte on average?

I think it means there is a small chance enough hard drives might fail at the same time that there happen to be no backups of those drives.

They make so many backups so quickly that there is only a 0.00000000001% (I didn't count the zeros) chance of this occuring.

Re: Amazon Glacier

#22
post #9

Earlier quoted context omitted.

Arq's support is enough. http://www.haystacksoftware.com/arq/

It already supports it?

Kinda: "In the coming months, Amazon S3 will introduce an option that will allow customers to seamlessly move data between Amazon S3 and Amazon Glacier based on data lifecycle policies."

Re: Amazon Glacier

#24
Storage experts: I'd love to know more about what might be backing this service.

What kind of system has Amazon most likely built that takes 3-4 hours to perform retrieval? What are some examples of similar systems, and where are they installed?

Re: Amazon Glacier

#26

What does "99.999999999% durability" mean? Does it mean they allow themselves to lose one byte per terabyte on average?

From: http://aws.amazon.com/s3/faqs/#How_durable_is_Amazon_S3

Amazon S3 is designed to provide 99.999999999% durability of objects over a given year. This durability level corresponds to an average annual expected loss of 0.000000001% of objects. For example, if you store 10,000 objects with Amazon S3, you can on average expect to incur a loss of a single object once every 10,000,000 years....

Re: Amazon Glacier

#27
post #21

What does "99.999999999% durability" mean? Does it mean they allow themselves to lose one byte per terabyte on average?

I think it means there is a small chance enough hard drives might fail at the same time that there happen to be no backups of those drives. They make so many backups so quickly that there is only a 0.00000000001% (I didn't count the zeros) chance of this occuring.

Which of course means that (if they're telling the truth) the probability of losing your data mostly comes from really big events: collapse of civilization, global thermonuclear war, Amazon being bought by some entity that just wants to melt its servers down for scrap, etc. (Whose probability is clearly a lot more than 10^-11 per year; the big bang was only on the order of 10^10 years ago.)

Re: Amazon Glacier

#28
Amazon Glacier is an extremely low-cost, pay-as-you-go storage service that can cost as little as $0.01 per gigabyte per month.

What would be absolutely fascinating is a pay-before-you-go storage service — data cryonics.

Paying $12 to store a gigabyte of data for 100 years seems like a pretty intriguing deal as we emerge from an era of bit rot.

Re: Amazon Glacier

#29
I hope they can get the access time down from 3-5 hours to about 1 hour - that's the difference for me between it being a viable alternative for storing backups of my client's web sites or not.

I might create a script that uploads everything to Glacier and just keeps a couple of the latest backups on S3 though.

Re: Amazon Glacier

#30
that's certainly interesting. as there will be migration from s3 to glacier, it would be nice if tarsnap had an option to store only the (say) last week in s3 (with .3$/gb/month) and the rest in glacier (with, say, .03$/gb/month).

that would certainly be very nice. cperciva, what do you think?

Post reply on HN