Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon Glacier

aws.amazon.com

Post reply on HN
Print view View original

161–170 of 393 posts

Re: Amazon Glacier

#161

Post by [deleted] »

arethuza wrote: post #150
wheels wrote: post #145

Earlier quoted context omitted.

> Governments of stable countries are obviously capable of this I don't consider that obvious. I live in Berlin, the capital of what most would consider a stable country, but my apartment (which is even older) has been a part of 5 different countries in the last 100 years (German Empire, Weinmar Republic, Nazi Germany, East Germany and finally, the Federal Republic of Germany).

Sorry, what I meant by "stable" there is countries that have been relatively stable for a few hundred years and seem reasonably likely to continue that integrity for at least a century or so. Of course, predicting future stability is complete guesswork!

[deleted]

Re: Amazon Glacier

#162

Post by tomp »

culturestate wrote: post #107
kondro wrote: post #90

Earlier quoted context omitted.

Home-use is probably the only situation Glacier is good for backup though. A home user is fine with a 3.5-4 hour window before their backup becomes available for download (as it will probably take them days to download it anyway). In a corporate environment, I don't want to wait around for 3.5-4 hours before my data even becomes available for restore in a disaster recovery situation. Seems good for archive-only in a…

In a corporate environment, I wouldn't want to depend on the cloud as my primary backup solution in the first place. I'd be much more comfortable using it as the offsite mirror of an onsite backup. If you're at a point in disaster recovery where you have to restore from your offsite, you (likely) have bigger problems than a 4-hour wait time.

I personally believe that data should never be deleted (or overwritten), but only appended to. Kinda like what redis/datomic does. So, keep live data onsite, along with an onsite (small) backup, and all the old data in Glacier.

Re: Amazon Glacier

#163

Post by speleding »

ghshephard wrote: post #116
kondro wrote: post #90

Earlier quoted context omitted.

Home-use is probably the only situation Glacier is good for backup though. A home user is fine with a 3.5-4 hour window before their backup becomes available for download (as it will probably take them days to download it anyway). In a corporate environment, I don't want to wait around for 3.5-4 hours before my data even becomes available for restore in a disaster recovery situation. Seems good for archive-only in a…

Interesting to note - those of us who used Iron Mountain/Data Safe for years - 4 Hours was considered a "Premier Rapid Recovery" service that we paid a lot of money for (as recently as 2003, actually). In a true disaster recovery (Building burned down or is otherwise unavailable) - it usually takes most businesses a week or so just to find new office facilities. But - agreed, there will be some customers for whom Gla…

Yes, that's what I am thinking: a week of backups to S3 and a script that does moves the oldest one from S3 to Glacier. You would rarely need a backup older than a week if you've already got a week of backups. I'm still figuring out if there is a practical way to do this with incremental backups without introducing to much risk that the backup process gets messed up.

Re: Amazon Glacier

#164

Post by mkl »

Tichy wrote: post #157
kalininalex wrote: post #96

Earlier quoted context omitted.

With large volumes the real issue is not the storage but the upload speed. I've done some experiments and with the Comcast link (20Mbps down/whatever up), I got 1 Gb/hour upload rate. So, it'll take 11 full days to upload 256 Gb. Or, more realistically, if you do it overnight (8 hours) - the entire month.

But then you can do incremental backups which should be faster. Although I admit I am not sure how to do it with encryption (impossible?).

That's what duplicity is for: http://duplicity.nongnu.org/

It uses rsync's algorithm to figure out what has changed, and everything is encrypted locally.

(The site says it's in beta, but it's said that for years.)

Re: Amazon Glacier

#165

Post by ghshephard »

gadders wrote: post #75

Anyone know what the TOS are for this? I couldn't find them on a scan of the announcement. A lot of the consumer-level services refuse any liability for any data loss. Does Amazon do the same for this?

Presumably the standard S3 SLA will apply: http://aws.amazon.com/s3-sla/

Realistically, you'd want to have at least two diverse cloud backup systems - I doubt you'd be happy with Service Credits if your data went missing.

Re: Amazon Glacier

#166

Post by arethuza »

bobsy wrote: post #154
arethuza wrote: post #150

Earlier quoted context omitted.

Sorry, what I meant by "stable" there is countries that have been relatively stable for a few hundred years and seem reasonably likely to continue that integrity for at least a century or so. Of course, predicting future stability is complete guesswork!

We are straying a bit off topic here. I don't think any country has been stable for a "few" hundred years. A few is 3. This is before the US was founded. I would say a stable country is one which has had a legit democracy for 70 or so years and doesn't share a border with a non-democratic / non-legit-democratic state. These two points suggests its unlikely to have a revolution or be invaded any time soon. Of course,…

I think I could argue that England has been pretty stable since at least the end of the Civil War - which is 360 years ago. A lot of the institutions that form part of the current UK go back an awful lot further than that.

[NB I'm not English]

Re: Amazon Glacier

#167

Post by abrahamsen »

arethuza wrote: post #150
wheels wrote: post #145

Earlier quoted context omitted.

> Governments of stable countries are obviously capable of this I don't consider that obvious. I live in Berlin, the capital of what most would consider a stable country, but my apartment (which is even older) has been a part of 5 different countries in the last 100 years (German Empire, Weinmar Republic, Nazi Germany, East Germany and finally, the Federal Republic of Germany).

Sorry, what I meant by "stable" there is countries that have been relatively stable for a few hundred years and seem reasonably likely to continue that integrity for at least a century or so. Of course, predicting future stability is complete guesswork!

US. UK. Sweden. It is really hard to come up with countries where the government has been stable "for a couple of centuries".

Re: Amazon Glacier

#168

Post by Yrlec »

This looks awesome! We are currently developing a P2P-based backup solution (http://degoo.com) where we are using S3 as fall-back. This will allow us to be much cheaper and I am sure it will enable many other backup providers to lower their prices to.

Re: Amazon Glacier

#169

Post by g-garron »

ghshephard wrote: post #36

I'm a long time user of backblaze, and I'm a big fan of the product - it does a great job of always making sure my working documents are backed up, particularly when I'm traveling overseas, and my laptop is more vulnerable to theft or damage. With that said - Backblaze is optimized for working documents - and the default "exclusion" list makes it clear they don't want to be backing up your "wab~,vmc,vhd,vo1,vo2,vsv,v…

I use s3cmd sync to keep my files backed up. But for my pictures, tunes, I use a Linux server and rsync. Now glacier is perfect for my tunes and family pictures.

Re: Amazon Glacier

#170

Post by mik4el »

Yrlec wrote: post #168

This looks awesome! We are currently developing a P2P-based backup solution ( http://degoo.com ) where we are using S3 as fall-back. This will allow us to be much cheaper and I am sure it will enable many other backup providers to lower their prices to.

The S3->Glacier lifecycle-feature must be a welcome thing for you I guess?
Post reply on HN