Having to restore data from Mag Tapes over decades and getting CRC errors maybe 20% of the time, this cannot possibly be worse.
You needed to run a cleaner through that tape device.
AWS Tape Gateway
21–30 of 139 posts
Re: AWS Tape Gateway
#22Anyone considering putting giant amounts of data into AWS or most other big clouds should be sure to do the numbers on retrieval. All the big clouds have "roach motel pricing" -- data is free or very cheap to put in, and expensive to get out. Outbound bandwidth costs from AWS are astronomical, so make sure you are not going to need to stream down all that data or move it any time soon or that you have compared that cost to your in-house solution.
Re: AWS Tape Gateway
#23> Tape Gateway stores virtual tapes in Amazon S3, Amazon S3 Glacier Flexible Retrieval, and Amazon S3 Glacier Deep Archive, protected by 99.999999999% of durability.
That’s a lot of 9s.
Re: AWS Tape Gateway
#24Tangent: What's the cheapest way to backup a few TB of personal data these days, pricing based on the premise that I probably will never need to retrieve it (due to local backups as well), but I don't want to pay thousands if I do have to (hundreds would be okay). Glacier Deep Archive?
Re: AWS Tape Gateway
#25Tangent: What's the cheapest way to backup a few TB of personal data these days, pricing based on the premise that I probably will never need to retrieve it (due to local backups as well), but I don't want to pay thousands if I do have to (hundreds would be okay). Glacier Deep Archive?
Yes.
You can use rclone to backup to an S3 bucket, and then have the S3 bucket set to "instantly" move files to deep archive.
To retrieve them, you will need to run an extra command to "unarchive" them for some period of time.
I find this easier than trying to interact directly with any Deep Archive API.
It is very cheap, and AWS's durability guarantees are impressive.
Main S3 page, linked to a note about Deep Archive https://rclone.org/s3/#glacier-and-glacier-deep-archive
The only thing I am not sure on is how to quickly restore a large number of files in a bucket from GDA to S3. It obviously can be scripted, but I don't have that handy. I only keep a small number of large, previously encrypted files in it, so I manually restore from the GUI.
(By the way, rclone can transparently encrypt files and filenames client-side!)
Re: AWS Tape Gateway
#26Tangent: What's the cheapest way to backup a few TB of personal data these days, pricing based on the premise that I probably will never need to retrieve it (due to local backups as well), but I don't want to pay thousands if I do have to (hundreds would be okay). Glacier Deep Archive?
Probably. Looks like about $1/TB/month. Although Backblaze personal backup isn't that much more for a few TB--about $6/month "unlimited" paid annually.
Re: AWS Tape Gateway
#27Tangent: What's the cheapest way to backup a few TB of personal data these days, pricing based on the premise that I probably will never need to retrieve it (due to local backups as well), but I don't want to pay thousands if I do have to (hundreds would be okay). Glacier Deep Archive?
Backblaze B2 would cost you about $10/mo to store 2TB. I've been using them for years for a few tens of gigabytes worth of documents and photos.
https://www.backblaze.com/b2/cloud-storage-pricing.html
edit: it integrates with TrueNAS (formerly FreeNAS) so it's been pretty much set-and-forget, but I can check in and see my stuff through their management interface. I do encrypt my docs before uploading, which TrueNAS also supports.
Re: AWS Tape Gateway
#28"Tape Gateway supports all leading backup applications" Only huge companies like Amazon can be this dumb. They don't even mention tar or pax, the two most common tape backup applications. Also, how will this magic Amazon "Tape Gateway" back up petabytes over slow links? There are many data heavy businesses that don't necessarily have tons of Internet bandwidth. Fully saturating a 100 Mbps outgoing connection will onl…
No organization considering this use case will have a 100Mbps line for it.
Re: AWS Tape Gateway
#29Anyone considering putting giant amounts of data into AWS or most other big clouds should be sure to do the numbers on retrieval. All the big clouds have "roach motel pricing" -- data is free or very cheap to put in, and expensive to get out. Outbound bandwidth costs from AWS are astronomical, so make sure you are not going to need to stream down all that data or move it any time soon or that you have compared that c…
This kind of unbalanced pricing also acts as a disincentive to regularly test your disaster recovery procedures.
Re: AWS Tape Gateway
#30Tangent: What's the cheapest way to backup a few TB of personal data these days, pricing based on the premise that I probably will never need to retrieve it (due to local backups as well), but I don't want to pay thousands if I do have to (hundreds would be okay). Glacier Deep Archive?
I have over 3TB backed up to Backblaze (in addition to a local backup) for $70/yr. That's for Mac or PC. If you're on linux, I believe they offer something for that, too.