Live data from Hacker News

Ask HN: Which file storage service would you recommend for the long term?

news.ycombinator.com

31–40 of 52 posts

Re: Ask HN: Which file storage service would you recommend for the long term?

#31
post #28
post #21

Earlier quoted context omitted.

Another vote for Arq if what the OP wants is backup. This lets you pick and switch storage providers. I don't think you should plan on staying with any provider for more than 2-3 years, the landscape changes too fast. Arq lets you be independent.

Aren't the backups now dependent on (1) the storage provider and (2) the Arq software developer? You lose Arq, you lose your backups.

The format of the backups is specified, so making a replacement should be possible if needed: https://www.arqbackup.com/s3_data_format.txt

Re: Ask HN: Which file storage service would you recommend for the long term?

#32
post #28
post #21

Earlier quoted context omitted.

Another vote for Arq if what the OP wants is backup. This lets you pick and switch storage providers. I don't think you should plan on staying with any provider for more than 2-3 years, the landscape changes too fast. Arq lets you be independent.

Aren't the backups now dependent on (1) the storage provider and (2) the Arq software developer? You lose Arq, you lose your backups.

[deleted]

Re: Ask HN: Which file storage service would you recommend for the long term?

#33
post #25

Based on your criteria, it sounds like you could use physical hard drives to backup to, rather than a service. You should store your files onto an external hard drive and keep the external hard drives in a safe place.

...multiple copies in mutiple places

Re: Ask HN: Which file storage service would you recommend for the long term?

#34

I use Arq [ https://www.arqbackup.com ] which is provider dependent and doesn't lock you into a specific cloud like Backblaze or Crashplan. You can set it up to sync to Glacier/S3/Dropbox/GDrive/OneDrive/Local NAS/FTP server or any combination of them if you want to have multiple copies. I get 1TB of OneDrive free with Office365 so backup to that but also to S3 so that if I was to stop using Microsoft I'm not tied do…

Has anyone else noticed Arq getting more buggy lately? I suspect it's the proliferation of storage options and the compromises required to support them all.

I would be happier with a more bulletproof app that only backed up to one provider.

Re: Ask HN: Which file storage service would you recommend for the long term?

#35

The best way to plan for 50 years is to continually have a 1, 5 and 10 year plan. Your 50 year requirement is the real tough problem here. I would have a hard time recommending any of the types of services your are referring to for more than a year at a time. To achieve anything beyond that you need to look for a service that is VERY standards based and portable. You do not mention a need for "backup/restore" or "ver…

I have been using Crashplan for around 4 years and I highly recommend it. I bought 4 years worth of storage 2 years ago. I have backups for my own computer and my in-laws. Great deal and great service.

Everything points to my Linux NAS and than I backup to CrashPlan.

Re: Ask HN: Which file storage service would you recommend for the long term?

#36
post #23

> My goal is to ... lose none of my files Duplicates. Perhaps two or three online services, plus local disk array at home. Check data integrity every year... Every decade you will have to swap service or two, as companies evolve.

Redundant array of independent file services.

Re: Ask HN: Which file storage service would you recommend for the long term?

#37
post #30

for a person with TB of data and increasing; your condition of 50 years service guaranteed in the future is strange. I may suggest deploying your own service using (owncloud)[ https://owncloud.org/ ] on your own dedicated servers

It worries me that https://owncloud.org seems to support only TLS 1.0, not 1.1 or 1.2. I can't speak about their software, but it is not a good sign to see the security warning when I first go to their site. https://www.howsmyssl.com/s/about.html considers TLS 1.0 "Bad".

Edit: in their favor, at least they do provide GPG signatures for their downloads.

Re: Ask HN: Which file storage service would you recommend for the long term?

#38
post #15

I'm a fan of Backblaze. Been using them for about 6 years. They meet all of your requirements. They don't make it particularly easy to access your files from another device (not a great cloud interface like Dropbox), which is probably one way they keep costs low ($5 per month, unlimited storage).

One negative of Backblaze is that they still don't support Linux. I'm not a huge Linux user, but I'd like to have the option, otherwise I'm seriously dis-interested in the service. The more open/options the better.

Re: Ask HN: Which file storage service would you recommend for the long term?

#39

The best way to plan for 50 years is to continually have a 1, 5 and 10 year plan. Your 50 year requirement is the real tough problem here. I would have a hard time recommending any of the types of services your are referring to for more than a year at a time. To achieve anything beyond that you need to look for a service that is VERY standards based and portable. You do not mention a need for "backup/restore" or "ver…

> The best way to plan for 50 years is to continually have a 1, 5 and 10 year plan.

This is the key point to focus on: you don't actually have a backup plan if you don't regularly access the stored data – until then, it's just hope.

I like the CrashPlan + Dropbox approach but there's a key gap: you need something else to check strong signatures (SHA-256/512) on data to avoid scenarios where a bit flips on one of your computers, the file is updated and you don't notice it for a long time, which is really easy for data which is infrequently accessed or where the client programs typically cover minor flaws (most image/video/audio formats).

My favorite example is a JPEG-2000 file which had corruption in the middle of its tile hierarchy – either a thumbnail or full 1:1 zoom looked fine but something like a 50% zoom would show corruption. You'll probably never find something like that without automated checksums until it's too late to recover a copy from somewhere else.

What I'd really like is something like a mature large-file optimized Git repo where there's a strong, checksumed history and it's immediately obvious if a remote version is out of sync. https://github.com/bup/bup and https://git-annex.branchable.com/ are very interesting.

Archive Team is trying git-annex as a way to back up the Internet Archive globally, which will likely lead to changes helping that tool become solid for general usage: http://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK

Re: Ask HN: Which file storage service would you recommend for the long term?

#40
> use a service for the next 50 years

Probably won't happen. Businesses come and go. Unless you want to be constantly shuffling file storage backends, such a plan will probably end in disaster.

If you want something with the requirements you describe, you'd be better off self-hosting. I'd set up two servers - one in your house or office or what have you, and a second in some further-away location (perhaps a relative's house). The "servers" could be as simple as ordinary desktops with a bunch of Western Digital Red drives. Pop your operating system of choice on them, set them up with some way to transfer files (I personally just SFTP important files to an OpenBSD box; once I find a suitable secondary location, I'll probably set up another one and have the first one pump the contents of its backup folder to the second one on a daily basis with something like rsync), and be done with it.

The downside is that now you have to manage the hardware side and the software side of things, but at least now you have some assurance that - so long as you actively maintain your backup server(s) - your data will be safely backed up.

Post reply on HN