Live data from Hacker News

Ask HN: How do you backup your files without depending on a third party service?

news.ycombinator.com

51–60 of 112 posts

Re: Ask HN: How do you backup your files without depending on a third party service?

#51

Synology or QNAP NAS. They collect backups from all computer in the house, encrypt them and ship the encrypted blobs to AWS Glacier. Synology in particular is a fantastic platform which does way more than a traditional NAS. It's quite polished personal cloud platform (way more so than FreeNAS) and includes hundreds of apps, even the backups into the cloud can be done in different ways. I also place a premium on the f…

Synology is great however I'd like to caution anyone considering their enterprise gear that they do not offer traditional 24/7 support. Regardless of which unit you purchase (in our case we purchased the most expensive RU model), all support tickets are triaged and prioritized equally, and there is no phone support (unless you scream loud).

Re: Ask HN: How do you backup your files without depending on a third party service?

#52
post #50
post #42

Hourly backups to a NAS and one of two local USB3 SSD drives that I rotate weekly. You can get around 400 MBps write rate on the latter [1], which is pretty decent by itself, but I also use bvckup2 that does block-level delta updates and that cuts down backup time to around 10 minutes. That's on a bit less than 1TB of data mostly comprising very large encrypted file containers and VMs. Worked pretty well so far, went…

What's your use case for such a strict backup regime?

I wouldn't call it strict. It still means an average of 15 min of work data lost in case of primary storage collapse.

Re: Ask HN: How do you backup your files without depending on a third party service?

#53
I have a home server with a lot of storage; it's running ZFS with full redundancy. If you're in the US, wait a few months and you can buy an 8TB external HDD when it goes on sale again. WD EasyStore HDDs regularly go on sale [0].

For documents and important files I usually keep an extra copy with two or more cloud storage providers. It's unlikely that these companies would suffer data loss, so the most likely cause for losing access to those files would probably be if they closed my account. Using multiple services reduces the chances of losing access to your files, since it's unlikely you'd be banned from all of them at the same time.

[0] https://www.reddit.com/r/DataHoarder/comments/7fx0i0/wd_easy...

Re: Ask HN: How do you backup your files without depending on a third party service?

#54
* 2, 1 TB on Hard Drives, 1 for each MBP. I use time machine

* A dozen or so Flash drives containing our wedding pictures and current copies of our taxes in locked / encrypted volumes.

* Facebook & Google photos for our favorites from vacations

* 4 hard drives scattered through out the house and 1 in our safe

* Typically I bring a flash drive with me when we travel and leave one in the car at the airport

Re: Ask HN: How do you backup your files without depending on a third party service?

#55
A lot of the replies either rely on third party services (albeit encrypted) or forget about the third part of the holy backup trinity of having something offsite.

It sounds like you're thinking of local backup while you're traveling, which is great. The portability of USB sticks seems perfect for your use case, although I think a 1TB stick is still a stretch, maybe look into a small self-powered external SSD drive. If using OSX you can encrypt it and use Time Machine to auto-backup when plugged in (easy) or just use an rsync script (manual).

But don't forget to ship these backups offsite once you're home. If you get a couple of 2TB drives to account for growth, you could get into the habit of depositing the current backup into offsite location, grabbing the old backup from offsite, and just rotating every couple of weeks. Offsite could be a local bank safe deposit, a work office, or out of town family. (I consider family second-party, not third-party.) Local backup means nothing if you have to evacuate due to flood (east coast hurricanes), fire (california wildfires), or any unforeseen disaster.

I use this method to backup 10TB of photography that I can't do online without a fiber uplink. Thankfully 10TB platter drives are possible these days for me to flat-rate mail to my parents across the country. (And yes, Synology for local backup, that seems to be the hit here.)

Re: Ask HN: How do you backup your files without depending on a third party service?

#56
I use Back In Time on Linux (which uses rsync) to back up data to a USB external drive. I backup critical data on 2 USB sticks one of which I carry with me at all times, the other one in a bank locker (this version of backup runs a little behind since I have to make trips to the bank). Not the most convenient way to make backups but I find it an acceptable trade off for me.

Pros

1 No data in the cloud.

2. Multiple copies of backup one of which is outside the house (to guard against fire etc.)

3. I have the most critical data with me at all times.

Cons

1. Data still in same city (does not guard against major earthquake, flood etc.)

2. Manual back ups (not automated on a schedule - though that can be set up on a home network, I just haven't bothered).

Re: Ask HN: How do you backup your files without depending on a third party service?

#57
I have always kept it simple. A storage array in JBOD (non-raid) setup. I buy two of whatever drive(s) will contain the duplicated data and just do a clean mirror using whatever backup software you desire. I happen to use 4TB HGST drives in a Mediasonic PROBOX 4 tower hooked into a PCIe card in my computer that connects them all through one multichannel eSATA cable. The software I use is Allway Sync (free for up to a certain amount of backed up data per month, after that a one time fee for lifetime updates).

I do one additional thing, and it's for third-party storage. So if you're dead set on cutting out a third-party, I understand. But here me out. If the data is encrypted on the third-party system, it's largely a non-risk in terms of privacy unless your filenames themselves put your privacy at risk. I am fine with my filenames being seen, but the content being encrypted. So what I do is use Boxcryptor to encrypt the "destination" drive and then I use pCloud as my third-party storage provider. Both pCloud and Boxcryptor show up as physical drives on your computer, which I find convenient. So I have my primary source drive synced with the Boxcryptor drive/location and Boxcryptor is set up on my machine to encrypt the data on the fly as it is copied (surprisingly, this is not the default setting). Then, The pCloud software is set up to automatically sync that Boxcryptor directory where the files show in their encrypted format (the "drive" version shows them unencrypted because everything is done on the fly both ways) to my pCloud storage. In the end, I have 3 versions - the unencrypted source, the encrypted Boxcryptor copy, and the pCloud backup which contains the encrypted copy.

Also important to note - pCloud is based in Germany and thus subject to the EU data protection laws and even without that I find pCloud to be a much lesser risk in terms of data privacy than any company in the US.

Re: Ask HN: How do you backup your files without depending on a third party service?

#58

A lot of the replies either rely on third party services (albeit encrypted) or forget about the third part of the holy backup trinity of having something offsite. It sounds like you're thinking of local backup while you're traveling, which is great. The portability of USB sticks seems perfect for your use case, although I think a 1TB stick is still a stretch, maybe look into a small self-powered external SSD drive. I…

The rsync solution doesn't have to be manual. On Mac you can install a launchd script to run using StartOnMount.

Re: Ask HN: How do you backup your files without depending on a third party service?

#59
post #8

I have a 4TB Hard Drive attached to an OpenWRT router (Rasberry Pi's are also a popular choice). The router exposes a locked down SSH port (SFTP only) through a cheap $5 a month VPS. I also use Jottacloud [1] who provide unlimited (yes unlimited) storage for 7.5 EUR a month. Based in Norway, they keep an up to date warrant canary. Client side, I backup to both of these services using Duplicati [2] which offers client…

I just started experimenting with Syncthing because Dropbox no longer meets my needs.

So far I'm pretty happy and impressed, it's a decentralized piece of software that Just Works (TM). My plan for backups is to spin up a VPS somewhere and have them back it up.

I also love that it can use LAN; I can finally sync up my giant mp3 collection.

Re: Ask HN: How do you backup your files without depending on a third party service?

#60
post #12

If you’re tech savvy and want the easy answer then check out Tarsnap[1]. If you’re tech savvy and want to save a few bucks by doing it yourself, check out borg[2]. You’ll need to set up an external server for it but at scale (TB) it’s an order of magnitude cheaper than Tarsnap. Regardless of off site storage I’d suggest also buying two large USB drives and formatting them with LUKS. Keep them offline and only sync th…

Tarsnap is a third-party service which in turn depends on S3. The author specifically requested solutions which do not depend on a third party.

I know and I still gave the answer I thought was best.

Unless you're going to run your own servers in multiple locations (or convince you friends to let you host a NUC at their homes), you're going to rely on a third party. All that changes is the type of service that you're receiving, i.e. whether it's an object store (S3, B2, etc), a virtualized server, or even a rack in a data center.

Post reply on HN