Live data from Hacker News

Ask HN: How do you back up your data?

news.ycombinator.com

31–40 of 60 posts

Re: Ask HN: How do you back up your data?

#31

This is not answering the question, but someone please build this for me (and hopefully a million others): Simple live off-site backup for worst-case scenario. I buy a pair of devices (e.g. Tonidos) with attached commodity HDDs that I split with a friend. He plugs his into his network, I plug mine in. I dump files to my local device, but they actually get buffered and then stored overnight at his place, and vice-vers…

Tahoe-LAFS: https://tahoe-lafs.org/trac/tahoe-lafs

Re: Ask HN: How do you back up your data?

#34
post #26

Since both my wife and I use either Mac or Linux based laptops I have a quick and dirty shell script that gets fired off by hand at the end of the day. The script uses rsync and cpio to copy all files in the laptop's home directory onto a machine running debian packed with 4 1TB drives in a RAID5+1 spare configuration. The script uses hard links to keep daily increments without consuming disk space and goes something…

So you have a hand rolled version of rsnapshot?: http://www.rsnapshot.org/

Re: Ask HN: How do you back up your data?

#35

1. I keep working data on my laptop, and archived data/media on a desktop machine in my home. 2. Both are backed up to Time Machine to a network drive, and also with Arq to Glacier. 3. I keep important documents in Dropbox. This gives me "Oh shit, I deleted a file" protection from Time Machine and Dropbox, two local copies of all media and data in case of hardware failure or machine loss, and a last-ditch offsite Gla…

I have independently reached the same conclusions. Glacier for photos / videos backup and Dropbox / time machine for everything else.

Re: Ask HN: How do you back up your data?

#36
This is how I do that for servers, but I'm experimenting with using the same backup schema for my local machine, too:

On my servers, every virtual machine is on an encrypted block device, so the data is already encrypted when it's written to the disk. Then I use Shasplit [1] and Rsync for efficient incremental backups. Restoration is a simple "cat" invocation (or use Shasplit for that), and I get back a full, running, encrypted VM with everything.

[1] http://vog.github.io/shasplit/

Re: Ask HN: How do you back up your data?

#37
Previous backup method: 1. Back up working dir (~1.5 GB) daily with rsync to Raspberry Pi. 2. Back up encrypted archives of photos/videos monthly to mega.co.nz and external drive, and back up new photos/videos during month with #1 above.

New back up method: 1. Back up everything with Deja Dup to $25/year, 50GB VPS daily - I don't have a lot of data. 2. Back up everything with Deja Dup to external drive monthly (maybe going to weekly).

Edit: All photos are resized monthly with a script to create a ~100KB copy that lives on my laptop and phone. I can see all photos I've ever taken on my phone, but still have the full-res copy backed up.

Re: Ask HN: How do you back up your data?

#38

This is not answering the question, but someone please build this for me (and hopefully a million others): Simple live off-site backup for worst-case scenario. I buy a pair of devices (e.g. Tonidos) with attached commodity HDDs that I split with a friend. He plugs his into his network, I plug mine in. I dump files to my local device, but they actually get buffered and then stored overnight at his place, and vice-vers…

I think Crashplan's software will do this without you paying them a sub.

No, it'll back up to other computers with a Crashplan account. I don't want to depend on third parties who may or may not be around, I want to give a drive to a friend and say: Plug this in.

Re: Ask HN: How do you back up your data?

#39
post #12

For my laptop: I use backblaze for everything. I have timemachine setup on a small server (running zfs and snapshotting). I also use arq to backup more important stuff an extra time to S3. For servers with data, which currently is just postgres - Heroku pg backups. We download, verify and archive them on S3 and to local server.

> I have timemachine setup on a small server (running zfs and snapshotting).

Are you talking about the Apple Time Machine app here? I'd be curious to hear about your setup if so. Right now I'm using time machine to a USB attached HDD, because my last foray into network attached volumes + time machine (using linux/samba as the volume host) was pretty painful.

I also like the idea of ZFS and periodic array scrubbing to detect invisible failures, which most RAIDesque configurations ignore.

Re: Ask HN: How do you back up your data?

#40
I've been burned before, so now I use a mix of incremental networked backups and offsite storage. My home server runs ZFS, snapshotting every hour/day/week. Critical files get sent off to TarSnap each night. Friday nights, a script archives important data to a set of tar.gz files that are written out to an external HDD. Saturday mornings, I take the HDD to the bank and swap it with its counterpart in my safe deposit box. It's a bit cumbersome, but it works for me.
Post reply on HN