Live data from Hacker News

Ask HN: Help me fix your backups

spreadsheets.google.com

21–30 of 42 posts

Re: Ask HN: Help me fix your backups

#21

Dropbox solved everything backup related for me, and I love it.

On the Mac, Dropbox doesn't do so well with restoring metadata: http://www.haystacksoftware.com/blog/2010/06/the-importance-... http://www.haystacksoftware.com/arq/dropbox-backup-bouncer-t... (Disclaimer -- I write backup software: http://haystacksoftware.com/arq/ )

What does this mean for regular people?

Re: Ask HN: Help me fix your backups

#22
post #14

Earlier quoted context omitted.

Absolutely agree. Only problem: getting the 100gb option is too expensive for me (for now), which is a shame. Also, I'd love it if they had a much larger size as well, so I can quietly back up everything without worrying about space.

Currentlig using 60% of my 51GB. I've got all workrelated files there (I'm a webdesigner), my music and a folder of collected inspiration. No videos.

I'm also on about 50% of my 50GB. The thing is, I'd rather dump everything in there and not worry about what is and is not "critical".

Re: Ask HN: Help me fix your backups

#23
post #6

How is your data backed up? ... [X] I use Tarsnap ... Where's the "I am Tarsnap" option? Somewhat related: Are the responses to this going to be made public somewhere? I'd love to see what they look like (for obvious reasons) and was thinking just last week that maybe I should post a survey to HN and Reddit.

Lol. I knew it was you as soon as I saw "I use tarsnap" as the only one checked. I love Tarsnap. I use you for a lot of very-critical-yet-small files. My personal pain point is that I'd like to back up a few TB of data but can't afford to--it would be nice to back up an entire workstation. I'm interested in seeing if that's a sentiment that others share, or if it's just me.

Personally I use Puppet to handle configuration of all my systems. All code is on git/hg on codebasehq.com. This means that I don't need to backup entire systems, only databases and other user created content (which I use tarsnap for).

Re: Ask HN: Help me fix your backups

#24

Earlier quoted context omitted.

On the Mac, Dropbox doesn't do so well with restoring metadata: http://www.haystacksoftware.com/blog/2010/06/the-importance-... http://www.haystacksoftware.com/arq/dropbox-backup-bouncer-t... (Disclaimer -- I write backup software: http://haystacksoftware.com/arq/ )

What does this mean for regular people?

I tried to explain that in the blog post. Some quick examples: If you back up a Mac app using Dropbox and then restore it, nothing happens when you double-click on it because the executable file within it wasn't set to be executable. If you restore your "downloaded files" with Dropbox, the "quarantine" metadata won't be there so you won't get the "This is an application downloaded from the Internet" warning. If you restore a "bundle" (e.g. an iPhoto Library) the bundle won't look like a single file anymore -- it'll look like a folder; double-clicking on it would open the folder instead of launching iPhoto. Modification timestamps are all set to the current time, so if you used that information to find things in the past you're out of luck.

Re: Ask HN: Help me fix your backups

#25
post #19
post #8

Earlier quoted context omitted.

My personal pain point is that I'd like to back up a few TB of data but can't afford to--it would be nice to back up an entire workstation. Why do you have a few TB of data on a workstation? What sort of work are you doing?

I'm not the OP but I'll add my datapoint here. I have that just because of digital photography. My current 12MP camera fills up a 16GB card easily if I am covering a 2-3 hour event for some friend. That adds up fast. Right now I do a versioned rsync to a server I host myself that has a (just upgraded from 1TB) 4.5TB RAID5 array. That was ~400$ in disks when I upgraded. Even at the current ~1TB usage that would be 360…

Comparing S3 to an offsite RAID volume seems like apples to oranges. The biggest difference I think is the data are stored in multiple data centers and Amazon takes care of all the issues with that. There were a lot of interesting comments about S3 cost here: http://news.ycombinator.com/item?id=422225

It would be awesome if Amazon offered something analogous to a single offsite automagically-expanding RAID volume for a lot less money than S3.

Re: Ask HN: Help me fix your backups

#26
post #6

How is your data backed up? ... [X] I use Tarsnap ... Where's the "I am Tarsnap" option? Somewhat related: Are the responses to this going to be made public somewhere? I'd love to see what they look like (for obvious reasons) and was thinking just last week that maybe I should post a survey to HN and Reddit.

Just to note, I've had very good results with tarsnap, thanks cperciva!

I'm hoping that the results are made public they'll be anonymised at least somewhat.

Re: Ask HN: Help me fix your backups

#27
"The biggest problem with backups is"

Missing option is impact on the computer while I'm using it. All of the transparent services (especially Time Machine) that I have experience with are abysmally bad at turning themselves off when the machine is being actively used.

Re: Ask HN: Help me fix your backups

#28
post #8

Earlier quoted context omitted.

Lol. I knew it was you as soon as I saw "I use tarsnap" as the only one checked. I love Tarsnap. I use you for a lot of very-critical-yet-small files. My personal pain point is that I'd like to back up a few TB of data but can't afford to--it would be nice to back up an entire workstation. I'm interested in seeing if that's a sentiment that others share, or if it's just me.

My personal pain point is that I'd like to back up a few TB of data but can't afford to--it would be nice to back up an entire workstation. Why do you have a few TB of data on a workstation? What sort of work are you doing?

FWIW, I also have the same problem (I'm a tarsnap user). I current have just shy of 2TB of GIS data (1.6TB is elevation data alone), so right now I backup everything except my GIS data. I loves me some tarsnap for the other stuff, but right now it's not a solution for this much data.

This is definately a pain point of mine. Luckily, the data doesn't change often, and if I needed to restore from data loss it doesn't need to happen ASAP. So I'm thinking just saving the data to seperate hard disks and storing those in a safety deposit box will fulfill my needs.

Does that sound right? Or am I missing some large dangers in this solution? (I'm pretty new to this stuff)

Re: Ask HN: Help me fix your backups

#29

"The biggest problem with backups is" Missing option is impact on the computer while I'm using it. All of the transparent services (especially Time Machine) that I have experience with are abysmally bad at turning themselves off when the machine is being actively used.

That's my favorite aspect of Windows Home Server's backup. It does it once a day whenever you're asleep. It'll even wake up your machine, back it up, and them put it back to sleep. And it's smart enough to only do this if you're laptop is plugged into AC and not running on battery. And if any machine isn't backed up in a while, you get a Health warning in your system tray. And this is all pretty configurable.

How's that for low impact.

Re: Ask HN: Help me fix your backups

#30
post #22

Earlier quoted context omitted.

Currentlig using 60% of my 51GB. I've got all workrelated files there (I'm a webdesigner), my music and a folder of collected inspiration. No videos.

I'm also on about 50% of my 50GB. The thing is, I'd rather dump everything in there and not worry about what is and is not "critical".

That's what I've done.
Post reply on HN