Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I Nearly Lost All of My Data

kevq.uk

Post reply on HN
Print view View original

171–180 of 262 posts

Re: I Nearly Lost All of My Data

#171

Post by verytrivial »

derekp7 wrote: post #13

The best solution I found as an alternative to an off-site copy is to set up a USB drive and something like a Raspberry Pi in my car. When I pull into the garage, the house server senses it and syncs new data to it. This can be supplemented further by having it auto sync to a computer in your office whenever you pull into work. Add in some monitoring so you can get a phone alert if any of the synced copies are more t…

Ha! That sounds like such a neat idea that I'm now skeptical that it is indeed just an idea! Do you have a write up somewhere? That sounds really cool.

Re: I Nearly Lost All of My Data

#172

Post by therein »

fro0116 wrote: post #137

I currently have way to much data lying around for any metered cloud storage to be economical, so I'm currently subscribing to both Backblaze and Crashplan for their unlimited storage backup plans. Crashplan killed off their consumer plan a while ago, so I ended up moving to their business plan at double the price. In my case even at that price it was still worth it considering the amount of storage I'm using. Anyone…

I'm using restic with a Backblaze backend and I couldn't be happier.

Re: I Nearly Lost All of My Data

#173

Post by xupybd »

ams6110 wrote: post #147
xupybd wrote: post #97

Earlier quoted context omitted.

Family photos and videos can take up a lot of space. Also it sounds like the authors work is backed up to this NAS as well. I wouldn't have that much to backup but some do, depending on their hobbies and work.

Photos, videos... Yeah I used to save that stuff. I realized I never looked at it again. So I just stopped. I literally don't worry about losing data at home. Work is different of course.

I think for some this might be the case but there are some photos people hold dear. Wedding photos, children growing up and other major life events. Each to their own.

Re: I Nearly Lost All of My Data

#174

Post by [deleted] »

derekp7 wrote: post #13

The best solution I found as an alternative to an off-site copy is to set up a USB drive and something like a Raspberry Pi in my car. When I pull into the garage, the house server senses it and syncs new data to it. This can be supplemented further by having it auto sync to a computer in your office whenever you pull into work. Add in some monitoring so you can get a phone alert if any of the synced copies are more t…

[deleted]

Re: I Nearly Lost All of My Data

#175

Post by philjohn »

basilgohar wrote: post #103
philjohn wrote: post #46

There isn't really a good excuse not to have an offsite backup, especially when services like back blaze are $5 a month. Also ... RAID is not a backup.

Backblaze is great. But their desktop backup solution for $5/month is not available beyond Windows and MacOS. Their B2 storage is via duplicity, but that quickly exceeds $5/month with typical storage cases.

Fair point. It would be great if Backblaze supported Linux with a desktop client.

So I guess the options would be desktop backup on the various computers that feed the current NAS solution.

Re: I Nearly Lost All of My Data

#176

Post by sooheon »

rsync wrote: post #135

Hard to believe we are 129 comments into this and there are zero mentions of 'borg' in the comment threads ... For those that don't know, borg is a backup utility[1] that has been called the "holy grail of backups"[2]. It takes your plaintext files and directories, chops them into gpg-encrypted chunks with encrypted, random filenames, and will upload (and maintain) them, with an efficient, changes-only update, to any…

Apparently the one downside of Borg is that it has to walk the whole filesystem for backups, rather than picking up changes: https://github.com/borgbackup/borg/issues/325

According to a more up to date comparison[1] (recommends Arq), Borg is also slow because it processes sequentially.

[1]: https://www.lullabot.com/articles/backup-strategies-for-2018

Re: I Nearly Lost All of My Data

#177

Post by techload »

m3nu wrote: post #152
rsync wrote: post #135

Hard to believe we are 129 comments into this and there are zero mentions of 'borg' in the comment threads ... For those that don't know, borg is a backup utility[1] that has been called the "holy grail of backups"[2]. It takes your plaintext files and directories, chops them into gpg-encrypted chunks with encrypted, random filenames, and will upload (and maintain) them, with an efficient, changes-only update, to any…

Let's also mention Vorta, an open source GUI for Borg to make it as easy to use as commercial backup tools. We just started translating into different languages. All input and PRs are welcome. https://github.com/borgbase/vorta/ (I'm the original author, but Thomas, the current Borg maintainer is also very active.)

Any plans to have a Windows client of Vorta? [Edit: Saw it now: "Windows is currently not supported by Borg, but this may change in the future."]

Re: I Nearly Lost All of My Data

#178

Post by stevekemp »

Jedd wrote: post #164
fro0116 wrote: post #137

I currently have way to much data lying around for any metered cloud storage to be economical, so I'm currently subscribing to both Backblaze and Crashplan for their unlimited storage backup plans. Crashplan killed off their consumer plan a while ago, so I ended up moving to their business plan at double the price. In my case even at that price it was still worth it considering the amount of storage I'm using. Anyone…

Your question - about data and transit volumes, and costs - would be answerable if you provided some actual numbers.

I'm not the poster, but I have local and remote backups of photographs.

When I shoot a model I will take 400-600 images in an hour, each about 25Mb in size. The shoot I had last weekend resulted in approximately 18Gb of RAW files, and output JPG files.

In total I have just under 3Tb of RAW, JPG, and other media files. (Sometimes I film shoots, or do some video-work at the same time.)

That kind of volume is not huge, but still painful to upload remotely. Its also at the cusp of the kind of data you can backup to a cheap SAN-box locally. I currently have two toy NAS devices each with 2x4Tb drives. If I want to bump my local capacity to 8Tb, or similar, it'll get quite expensive.

Re: I Nearly Lost All of My Data

#179

Post by keithpeter »

randyrand wrote: post #131

Pretty happy with my solution. Keeps me safe from floods, ransomware, and losing google drive access: - originals: 2TB google drive + 50GB icloud - backup #1 (autosync from drive/icloud): 4TB internal drive - backup #2 (cold storage): 4TB external drive

How often do you do the incremental backups on backup drive #2?

Some degree of cold storage would have reduced the OP's stress level when restoring their NAS mind you.

Re: I Nearly Lost All of My Data

#180

Post by distances »

blattimwind wrote: post #79
x220 wrote: post #37

Earlier quoted context omitted.

Yeah but don't you think having a raid array but not having a surge protector is missing the forest for the trees?

Power surges, brownouts etc. don't really exist in large parts of Europe. I also never unplugged my computer(s) in thunderstorms (some of which are on a USP, most of which were simply plugged into mains, no surge protector, no USP) and lost exactly zero computers to that. One of the few things that actually routinely comes with real surge arresters (i.e. gas-discharge tubes, not the MOVs plastered all over the place)…

Can confirm, I think it's over ten years since my last power glitch. I don't think I've ever even seen a surge protector; UPS I've seen a couple of times at people who run servers at home.
Post reply on HN