Live data from Hacker News

Ask HN: How do you backup your files without depending on a third party service?

news.ycombinator.com

91–100 of 112 posts

Re: Ask HN: How do you backup your files without depending on a third party service?

#91
Tentang Expert Translation Agency adalah pernyedia Jasa Penerjemah Tersumpah yang sudah sejak tahun 1996 hingga kini melayani klien-klien kami untuk kebutuhan jasa penerjemah bahasa Inggris, Jepang, Arab Dan lain-lain. http://www.experttranslationagency.com/

Re: Ask HN: How do you backup your files without depending on a third party service?

#92
HP MicroServer with FreeNAS at home, it pulls down backups from my vservers and pushes encrypted parts of local data back there.

Every few months I manually sync most of the NAS onto an external, encrypted HDD (just bought a fresh 3 TB one) and that will be stashed in other parts of town/out of country with family. It's my last line of defense should the apartment burn down or something. Data might be half a year old, but the last 20 years are mostly there. Also it's not too inconvenient.

Re: Ask HN: How do you backup your files without depending on a third party service?

#93
Just because nobody has mentioned it yet, there is a file format called zpaq [1] which is incremental and journaling with good support for linux, mac and windows. It support multi-threaded compression and error detection and recovery.

[1] http://mattmahoney.net/dc/zpaq.html

Re: Ask HN: How do you backup your files without depending on a third party service?

#95
post #68

Synology or QNAP NAS. They collect backups from all computer in the house, encrypt them and ship the encrypted blobs to AWS Glacier. Synology in particular is a fantastic platform which does way more than a traditional NAS. It's quite polished personal cloud platform (way more so than FreeNAS) and includes hundreds of apps, even the backups into the cloud can be done in different ways. I also place a premium on the f…

I would stay away from QNAP, their quality is terrible. I had a QNAP QVR and it just reeked of insecurity. My friend has one of the smaller Synology boxes with 20TB and it is pretty nice. You can think of it as the Apple of the NAS systems out there, everything just works. However, if you like to tinker with your NAS a bit more, FreeNAS is excellent. It's pretty comforting running zfs over standard RAID, and you have…

Agreed, QNAP os/distro/apps just feel shoddily made and maintained. If you maintain systems for a living you'll go berzerk trying to track down just exactly what it is doing and why and the constant (weekly?) firmware security updates.

I haven't tried Synology in a long time. I'm looking to get my few TBs off of the QNAP and sell it in favour of something custom built.

Re: Ask HN: How do you backup your files without depending on a third party service?

#96
I recently converted all my Linux boxes to use BTRFS filesystems. That allows for snapshots of each sub volume, and you can even send them (incrementally) to another btrfs drive. Last weekend I also set up btrbk, which gives you an environment to automate the process. It let's you snapshot any subvolume to a schedule you configure, and then send backups to any destination you specify via ssh, or even USB drives. Since these are incremental it uses very little bandwidth. It even has an archive function for long term storage, and just like the other backups you can define individual retention policies for each location. Did I mention it also supports non-btrfs support, encryption, and both host/server initiated backups? Awesome. Next weekend I'll set up encrypted archives to the cloud...

Re: Ask HN: How do you backup your files without depending on a third party service?

#97
post #47
post #8

I have a 4TB Hard Drive attached to an OpenWRT router (Rasberry Pi's are also a popular choice). The router exposes a locked down SSH port (SFTP only) through a cheap $5 a month VPS. I also use Jottacloud [1] who provide unlimited (yes unlimited) storage for 7.5 EUR a month. Based in Norway, they keep an up to date warrant canary. Client side, I backup to both of these services using Duplicati [2] which offers client…

Jottacloud sounds interesting, how do you integrate with it, doesn't seem to offer any standard API's besides their own CLI.

Not op but apparently he uses Duplicati to upload to jottacloud: https://duplicati.readthedocs.io/en/latest/05-storage-provid...

Re: Ask HN: How do you backup your files without depending on a third party service?

#98
post #12

If you’re tech savvy and want the easy answer then check out Tarsnap[1]. If you’re tech savvy and want to save a few bucks by doing it yourself, check out borg[2]. You’ll need to set up an external server for it but at scale (TB) it’s an order of magnitude cheaper than Tarsnap. Regardless of off site storage I’d suggest also buying two large USB drives and formatting them with LUKS. Keep them offline and only sync th…

I tried Borg for sometime and it worked fine. I used to backup to a 1TB VPS. But when I decided to move to B2 I had to look for alternatives since Borg doesn't support object storage. I'm playing around with Restic[0] these days. They have recently added many nice features, e.g compression.

Looks promising. Though I wish apps like Borg/Restic had functional GUIs, even though minimal. In fact preferably minimal. Just notifications, list of archives, info about data backed up and actual space used, scheduling etc.

[0] https://restic.net

Re: Ask HN: How do you backup your files without depending on a third party service?

#99

If you do that (just rsync every day), what happens when your primary storage gets corrupted, and you rsync the corrupted copy over your USB backup? Much better to do some sort of incremental or differential backup. As someone else said, borg is a good way of doing this. Given you're using cloud storage, you could use rclone to sync (one way, from cloud to local) to a local disk, and then use borg (on your local mach…

borg is awesome, I once happened to talk to the developer of this. He said sometimes people report bugs to him and it turns out these are hardware errors that the integrity check of it found...

Re: Ask HN: How do you backup your files without depending on a third party service?

#100
roughly, my $HOME ( 400Gb ) is rsync'ed to a external RAID ( https://www.amazon.com/Oyen-Digital-MobiusTM-FireWire-Enclos... ) , my preferred media is burn on DVDR , a few specific files go to dropbox and/or gdrive , and all my source code sits on bitbucket.
Post reply on HN