Live data from Hacker News

Ask HN: Best Centralized Backup Solution

news.ycombinator.com

61–70 of 70 posts

Re: Ask HN: Best Centralized Backup Solution

#61
post #58

Gitlab is surprisingly good for that. I keep backup schedules in it executed as CI pipelines. Gitlab runner executes my ansible custom code in docker container using image prepared for that purpose.

Thanks for sharing the feedback with the community. We are glad to hear how GitLab helps you.

Re: Ask HN: Best Centralized Backup Solution

#62
post #54

Earlier quoted context omitted.

I thought it was reasonably secure (consider this would only include minimal binaries required for rsync without an interactive shell), but I am relatively ignorant in this area, would you care to elaborate? LXC/D was on my radar but all of this is a little more complexity than I was anticipating dealing with myself (the security side of locking down the rsync account at least). I may even settle for "restricted rsyn…

Indeed. For clarification, FreeBSD jails are considered safe, since they add capabilities checks on top of the chroot. Chroot itself, on the other hand, is relatively easy to break out. Not sure if you have ever used, but you might enjoy FreeBSD :) using jails is not at all that difficult. To be honest I find it easier to use jails than docker. Never used LXC so I don't know how it compares with regards to ease of us…

Thanks. I've used FreeBSD before, but have far more experience using Linux in production, I may have to give it another go some time for specific purposes like this.

Re: Ask HN: Best Centralized Backup Solution

#63
post #8

Earlier quoted context omitted.

He didn't say, he's using AWS. Or did you mean something different?

He can migrate to AWS. Managing database backup manually when there is something like RDS and now RDS serverless seems like a lost cause.

Unfortunately not everyone can migrate to AWS, and not everyone would want to either.

There are plenty of reasons companies still host everything on their own servers, and can't/don't want to move their infrastructure to a cloud service.

Re: Ask HN: Best Centralized Backup Solution

#64
post #9

burp ( https://burp.grke.org/ ) comes to mind, as well. Windows and UNIX-like only, no macOS.

"For Mac users, burp is available in Homebrew. See the quick start page for more information." - https://burp.grke.org/download.html Also, I can't imagine how something could be for Unix-likes and not target Mac OS, since it is literally a certified Unix.

While I agree, that macOS is a UNIX, backup tends to be a very sensitive form of software (think scalpell, not hammer) and I would not dare to use it on a platform without certification by its vendor (in this case an "OK" by the author).

We do not live in a perfect world. But backups can have exactly zero errors.

But thanks for pointing out, that a mac brew exists. I did not see this.

Re: Ask HN: Best Centralized Backup Solution

#65
I personally use Bacula: https://www.baculasystems.com/

But in truth, it's a bit complex to setup. You have 3 daemons (agent, director and storage) each with its configuration.

This configuration files must match exactly (a bit like a nagios configuration) (http://www.bacula.org/2.4.x-manuals/en/main/Conf-Diagram.png).

Adding SSL is also a bit annoying, as there are many moving parts.

But once setup, it works quite well and bconsole is nice.

It's also quite easy to install since it's already available in most distributions.

You can set backup policies on a per job basis, do full, incremental and differential backups, you can also set a pre and post backup scripts as well as do the same for restorations. It is quite comprehensive albeit a bit complex.

At home, I use it with an old LTO-1 tape recorder/bank (IBM 3581-H17) repaired with pieces of bicycle tube (I find this kind of robots fascinating, a bit anachronistic in our age, but still relevant).

In the end, I'm not sure if I will recommend it, but it's definitely a viable option.

Re: Ask HN: Best Centralized Backup Solution

#66

Earlier quoted context omitted.

Using a file storage service like B2 or S3 as a file system is a bad idea anyway. You won’t be able to use features such as deduplication and incremental backup. It’s better to use an external tool such as Restic or Duplicacy. So moving 5GB file is just a matter of changing a few KB index file.

Depends what you're backing up IMO. In the case of my home video and pictures, I have terabytes of data that is largely unique+incompressible so the "dedupe" step on every backup program I've used so far takes a ridiculously long time and yields approximately zero space savings. Incremental backup I also don't care about because `s3 sync` already only syncs what changed, and I don't care about restoring to previous v…

Makes sense. I wasn’t think about all this use case.

Re: Ask HN: Best Centralized Backup Solution

#67
There's a lot of good descriptions in this book:

Backup & Recovery - Inexpensive Backup Solutions for Open Systems

https://www.oreilly.com/library/view/backup-recovery/0596102...

It's from 2009, but going through the comments here it seems not much has changed. It will help you choose the right tools, and with many of the open source ones, configure them.

Re: Ask HN: Best Centralized Backup Solution

#68
I've been playing with Keybase for backups. It's neat because you don't need to deal with any proprietary APIs or scripts (but you do have to install Keybase). The backups are encrypted and can be accessed from another device as well either through your own account or as part of a Keybase Team. For now you get 250 gigs free storage.

Re: Ask HN: Best Centralized Backup Solution

#70
post #42
post #5

BackupPC is the best one: https://backuppc.github.io/backuppc/ You get every professional features out of the box (full/inc backups, deduplication, compression...) & everything is automated.

backuppc works really well, the drawback is that it is kind of slow if you have lots (millions) of files.

To be fair that's because it uses rsync, and rsync is itself very slow when dealing with millions of small files.
Post reply on HN