Live data from Hacker News

BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

borgbackup.readthedocs.io

41–50 of 124 posts

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#41
post #39

I've always been doing "two-pass" backups to achieve "3-2-1" goal: first pass is to run BorgBackup to backup devices to my home server. The second pass is to use rclone to transfer the repos on home server to an object storage service (B2). With rclone support built-in, the setup would be much easier.

I think this is heavily discouraged? Instead you should have multiple separate borg repos to minimize risk of misconfiguration and data corruption.

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#42

It wasn't recommended a bit ago to use Borg 2.0 because it wasn't baked enough. Has that changed? Are people using Borg 2?

Author calls that out right at the top of the changelog: > Beta releases are only for testing on NEW repos - do not use for production.

That's fair. There's a lot of software that is generally ok to use in beta, however, and this has been in beta for a long time.

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#43
Also BorgBackup user here: I'm running it on a Raspberry Pi to backup important documents to a Hetzner storage box via ssh. The Pi als runs OpenMediaVault to provide a SMB share on my home LAN. So whenever I scan a new document, just put it on the SMB share and from there it's backed up automatically every day.

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#45

BorgBackup user here and really happy. It was a set and forget for me and after 7 years, the deduplicated backup is still working flawlessly each week. I recommend pairing it with borgmatic [1], which helps to design away some of the complexities of the underlying borg backup. [1]: https://github.com/borgmatic-collective/borgmatic

> set and forget for me and after 7 years Please tell me you verify your backups now and then?

> Please tell me you verify your backups now and then?

Then one can't call it "set and forget", right?

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#46

BorgBackup user here and really happy. It was a set and forget for me and after 7 years, the deduplicated backup is still working flawlessly each week. I recommend pairing it with borgmatic [1], which helps to design away some of the complexities of the underlying borg backup. [1]: https://github.com/borgmatic-collective/borgmatic

> set and forget for me and after 7 years Please tell me you verify your backups now and then?

Borgmatic runs consistency checks [1] once a month on all repositories and archives and I occasionally retrieve older versions for selected files (archives with --verify-data only once a year or whenever I feel the need - there's 9TB of data in the borg repo, which takes a bit to scan). Note though that borg is not my main backup, it is the fallback "3" in the 3-2-1 principle, where my primary data is a ZFS Raidz2 and my primary backup is an offsite ZFS Raidz2 in pull mode. I added borg because I did not want to rely on a single software (ZFS), although this fear was unstained so far.

[1]: https://borgbackup.readthedocs.io/en/stable/usage/check.html

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#47

So, should I plan to switch to this rather than keep using Kopia? I was using it for years on an external drive, but then I got a NAS, and did not want to fuss with community packages to get Borg working. Kopia works fine, aside from the confusing GUI setup process, but it seems to be the least popular up and coming option. Now it seems that this can directly target SFTP? I wonder what that means for the future of Ko…

Kopia also supported rclone for a long time, though: https://kopia.io/docs/reference/command-line/common/reposito... . However, in my experience backing up over sftp with kopia can be very slow. I suspect it's unable to use parallel sessions for them (or pipelining, but rclone API probably doesn't do that).

My reason to go with kopia was that previously you were not able to backup multiple hosts into the same repo without great inefficiencies. I'm not sure if they still have resolved that. Another was its native S3 support which I use with ceph.

A perhaps more superficial personal reason is that at least Go is a statically typed language, even if its type system isn't that great..

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#48
post #22
post #12

Earlier quoted context omitted.

How good at deduping is this when encryption is enabled? I was looking at rsync.net and it killed me that they don't support encryption in a sane way.

It's very sane: encrypt the bits, then send it to the host. Curious what you think is not right with their methods.

Sure, but there is some requirement to not just blindly copy everything over-and-over, and that is where I've seen things get tricky before. If you enable encryption you have to re-upload the entire snapshot periodically.

It's annoying because if you have TBs of stuff that blows. I'm just curious what systems exist for incremental, encrypted backups that don't require full uploading new snapshots.

See here in the NOTE section. Re-reading this, it might a limitation of Duplicity. https://www.rsync.net/resources/howto/duplicity.html

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#49
post #45

Earlier quoted context omitted.

> set and forget for me and after 7 years Please tell me you verify your backups now and then?

> Please tell me you verify your backups now and then? Then one can't call it "set and forget", right?

Backup testing can be automated. I don't do this for my personal stuff, but at work there's a box that does a restore of our primary DB from backups, loads it into MySQL, and runs some smoke tests to make sure it looks roughly right. A quick script and a cronjob, and backups get tested every night.

I'm sure there's more thorough ways to do this kind of testing, but whatever level of confirmation you need automating it should be viable and then you only have to pay attention if/when something breaks.

Re: BorgBackup 2.0 supports Rclone – over 70 cloud providers in addition to SSH

#50

Earlier quoted context omitted.

Author calls that out right at the top of the changelog: > Beta releases are only for testing on NEW repos - do not use for production.

That's fair. There's a lot of software that is generally ok to use in beta, however, and this has been in beta for a long time.

Beta is beta. Hard to fault the developer using this label correctly with a clear notice for the way some other projects treat 'beta'.
Post reply on HN