Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Duplicity: Encrypted bandwidth-efficient backup

duplicity.us

Post reply on HN
Print view View original

61–70 of 104 posts

Re: Duplicity: Encrypted bandwidth-efficient backup

#61

Post by stavros »

pdimitar wrote: post #58
stavros wrote: post #41

Earlier quoted context omitted.

After Borg, I switched to Restic: https://restic.net/ AFAIK, the only difference is that Restic doesn't require Restic installed on the remote server, so you can efficiently backup to things like S3 or FTP. Other than that, both are fantastic.

Technically Borg doesn't require it either, you can backup to a local directory and then use `rclone` to upload the repo wherever. Not practical for huge backups but it works for me as I'm backing up my machines configuration and code directories only. ~60MB, and that includes a lot of code and some data (SQL, JSON et. al.)

Sure, but rsync requires the server to support rsync.

Re: Duplicity: Encrypted bandwidth-efficient backup

#62

Post by radlad »

e12e wrote: post #54
radlad wrote: post #45

Earlier quoted context omitted.

I really like restic, and am personally happy to use it via the command line. It's very fast and efficient! However, I do wish there was better tooling / wrappers around it. I'd love to be able to set something simple up on my partner's Macbook. For example, Pika Backup, and Vorta are popular UIs for Borg of which no equivalent exists for Restic, while Borgmatic seems to be a de-facto standard for profile configurati…

> For example, Pika Backup, and Vorta are popular UIs for Borg of which no equivalent exists for Restic Have you considered?: https://github.com/netinvent/npbackup Or (not FOSS, but restore-compatible): https://relicabackup.com/features

Thanks - last time I looked at npbackup it didn't support macOS! I'll have her give it a go.

Relica looks neat, but at that point I'd either suggest she uses one of the Borg tools or write a simple wrapper for her to trigger backups instead.

edit: Still looks a bit hairy for an average user to install currently, and the maintainer writes "I'm not planning on full macos support since I don't own any mac" - https://github.com/netinvent/npbackup/issues/28

Re: Duplicity: Encrypted bandwidth-efficient backup

#63

Post by pdimitar »

stavros wrote: post #61
pdimitar wrote: post #58

Earlier quoted context omitted.

Technically Borg doesn't require it either, you can backup to a local directory and then use `rclone` to upload the repo wherever. Not practical for huge backups but it works for me as I'm backing up my machines configuration and code directories only. ~60MB, and that includes a lot of code and some data (SQL, JSON et. al.)

Sure, but rsync requires the server to support rsync.

Does rclone require rsync? Haven't checked.

Re: Duplicity: Encrypted bandwidth-efficient backup

#64

Post by stavros »

pdimitar wrote: post #63
stavros wrote: post #61

Earlier quoted context omitted.

Sure, but rsync requires the server to support rsync.

Does rclone require rsync? Haven't checked.

Oh sorry, brain fart, I thought you said rsync. I think rclone uploads everything if you don't have rclone on the server, but I'm not sure.

Re: Duplicity: Encrypted bandwidth-efficient backup

#65

Post by pdimitar »

stavros wrote: post #64
pdimitar wrote: post #63

Earlier quoted context omitted.

Does rclone require rsync? Haven't checked.

Oh sorry, brain fart, I thought you said rsync. I think rclone uploads everything if you don't have rclone on the server, but I'm not sure.

Pretty sure rclone uploads just fine without server dependencies, yeah. I never installed anything special on my home NAS and it happily accepts uploads with rclone.

Re: Duplicity: Encrypted bandwidth-efficient backup

#66

Post by stavros »

pdimitar wrote: post #65
stavros wrote: post #64

Earlier quoted context omitted.

Oh sorry, brain fart, I thought you said rsync. I think rclone uploads everything if you don't have rclone on the server, but I'm not sure.

Pretty sure rclone uploads just fine without server dependencies, yeah. I never installed anything special on my home NAS and it happily accepts uploads with rclone.

It will upload fine, but it can't upload only the changed parts of the file without server support.

Re: Duplicity: Encrypted bandwidth-efficient backup

#67

Post by nh2 »

nijave wrote: post #48
_flux wrote: post #9

I've moved to using backup tools using content-based ids with rolling window hashes, which allows deduplicating content even between different hosts—and crucially handles moving content from one host to another efficiently—even though in other scenarios I'm guessing rdiff-algorithm can produce smaller backups. The problem I have with duplicity and backups tools of its kind is that you still need to create a full back…

>borgbackup is still unable to back up to the same repo from multiple hosts at the same time, Basically still an issue. The machine takes an exclusive lock and it also adds override since each machine has to update it's local data cache (or whatever it's called) because they're constantly getting out of sync when another machine backs up bupstash looks promising as a close-to-but-more-performant borg alternative but…

What is alpha quality about bupstash?

It has less features than Kopia, but what's there looks like high-quality to me.

(I'm also using it to back up 150 TB (300 million files), on which all other dedup programs run out of memory.)

Re: Duplicity: Encrypted bandwidth-efficient backup

#68

Post by pdimitar »

stavros wrote: post #66
pdimitar wrote: post #65

Earlier quoted context omitted.

Pretty sure rclone uploads just fine without server dependencies, yeah. I never installed anything special on my home NAS and it happily accepts uploads with rclone.

It will upload fine, but it can't upload only the changed parts of the file without server support.

That I can't really speak of. I know it does not reupload the same files at least (uses timestamps) but never really checked about only uploading file diffs.

Do you have a direct link I can look at?

Re: Duplicity: Encrypted bandwidth-efficient backup

#69

Post by stavros »

pdimitar wrote: post #68
stavros wrote: post #66

Earlier quoted context omitted.

It will upload fine, but it can't upload only the changed parts of the file without server support.

That I can't really speak of. I know it does not reupload the same files at least (uses timestamps) but never really checked about only uploading file diffs. Do you have a direct link I can look at?

Nothing offhand, but basically it can't know what's on the server without reading it all, and if it can't do that locally, it'll have to do it remotely. At that point, might as well re-upload the whole thing.

Its front page hints at this, but there must be details somewhere.

Re: Duplicity: Encrypted bandwidth-efficient backup

#70

Post by pdimitar »

stavros wrote: post #69
pdimitar wrote: post #68

Earlier quoted context omitted.

That I can't really speak of. I know it does not reupload the same files at least (uses timestamps) but never really checked about only uploading file diffs. Do you have a direct link I can look at?

Nothing offhand, but basically it can't know what's on the server without reading it all, and if it can't do that locally, it'll have to do it remotely. At that point, might as well re-upload the whole thing. Its front page hints at this, but there must be details somewhere.

Not to make this an endless thread, but I have been wondering about what's the most rsync-friendly backup on-disk layout. I have found Borg to have less files and directories which I would naively think translates to less checks (and the files are not huge, too). I have tried Kopia and Bupstash as well but they both produce a lot of files and directories, much more than Borg. So I think Borg wins at this but I haven't checked Restic and the various Duplic[ati|icity|whatever-else] programs in a while (last I did at least a year ago).
Post reply on HN