Live data from Hacker News

Duplicity: Encrypted bandwidth-efficient backup

duplicity.us

11–20 of 104 posts

Re: Duplicity: Encrypted bandwidth-efficient backup

#11
post #8
post #6

If you're using S3 to back up your files, it's easier to write a shell script with the AWS CLI. For example here's a script I wrote that I run automatically to back up my computer to S3. I have an exclude array to exclude certain folders. It's simpler than downloading software and more customizable. # $1 # local folder # $2 # bucket declare -a exclude=( "node_modules" "Applications" "Public" ) args="" for item in "${…

Your script doesn't do the same thing as duplicity. Your script mirrors the local directory with your bucket. It loses all history. Duplicity does backups (ie with history) but not just that, it does differential backups to not upload everything all the time.

S3 has bucket versioning if you want to have multiple backups. The S3 sync command also does differential backups; if you for example try to run the script over and over it will only upload new/different files.

Re: Duplicity: Encrypted bandwidth-efficient backup

#12
I've had issues with Duplicity not performing backups when a single backend is down (despite it being set to continue on error). In my case an SFTP server lost its IPv6 routing so Duplicity couldn't connect to it; rather than give up on that backend and only use the other server it just gave up entirely.

Re: Duplicity: Encrypted bandwidth-efficient backup

#15
post #6

If you're using S3 to back up your files, it's easier to write a shell script with the AWS CLI. For example here's a script I wrote that I run automatically to back up my computer to S3. I have an exclude array to exclude certain folders. It's simpler than downloading software and more customizable. # $1 # local folder # $2 # bucket declare -a exclude=( "node_modules" "Applications" "Public" ) args="" for item in "${…

no encryption though

Re: Duplicity: Encrypted bandwidth-efficient backup

#16
post #6

If you're using S3 to back up your files, it's easier to write a shell script with the AWS CLI. For example here's a script I wrote that I run automatically to back up my computer to S3. I have an exclude array to exclude certain folders. It's simpler than downloading software and more customizable. # $1 # local folder # $2 # bucket declare -a exclude=( "node_modules" "Applications" "Public" ) args="" for item in "${…

no encryption though

You can encrypt S3 buckets/files inside your buckets. By default buckets are encrypted.

Re: Duplicity: Encrypted bandwidth-efficient backup

#18
post #4

I used this many, many years ago but switched to Borg[0] about five years ago. Duplicity required full backups with incremental deltas, which meant my backups ended up taking too long and using too much disk space. Borg lets you prune older backups at will, because of chunk tracking and deduplication there is no such thing as an incremental backup. [0] https://www.borgbackup.org/

Same for me. Also, on MacOs duplicity was consuming much more CPU than Borg and was causing my fan to spin loudly. Eventually I moved to timemachine, but I still consider Borg a very good option.

Re: Duplicity: Encrypted bandwidth-efficient backup

#19
post #4

I used this many, many years ago but switched to Borg[0] about five years ago. Duplicity required full backups with incremental deltas, which meant my backups ended up taking too long and using too much disk space. Borg lets you prune older backups at will, because of chunk tracking and deduplication there is no such thing as an incremental backup. [0] https://www.borgbackup.org/

I have an overnight cron that flattens my duplicity backups from many incremental backups made over the course of one day to a single full backup file, that becomes the new backup. then subsequent backups over the course of the day do incremental on that file. So I always have full backups for each individual day with only a dozen or so incremental backups tacked onto it.

that said will give Borg a look

Post reply on HN