41–50 of 63 posts
so, its 2014 and still people use homegrown variations of tar, rsync, git and whatnot. Or a half done solution like this, or an abandoned solution like box backup. why on earth isnt there already a perfect cross platform open source backup program? :) I know,i know..why dont i make one myself? because we dont need a nother half done solution :-b
Bup is lovely. I used it to back up my huge home folder and only switched away to rdiff-backup because (at the time) there was no support for deleting old revisions. Is there any support for that? (Of course, for a large enough hard drive, it's not much of a problem...)
Looking at the README under "Stuff that is stupid": > bup currently has no way to prune old backups Thanks for the rdiff-backup shout-out. I'm looking for a nice way to do system backups to my NAS of large VM images without having to install Crashplan. Bup and rdiff-backup both look pretty good.
This does deduplication, but can also encrypt the deduplicated blocks and store them on (say) S3.
so, its 2014 and still people use homegrown variations of tar, rsync, git and whatnot. Or a half done solution like this, or an abandoned solution like box backup. why on earth isnt there already a perfect cross platform open source backup program? :) I know,i know..why dont i make one myself? because we dont need a nother half done solution :-b
How do people who would use this kind of thing manage to have remote servers with terabytes of available disk space on them? Anything is possible with money, of course, but how is this anything other than really expensive? For example AWS S3 would be $235/month (that's $2,820/year!) for 3TB not even including any data-out transfer charges. Sure there are others that are cheaper but only marginally so. Is this really…
My suggestion is to backup your cloud servers, which are expensive and redundant and have good uplink speeds, to home servers which are cheap and have good downlink speeds. You don't need your backup file server to be ultra-reliable or even up all the time, so the cheapest possible PC sitting on a home internet connection is a pretty good choice. That way, 3TB is just $150 or so plus your electricity, and it's not a…
Another backup possibility I currently use: ZFS on a backup server (not necessarily ZFS on the system that should be backed up), pull data with rsync on the backup host to a ZFS, after that make a snapshot for an "incremental backup". So simplified it's like: rsync -avx remote:/etc /backup/ && zfs snapshot backup@`date` With zfSnap ( https://github.com/graudeejs/zfSnap ) you can tell how long incremental backups/snap…
rsync.net is an example of a host that does something like this (with daily snapshots) $> ssh rsyncnet ls .zfs/snapshot daily_2014-02-09 daily_2014-02-10 daily_2014-02-11 daily_2014-02-12 daily_2014-02-13 daily_2014-02-14 daily_2014-02-15 They allow you to customise the length of time for which these snapshots are kept, too (IIRC) (at the cost to you of the incremental extra storage)
Earlier quoted context omitted.
I wrote ddar, which is basically this but solves that particular problem, by using something other than the git packfile format. http://www.synctus.com/ddar and http://github.com/basak/ddar It's recently been made available on Homebrew, too.
How actively is it developed? How reliable is it currently?
It's a simple tool that does a simple job. It's pretty much done.
> How reliable is it currently?
No known bugs.
Earlier quoted context omitted.
I wrote ddar, which is basically this but solves that particular problem, by using something other than the git packfile format. http://www.synctus.com/ddar and http://github.com/basak/ddar It's recently been made available on Homebrew, too.
Nice. Could you add some description there how the deduplication works? I assume it uses rolling checksums to create chunk boundaries, just like bup?
That's right.
a 'backup system' that runs on python. how oxymoron.
so, its 2014 and still people use homegrown variations of tar, rsync, git and whatnot. Or a half done solution like this, or an abandoned solution like box backup. why on earth isnt there already a perfect cross platform open source backup program? :) I know,i know..why dont i make one myself? because we dont need a nother half done solution :-b
Every "perfect cross platform open source program" had to start as a homegrown variation of tar, rsync, git, and whatnot. It's not like they fall out of the sky.
Earlier quoted context omitted.
rsync.net is an example of a host that does something like this (with daily snapshots) $> ssh rsyncnet ls .zfs/snapshot daily_2014-02-09 daily_2014-02-10 daily_2014-02-11 daily_2014-02-12 daily_2014-02-13 daily_2014-02-14 daily_2014-02-15 They allow you to customise the length of time for which these snapshots are kept, too (IIRC) (at the cost to you of the incremental extra storage)
rsync.net looks awesome, but it is just way too expensive for me.
https://news.ycombinator.com/item?id=6554313
(I happen to get a discount for being a prgmr.com user, but IIRC the terms are similar.)