51–60 of 70 posts
I like to rsync into a BTRFS volume, and then take a snapshot. It's simple, fine-grained (you can use .rsyncignore files like .gitignore files) and versioned.
ZFS snapshots!... I _wanted_ to use "rsync.net" for this, they use FreeBSD with ZFS snapshots in a jail, the idea is that you get your stuff onto the account however you like over SSH (i.e rsync), then the snapshots serve two purposes: snapshots through time, and read only access incase you get 0wned. I couldn't use rsync.net though because all it's datacenters are outside of EEA, i'm currently looking into doing thi…
Honestly curious, what's wrong with Switzerland? It's not technically in the EEA but it's part of EFTA and the single-market so has to meet the same requirements as an EEA country.
ZFS snapshots!... I _wanted_ to use "rsync.net" for this, they use FreeBSD with ZFS snapshots in a jail, the idea is that you get your stuff onto the account however you like over SSH (i.e rsync), then the snapshots serve two purposes: snapshots through time, and read only access incase you get 0wned. I couldn't use rsync.net though because all it's datacenters are outside of EEA, i'm currently looking into doing thi…
> I couldn't use rsync.net though because all it's datacenters are outside of EEA Honestly curious, what's wrong with Switzerland? It's not technically in the EEA but it's part of EFTA and the single-market so has to meet the same requirements as an EEA country.
The problem is our customers are not end-users, they have their own policies and a significant number of them have a much more rigid interpretation of GDPR data storage rules which we've been forced to integrate into our own. This is one of the many problems of overreach due to the fear that GDPR creates IMO.
ZFS snapshots!... I _wanted_ to use "rsync.net" for this, they use FreeBSD with ZFS snapshots in a jail, the idea is that you get your stuff onto the account however you like over SSH (i.e rsync), then the snapshots serve two purposes: snapshots through time, and read only access incase you get 0wned. I couldn't use rsync.net though because all it's datacenters are outside of EEA, i'm currently looking into doing thi…
Note that chroot is not a security feature, it can be compromised in many ways. You probably need containers like lxc/lxd
LXC/D was on my radar but all of this is a little more complexity than I was anticipating dealing with myself (the security side of locking down the rsync account at least). I may even settle for "restricted rsync". This is why I value rsync.net, they do this for me - and for a much lower cost I might add (I am not a security expert).
Earlier quoted context omitted.
Note that chroot is not a security feature, it can be compromised in many ways. You probably need containers like lxc/lxd
I thought it was reasonably secure (consider this would only include minimal binaries required for rsync without an interactive shell), but I am relatively ignorant in this area, would you care to elaborate? LXC/D was on my radar but all of this is a little more complexity than I was anticipating dealing with myself (the security side of locking down the rsync account at least). I may even settle for "restricted rsyn…
Not sure if you have ever used, but you might enjoy FreeBSD :) using jails is not at all that difficult. To be honest I find it easier to use jails than docker. Never used LXC so I don't know how it compares with regards to ease of use.
I started using Backblaze B2 on servers for storing database backups and so far it's been great. Now I wonder if `b2 sync` is a good candidate for more traditional desktop backups (documents, lots of photos...). Does anyone have feedback on it?
B2 can't do simple things like move or copy,[1] so in my opinion it's really bad for those kinds of applications. For example, if you move a 5GB video file, you shouldn't have to delete+re-upload the entire thing just to change the path. [1]: https://github.com/Backblaze/B2_Command_Line_Tool/issues/525
It’s better to use an external tool such as Restic or Duplicacy. So moving 5GB file is just a matter of changing a few KB index file.
Earlier quoted context omitted.
B2 can't do simple things like move or copy,[1] so in my opinion it's really bad for those kinds of applications. For example, if you move a 5GB video file, you shouldn't have to delete+re-upload the entire thing just to change the path. [1]: https://github.com/Backblaze/B2_Command_Line_Tool/issues/525
Using a file storage service like B2 or S3 as a file system is a bad idea anyway. You won’t be able to use features such as deduplication and incremental backup. It’s better to use an external tool such as Restic or Duplicacy. So moving 5GB file is just a matter of changing a few KB index file.
In the case of my home video and pictures, I have terabytes of data that is largely unique+incompressible so the "dedupe" step on every backup program I've used so far takes a ridiculously long time and yields approximately zero space savings.
Incremental backup I also don't care about because `s3 sync` already only syncs what changed, and I don't care about restoring to previous versions because I want it to be an append-only store, which S3 versioning gives me.
I also need it to be simple for my family to recover data from in case I die suddenly, so I don't want them to have to decode some binary format to get at our pictures and video.