Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kopia: Fast and secure open-source backup software

kopia.io

Post reply on HN
Print view View original

61–70 of 138 posts

Re: Kopia: Fast and secure open-source backup software

#61

Post by cycomanic »

proxyon wrote: post #56

Where does one even acquire a VPS that makes this worth it? Most VPS pricing I've looked at is significantly more expensive than something like BackBlaze or IDrive. So what even is the point of rolling your own backups if you can't get cheap terrabytes in the cloud? And no I'm not going to consider something like S3 because Amazon's pricing is obnoxious and confusing. Edit: $70 / month for 3TB of S3. Significantly mo…

AFAIK kopia has a S3 backend so can backup to idrive E2. That said I have a vps from greencloud with 2 TB (and 4 cores) for $80 a year which is very price competitive. There are actually lots of smaller vps providers that offer cheap storage vps. Lowendtalk.com is a good place to find out about offers in particular around black Friday.

Re: Kopia: Fast and secure open-source backup software

#62

Post by danielhep »

proxyon wrote: post #56

Where does one even acquire a VPS that makes this worth it? Most VPS pricing I've looked at is significantly more expensive than something like BackBlaze or IDrive. So what even is the point of rolling your own backups if you can't get cheap terrabytes in the cloud? And no I'm not going to consider something like S3 because Amazon's pricing is obnoxious and confusing. Edit: $70 / month for 3TB of S3. Significantly mo…

I haven't tried it but it should work with Hetzner Storage Boxes over SFTP. Extremely price competitive.

Re: Kopia: Fast and secure open-source backup software

#63

Post by xgbi »

We are trying to use it for large backups of a production item, and it has not been a complete smooth ride all along.

We have many files (millions) and lots of churn over ~80Tb total.

Kopia has exhibited some issues:

- takes about 120GB (!) of ram to perform regular maintenance & takes about 5hrs to do so. There are ideas floating around to cherry pick the large inefficiencies in the GC code but it’s yet to be worked on. I’ll try to have a internship accepted to work on this in my company.

- there’s a good activity on the repository but the releases are not quick to come and the PRs are not very fast to be examined

- the local cache gets enormous and if we try to saddle it, we have huge download spikes (>10% of repo size) during maintenance. Same as above: pb is acknowledged but yet to be solved

- the documentation is very S3 centric, and we discovered too late that the tiered backup (long term files go into cold storage on s3) is only supported on S3, while we use azure. We contributed a PR to implement it in June, yet to be merged (see point 2)

So, not too bad, especially for a small-ish project maintained by mainly one person (from the looks of my interactions on slack and seeing the commit log). The maintainer is easy to reach and will answer, but external prs are slow. If I could use zfs cheaply on azure via s3, I’d use it over kopia, but as of now, it works.

Re: Kopia: Fast and secure open-source backup software

#64

Post by wmf »

proxyon wrote: post #56

Where does one even acquire a VPS that makes this worth it? Most VPS pricing I've looked at is significantly more expensive than something like BackBlaze or IDrive. So what even is the point of rolling your own backups if you can't get cheap terrabytes in the cloud? And no I'm not going to consider something like S3 because Amazon's pricing is obnoxious and confusing. Edit: $70 / month for 3TB of S3. Significantly mo…

S3 is the most expensive object storage; there are plenty of cheaper options like B2, Wasabi, or Coldline.

Re: Kopia: Fast and secure open-source backup software

#65

Post by johnchristopher »

havaloc wrote: post #6

I was using Vorta/Borgbase until I discovered that Vorta had an issue with restores. Kopia is pretty neat, but make sure you test as always.

> I was using Vorta/Borgbase until I discovered that Vorta had an issue with restores.

Such as ?

Re: Kopia: Fast and secure open-source backup software

#67

Post by Linux-Fan »

monlockandkey wrote: post #36

Can someone please help decide what is the "best" backup software? - Restic ( https://restic.net/ ) - Borg backup ( https://www.borgbackup.org/ ) - Duplicati ( https://www.duplicati.com/ ) - Kopia ( https://kopia.io/ ) - Duplicay ( https://duplicacy.com/ ) - Duplicity ( https://duplicity.us/ )

Bupstash (https://bupstash.io/) beats Borg and Kopia in my tests (see https://masysma.net/37/backup_tests_borg_bupstash_kopia.xhtm...). It is a modern take very close to what Borg offers regarding the feature set but has a significantly better performance (in terms of resource use for running tasks, the backups were slightly larger than Borg's in my tests).

Re: Kopia: Fast and secure open-source backup software

#69

Post by jiggawatts »

xgbi wrote: post #63

We are trying to use it for large backups of a production item, and it has not been a complete smooth ride all along. We have many files (millions) and lots of churn over ~80Tb total. Kopia has exhibited some issues: - takes about 120GB (!) of ram to perform regular maintenance & takes about 5hrs to do so. There are ideas floating around to cherry pick the large inefficiencies in the GC code but it’s yet to be worked…

“ZFS on Azure via S3” is missing just an Apple technology to win the “mixing vendors randomly” bingo.

Re: Kopia: Fast and secure open-source backup software

#70

Post by chenxiaolong »

Kopia is great, though it's worth noting for folks on Linux: non-UTF-8 paths aren't stored correctly [1] and xattrs aren't stored [2]. While most folks probably won't care about the former, the latter can could cause issues (eg. losing SELinux labels makes it difficult to restore a backup of the root filesystem on distros that use SELinux).

[1] https://github.com/kopia/kopia/issues/1764

[2] https://github.com/kopia/kopia/issues/544

Post reply on HN