Live data from Hacker News

Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

github.com

41–50 of 72 posts

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#41
post #27

Reported to Github, as Commercial software masquerading as various open free license projects (MIT, GPL, BSD, etc.). Also, intentional namespace pollution with existing backup tool, which IS gpl'ed. Not cool. Not cool at all. ____________________________________ (response, since I'm submitting 'too fast'... ): Github has commercial repos, and private repos. It's pretty simple, really. If you want the free options on…

Wait, how's it masquerading as what?

The name is very similar to the GPL software Duplicity, and the license is not a free software license.

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#42
post #33

For about the last year or so I've been looking for an online backup system with the following requirements: - Off-site storage, preferably not costing too much. - Option for on-site storage (e.g., to store a backup "in the cloud" and on my NAS) - Keeps version history, with the associated goodies (purging old backups, etc) - Able to run on FreeBSD and Linux, with Windows and MacOS being nice to have but not required…

Have you looked at crashplan? Although I can't say I've tried running it on FreeBSD...

I haven't looked at Crashplan in detail yet, though one of my co-workers uses it for his Macs and is happy with it.

A quick Google search gives me the feeling that it runs under FreeBSD's Linux emulation and the port seems to break occasionally. I could run it on a real Linux in a VM on FreeBSD though, so that's a potential option.

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#44
post #27

Reported to Github, as Commercial software masquerading as various open free license projects (MIT, GPL, BSD, etc.). Also, intentional namespace pollution with existing backup tool, which IS gpl'ed. Not cool. Not cool at all. ____________________________________ (response, since I'm submitting 'too fast'... ): Github has commercial repos, and private repos. It's pretty simple, really. If you want the free options on…

> Their license, however, is very much NON-FREE. As in, if I click clone, since I work for an employer of 50k people, I'm in violation. Full stop. And we're not even talking about developing on it, or submitting PR's, or what have you. This is simple copy which puts me in violation.

I'm not a lawyer, but the user cap would seem to apply to "use" of the software, not simple copying.

https://fair.io/

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#45

Earlier quoted context omitted.

Wait, how's it masquerading as what?

The name is very similar to the GPL software Duplicity, and the license is not a free software license.

While I'd agree it's similar, it's not the same.

Public projects on GitHub do not need to be under an open source license - there is absolutely no requirement for that anywhere.

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#46
post #27

Reported to Github, as Commercial software masquerading as various open free license projects (MIT, GPL, BSD, etc.). Also, intentional namespace pollution with existing backup tool, which IS gpl'ed. Not cool. Not cool at all. ____________________________________ (response, since I'm submitting 'too fast'... ): Github has commercial repos, and private repos. It's pretty simple, really. If you want the free options on…

Wait, how's it masquerading as what?

It's a derivative work of, at least, an LGPL[0] and Apache2[1] project, but does not include any copyright notices or attribution at all.

[0] - https://github.com/gilbertchen/goamz/blob/master/LICENSE

[1] - https://github.com/gilbertchen/azure-sdk-for-go/blob/master/...

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#47
post #27

Reported to Github, as Commercial software masquerading as various open free license projects (MIT, GPL, BSD, etc.). Also, intentional namespace pollution with existing backup tool, which IS gpl'ed. Not cool. Not cool at all. ____________________________________ (response, since I'm submitting 'too fast'... ): Github has commercial repos, and private repos. It's pretty simple, really. If you want the free options on…

The naming clash is unfortunate, but will at some point become inevitable as more tools doing the same thing (de-duplicating backup in this case) are created.

GitHub does not restrict licensing on their public repositories; I'm not interested in declaring myself a shaman for the "spirit of GitHub" to address that point.

http://www.infoworld.com/article/2615869/open-source-softwar...

I do agree with this part of your post:

Not cool. Not cool at all.

Either naivety or guerilla growth hacking / marketing; we'll see how things shake out.

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#48
post #35

Can someone explain how it's able to make small updates, e.g. to s3? How does it know what's already there -- cache? How does it prune old chunks -- will there be tons of individual API requests to S3?

I haven't read the code (read: speculation ahead!), but at least the "what's already there" part seems rather easy to me if the backups are performed in a chunk-based, deduplicated way (cf. also borg backup[1] and restic[2]): First, you perform a GET BUCKET[3], which gives you a list of all files in the bucket. If you name your chunk files after their hashes, that's all the info you need about which chunks you still have to upload. You can then proceed to chunk your local files and upload the missing parts.

The only question remaining would be the amount of data (i.e. filenames) you'll have to download per amount of data in the backups, which you can vary by adjusting the chunking size.

[1]: https://github.com/borgbackup/borg

[2]: https://restic.github.io/

[3]: http://docs.aws.amazon.com/AmazonS3/latest/API/RESTBucketGET...

Edit: Of course, because S3's PUT OBJECT[4] is idempotent in this case (i.e. ignoring hash collisions as their probability should be orders of magnitude lower than a doomsday scenario), you could of course just transfer each chunk every time. Realistically, all this would do is hog your bandwidth and ruin your performance. That's why it's possible to make the whole thing lock-free; otherwise you could always run into the problem of uploading the same chunk twice.

[4]: http://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectPUT...

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#49

Earlier quoted context omitted.

I didn't want to sound like duplicity intentionally, but duplicacy.com was still available at that time and I thought it was a perfect name for a backup tool...

For what it's worth, I thought this was Duplicity until I read the comment even after I did a quick glance at the github repo. Since you're both in backup, this is going to be very confusing to people.

Same here.

Edit: Come to think of it, it seems quite funny how many backup solutions are named akin to this, while, under the hood, they actually go through great lengths to actually get rid of duplicates. Maybe a name deriving from "condensing" or "shelving" would be more accurate? ;-)

Re: Duplicacy: Lock-free deduplication cloud backup tool, with “fair source” license

#50
post #34
post #25

The website makes it sound just like Tarsnap. Am I wrong? Is there some compelling feature I am missing that would make me want to switch from Tarsnap?

AFAIK Tarsnap backups go through Tarsnap's server but every other backup tool seems to not have that requirement.

Does this mean Tarsnap de-dupes before encrypting? That doesn't seem to make sense but I don't see any other reason going through their server would be required.
Post reply on HN