Live data from Hacker News

Casync – A tool for distributing file system images

0pointer.net

1–10 of 36 posts

Re: Casync – A tool for distributing file system images

#4
post #3

What is the difference between Casync & rclone ( https://rclone.org )?

rclone is a nice cloud cloning solution for files and folders. casync is intended to clone and delta entire filesystems, in a way that makes them nicely deployable. rclone is very cloud focused while casync says nothing of the details of how images are served.

casync also has fs composition, a multitude of recorded file attributes, automatic reflinking/hardlinking, uid/gid shifting, and so much more.

tl;dr: rclone is for files, casync is for entire filesystems/deployments.

Re: Casync – A tool for distributing file system images

#5
post #2

If you read the internals description it could just as well be about Borg, very similar principles here, though the application is very different. By the way, both buzhash and SHA-256 are kinda poor choices for a new system, especially one that targets servers.

Yap borg is the first thing I thought of. It already does a lot of this an more: encryption, configurable encoding, a rolling hash computed by the Buzhash algorithm and so on.

Maybe it wasn't geared for CDN delivery during restores but otherwise I've been impressed by borg so far (haven't deployed it in production, only played with it locally though).

https://github.com/borgbackup/borg

This is a description of the internal design:

http://borgbackup.readthedocs.io/en/stable/internals.html

Re: Casync – A tool for distributing file system images

#6
post #4
post #3

What is the difference between Casync & rclone ( https://rclone.org )?

rclone is a nice cloud cloning solution for files and folders. casync is intended to clone and delta entire filesystems, in a way that makes them nicely deployable. rclone is very cloud focused while casync says nothing of the details of how images are served. casync also has fs composition, a multitude of recorded file attributes, automatic reflinking/hardlinking, uid/gid shifting, and so much more. tl;dr: rclone is…

Thanks for explaining

Re: Casync – A tool for distributing file system images

#8
post #2

If you read the internals description it could just as well be about Borg, very similar principles here, though the application is very different. By the way, both buzhash and SHA-256 are kinda poor choices for a new system, especially one that targets servers.

both buzhash and SHA-256 are kinda poor choices for a new system

Why?

Re: Casync – A tool for distributing file system images

#9
I think this is a very useful tool if working with arbitrary file changes on block devices, but it's still very low level and would need a crapton of modification/wrapping to make it useful in a complex system. I would rather use Kickstart or the like to distribute changes intelligently, or barring that, rsyncing hardlinked directory trees, or zsync (but RPM/Yum would really be ideal due to the features gained)

Re: Casync – A tool for distributing file system images

#10
post #5
post #2

If you read the internals description it could just as well be about Borg, very similar principles here, though the application is very different. By the way, both buzhash and SHA-256 are kinda poor choices for a new system, especially one that targets servers.

Yap borg is the first thing I thought of. It already does a lot of this an more: encryption, configurable encoding, a rolling hash computed by the Buzhash algorithm and so on. Maybe it wasn't geared for CDN delivery during restores but otherwise I've been impressed by borg so far (haven't deployed it in production, only played with it locally though). https://github.com/borgbackup/borg This is a description of the in…

The "latest" version of that page has seen significant additions: http://borgbackup.readthedocs.io/en/latest/internals.html
Post reply on HN