Live data from Hacker News

Casync – A tool for distributing file system images

0pointer.net

11–20 of 36 posts

Re: Casync – A tool for distributing file system images

#11
post #8
post #2

If you read the internals description it could just as well be about Borg, very similar principles here, though the application is very different. By the way, both buzhash and SHA-256 are kinda poor choices for a new system, especially one that targets servers.

both buzhash and SHA-256 are kinda poor choices for a new system Why?

Low software performance

Re: Casync – A tool for distributing file system images

#12
I'm not sure I buy the embedded/IoT use case; OSTree is a really good model there and is more featureful. The "well, if your filesystem image delta happens to be in the form of a lot of very small files it's not so great for CDNs" doesn't strike me as a terribly good reason to give up everything OSTree gives you (especially with stuff like the meta-updater [1] Yocto integration).

[1] https://github.com/advancedtelematic/meta-updater

(Full disclosure: I work for Advanced Telematic, the creators and maintainers of the meta-updater Yocto layer.)

Re: Casync – A tool for distributing file system images

#14
post #10
post #5

Earlier quoted context omitted.

Yap borg is the first thing I thought of. It already does a lot of this an more: encryption, configurable encoding, a rolling hash computed by the Buzhash algorithm and so on. Maybe it wasn't geared for CDN delivery during restores but otherwise I've been impressed by borg so far (haven't deployed it in production, only played with it locally though). https://github.com/borgbackup/borg This is a description of the in…

The "latest" version of that page has seen significant additions: http://borgbackup.readthedocs.io/en/latest/internals.html

Thanks. That is a better reference indeed. It's got nice diagrams as well. Can't edit my post any longer, so hopefully others will just see your message.

Re: Casync – A tool for distributing file system images

#15
post #12

I'm not sure I buy the embedded/IoT use case; OSTree is a really good model there and is more featureful. The "well, if your filesystem image delta happens to be in the form of a lot of very small files it's not so great for CDNs" doesn't strike me as a terribly good reason to give up everything OSTree gives you (especially with stuff like the meta-updater [1] Yocto integration). [1] https://github.com/advancedtelema…

Well, I am pretty sure IoT devices should be designed with security in mind, and that means that they need to be protected against offline modification. And that's something OSTree can't really deliver, but dm-crypt can. And casync works pretty well for delivering dm-crypt enabled disk images.

I think OSTree is great — but for embedded devices that are installed in the wild, humm, uh, I don't think so? I am pretty sure there are better options than that.

Re: Casync – A tool for distributing file system images

#18
Great. The chunked model (inspired by Borgbackup/Tarsnap) seems preferable to Docker layering, and diff-based approaches.

As far as I can tell, the advantages compared to Borgbackup seem to be:

* casync offers control over which FS metadata is included

* casync, the server, exposes chunks over HTTP

* casync, the library, is written in C so is more easily used by systems software.

I'm betting we'll see machinectl integration. Excellent!

Re: Casync – A tool for distributing file system images

#20
post #18

Great. The chunked model (inspired by Borgbackup/Tarsnap) seems preferable to Docker layering, and diff-based approaches. As far as I can tell, the advantages compared to Borgbackup seem to be: * casync offers control over which FS metadata is included * casync, the server, exposes chunks over HTTP * casync, the library, is written in C so is more easily used by systems software. I'm betting we'll see machinectl inte…

> I'm betting we'll see machinectl integration. Excellent!

systemd-nspawn integration is what I was thinking about too, so yeah! Nice work.

Post reply on HN