With a small bit of tweaking this could be used for syncing live SQLite databases (probably)
CDC File Transfer
31–40 of 229 posts
Re: CDC File Transfer
#32It would be interesting to also try this on more underpowered systems. E.g. aging armv5-based NAS boxes. Would we have similar performance improvements, or any improvements would be hampered by poor I/O performance and architectural inefficiencies?
Built this cdc tool for software update of embedded (Linux) systems and have deployed it with good enough performance on a couple of arm CPUs; https://github.com/oll3/bita
Though main goal has been keeping data usage low rather than speed up.
Re: CDC File Transfer
#33I took a quick glance at the repo, it wasn't totally clear to me if the client is windows only. Anyone know more?
Can I use this to replace some rsync cronjobs I have? I'd love to convert them to 'streaming' rather than updating every few minutes when the cron fires.
Re: CDC File Transfer
#34I'm currently working on a required CDC (Center for Disease Control) reporting function for a COVID test. For a second I thought this article was going to be extremely helpful.
A new CDC (Change Data Capture) approach open-sourced by Google? Quickly I, a subsequently disappointed data engineer, started reading
Re: CDC File Transfer
#35sounds like cdc_rsync should be a good replacement for rsync in a generic backup
Re: CDC File Transfer
#36I'm currently working on a required CDC (Center for Disease Control) reporting function for a COVID test. For a second I thought this article was going to be extremely helpful.
I thought Cult of the Dead Cow was back.
Re: CDC File Transfer
#37I'm currently working on a required CDC (Center for Disease Control) reporting function for a COVID test. For a second I thought this article was going to be extremely helpful.
> USB communications device class (or USB CDC class) is a composite Universal Serial Bus device class.
I may add this (and it fits somewhat nicely with file transfer..)
Re: CDC File Transfer
#38Content Defined Chunking is one of my favorite algorithms because it has some "magic" similar to HyperLogLogs, Bloom filters, etc... This algorithm is good to explain to people, to get them inspired by computer science. I usually explain the simplest variant with rolling hashes. It is interesting what the result will be (average saving on deduplication) if it is applied globally to a large-scale blob storage, such as…
[deleted]
Re: CDC File Transfer
#39Lame move google, CDC = Change Data Capture .
Re: CDC File Transfer
#40This is an excellent candidate to be used with local-first software [1]. Thanks for sharing, never knew that this algorithm existed.
[1]Local-first software: You own your data, in spite of the cloud: