I cannot recommend rclone enough. Been using it to transfer petabyte-scale datasets flawlessly. Available as librclone as well
it even has a decent Android client in F-droid, RCX. I just wish it supported SSHFS
Ask HN: Best modern file transfer/synchronization protocol?
31–40 of 59 posts
Re: Ask HN: Best modern file transfer/synchronization protocol?
#32Re: Ask HN: Best modern file transfer/synchronization protocol?
#33It allows you to sync between 2 machines (bi-directional) over TCP or SSH.
Note that TCP way is not encrypted, you may use wireguard as transport layer encryption for that purpose...
You can use an external application to copy if file size is larger than an arbitrary number. (Eg: use rsync for files > 1gb)
Re: Ask HN: Best modern file transfer/synchronization protocol?
#34Re: Ask HN: Best modern file transfer/synchronization protocol?
#35I highly recommend Unison ( https://github.com/bcpierce00/unison ) It allows you to sync between 2 machines (bi-directional) over TCP or SSH. Note that TCP way is not encrypted, you may use wireguard as transport layer encryption for that purpose... You can use an external application to copy if file size is larger than an arbitrary number. (Eg: use rsync for files > 1gb)
that said, i haven't managed to set it up for my android phone yet - it's not available in termux and i have NO idea where to start if i'd like to package it myself. probably has to be done by someone who knows ocaml, since termux' environment is so different from normal linux.
unless... maybe i should give proot a shot (chroot in termux, lets you run something closer to linux). but it's another layer of complexity on top of everything....
Re: Ask HN: Best modern file transfer/synchronization protocol?
#36I use syncthing for this. It's a little fiddly to set up, and transfer speeds aren't great. However, it's very reliable once configured, and it barely uses any resources after an initial scan of the folder you want to sync.
You can ease the eureka moment by remembering that each node is completely independent and decided what comes in, and suggests what goes out.
You can say that a folder is two way on a node and read only on another - and this is great because tout make decisions locally that allow you to build nice things.
The real issue is that you have to check on both sides of the pipe what is allowed.
It is very robust and good for LAN and remote sync (the traffic is outgoing to a relay server. Note that many of these relay servers are also TOR nudes so they can be flagged by your severity systems. You can always use your own)
Re: Ask HN: Best modern file transfer/synchronization protocol?
#37Re: Ask HN: Best modern file transfer/synchronization protocol?
#38Earlier quoted context omitted.
it even has a decent Android client in F-droid, RCX. I just wish it supported SSHFS
RCX is approaching abandonware status (last release 2y ago). Round Sync is worth a look.
Re: Ask HN: Best modern file transfer/synchronization protocol?
#39Do a 3 way sync with the s3 command line tool.
That way, you have a neat cloud backup as well. Wouldn't take any more than 20 minutes total to set up.