Live data from Hacker News

Ask HN: Best modern file transfer/synchronization protocol?

news.ycombinator.com

31–40 of 59 posts

Re: Ask HN: Best modern file transfer/synchronization protocol?

#31
post #18

I cannot recommend rclone enough. Been using it to transfer petabyte-scale datasets flawlessly. Available as librclone as well

it even has a decent Android client in F-droid, RCX. I just wish it supported SSHFS

RCX is approaching abandonware status (last release 2y ago). Round Sync is worth a look.

Re: Ask HN: Best modern file transfer/synchronization protocol?

#33
I highly recommend Unison (https://github.com/bcpierce00/unison)

It allows you to sync between 2 machines (bi-directional) over TCP or SSH.

Note that TCP way is not encrypted, you may use wireguard as transport layer encryption for that purpose...

You can use an external application to copy if file size is larger than an arbitrary number. (Eg: use rsync for files > 1gb)

Re: Ask HN: Best modern file transfer/synchronization protocol?

#35
post #33

I highly recommend Unison ( https://github.com/bcpierce00/unison ) It allows you to sync between 2 machines (bi-directional) over TCP or SSH. Note that TCP way is not encrypted, you may use wireguard as transport layer encryption for that purpose... You can use an external application to copy if file size is larger than an arbitrary number. (Eg: use rsync for files > 1gb)

another vote for Unison, been using it for about a year for practically everything and it's great. takes a moment to grasp the concept, but it's 100% worth it.

that said, i haven't managed to set it up for my android phone yet - it's not available in termux and i have NO idea where to start if i'd like to package it myself. probably has to be done by someone who knows ocaml, since termux' environment is so different from normal linux.

unless... maybe i should give proot a shot (chroot in termux, lets you run something closer to linux). but it's another layer of complexity on top of everything....

Re: Ask HN: Best modern file transfer/synchronization protocol?

#36

I use syncthing for this. It's a little fiddly to set up, and transfer speeds aren't great. However, it's very reliable once configured, and it barely uses any resources after an initial scan of the folder you want to sync.

I ended up with Syncthing after trying everything else (that O can self-host).

You can ease the eureka moment by remembering that each node is completely independent and decided what comes in, and suggests what goes out.

You can say that a folder is two way on a node and read only on another - and this is great because tout make decisions locally that allow you to build nice things.

The real issue is that you have to check on both sides of the pipe what is allowed.

It is very robust and good for LAN and remote sync (the traffic is outgoing to a relay server. Note that many of these relay servers are also TOR nudes so they can be flagged by your severity systems. You can always use your own)

Re: Ask HN: Best modern file transfer/synchronization protocol?

#38
post #31

Earlier quoted context omitted.

it even has a decent Android client in F-droid, RCX. I just wish it supported SSHFS

RCX is approaching abandonware status (last release 2y ago). Round Sync is worth a look.

Thanks for the recommendation! I searched F-droid but found nothing, and then I realised it was probably.on Izzy
Post reply on HN