Live data from Hacker News

Ask HN: Best modern file transfer/synchronization protocol?

news.ycombinator.com

51–59 of 59 posts

Re: Ask HN: Best modern file transfer/synchronization protocol?

#51

On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)? scp, rsync, wormhole give me only 2-3 mb/s. For the context, I'm trying to transfer about 50-70 GB files. What's causing the bottleneck here and what am I missing? Thanks in advance! https://github.com/magic-wormhole/magic-wormhole

Are you transferring a large amount of small files?

Re: Ask HN: Best modern file transfer/synchronization protocol?

#52
post #31

Earlier quoted context omitted.

RCX is approaching abandonware status (last release 2y ago). Round Sync is worth a look.

Thanks for the recommendation! I searched F-droid but found nothing, and then I realised it was probably.on Izzy

Or just use rclone from inside Termux.

Re: Ask HN: Best modern file transfer/synchronization protocol?

#53

On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)? scp, rsync, wormhole give me only 2-3 mb/s. For the context, I'm trying to transfer about 50-70 GB files. What's causing the bottleneck here and what am I missing? Thanks in advance! https://github.com/magic-wormhole/magic-wormhole

Are you transferring a large amount of small files?

No, it is a large zip file.

Re: Ask HN: Best modern file transfer/synchronization protocol?

#54

Earlier quoted context omitted.

Are you transferring a large amount of small files?

No, it is a large zip file.

Are speed tests (e.g. speed.cloudflare.com) on both laptop also giving similar number?

If speed test result is much faster, the bottleneck could be the CPU incapable of encrypting/decrypting data fast enough using the default encryption method used by SCP/rsync. In that case, try unencrypted file transfer instead. Maybe just serve the file temporarily with `python -m http.server`

Re: Ask HN: Best modern file transfer/synchronization protocol?

#55

Earlier quoted context omitted.

Thanks for the recommendation! I searched F-droid but found nothing, and then I realised it was probably.on Izzy

Or just use rclone from inside Termux.

Sure, but then it's not visible across the Android filesystem

Re: Ask HN: Best modern file transfer/synchronization protocol?

#57

Earlier quoted context omitted.

No, it is a large zip file.

Are speed tests (e.g. speed.cloudflare.com) on both laptop also giving similar number? If speed test result is much faster, the bottleneck could be the CPU incapable of encrypting/decrypting data fast enough using the default encryption method used by SCP/rsync. In that case, try unencrypted file transfer instead. Maybe just serve the file temporarily with `python -m http.server`

I shall check the speed on Cloudflare but the speed is not much improved on Python HTTP server too. :(

Re: Ask HN: Best modern file transfer/synchronization protocol?

#58

Earlier quoted context omitted.

Are speed tests (e.g. speed.cloudflare.com) on both laptop also giving similar number? If speed test result is much faster, the bottleneck could be the CPU incapable of encrypting/decrypting data fast enough using the default encryption method used by SCP/rsync. In that case, try unencrypted file transfer instead. Maybe just serve the file temporarily with `python -m http.server`

I shall check the speed on Cloudflare but the speed is not much improved on Python HTTP server too. :(

Then the issue might be in your wireless access point, maybe one of these:

- there is a max speed limit rule added to your access point to limit download/upload speed on one of your laptop. Remove them if you have access to the access point control panel, or use another access point

- the access point is overloaded, too many clients connected and its cpu can't keep up. Use another access point

- you are using 2.4Ghz band and it has a lot of interference in your area, try switching to 5Ghz or 6Ghz band if possible

- use adhoc transfer, directly connect to the other machine without using an access point: https://help.gnome.org/users/gnome-help/stable/net-wireless-...

Re: Ask HN: Best modern file transfer/synchronization protocol?

#59

Earlier quoted context omitted.

I shall check the speed on Cloudflare but the speed is not much improved on Python HTTP server too. :(

Then the issue might be in your wireless access point, maybe one of these: - there is a max speed limit rule added to your access point to limit download/upload speed on one of your laptop. Remove them if you have access to the access point control panel, or use another access point - the access point is overloaded, too many clients connected and its cpu can't keep up. Use another access point - you are using 2.4Ghz…

Thank you! Shall check.

(Sorry for replying late, I forgot to check back for replies)

Post reply on HN