On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)? scp, rsync, wormhole give me only 2-3 mb/s. For the context, I'm trying to transfer about 50-70 GB files. What's causing the bottleneck here and what am I missing? Thanks in advance! https://github.com/magic-wormhole/magic-wormhole
Ask HN: Best modern file transfer/synchronization protocol?
51–59 of 59 posts
Re: Ask HN: Best modern file transfer/synchronization protocol?
#52Re: Ask HN: Best modern file transfer/synchronization protocol?
#53On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)? scp, rsync, wormhole give me only 2-3 mb/s. For the context, I'm trying to transfer about 50-70 GB files. What's causing the bottleneck here and what am I missing? Thanks in advance! https://github.com/magic-wormhole/magic-wormhole
Are you transferring a large amount of small files?
Re: Ask HN: Best modern file transfer/synchronization protocol?
#54Earlier quoted context omitted.
Are you transferring a large amount of small files?
No, it is a large zip file.
If speed test result is much faster, the bottleneck could be the CPU incapable of encrypting/decrypting data fast enough using the default encryption method used by SCP/rsync. In that case, try unencrypted file transfer instead. Maybe just serve the file temporarily with `python -m http.server`
Re: Ask HN: Best modern file transfer/synchronization protocol?
#55Re: Ask HN: Best modern file transfer/synchronization protocol?
#56--
3. self hosted ipfs in tailscale or something? (that would be cool)
Re: Ask HN: Best modern file transfer/synchronization protocol?
#57Earlier quoted context omitted.
No, it is a large zip file.
Are speed tests (e.g. speed.cloudflare.com) on both laptop also giving similar number? If speed test result is much faster, the bottleneck could be the CPU incapable of encrypting/decrypting data fast enough using the default encryption method used by SCP/rsync. In that case, try unencrypted file transfer instead. Maybe just serve the file temporarily with `python -m http.server`
Re: Ask HN: Best modern file transfer/synchronization protocol?
#58Earlier quoted context omitted.
Are speed tests (e.g. speed.cloudflare.com) on both laptop also giving similar number? If speed test result is much faster, the bottleneck could be the CPU incapable of encrypting/decrypting data fast enough using the default encryption method used by SCP/rsync. In that case, try unencrypted file transfer instead. Maybe just serve the file temporarily with `python -m http.server`
I shall check the speed on Cloudflare but the speed is not much improved on Python HTTP server too. :(
- there is a max speed limit rule added to your access point to limit download/upload speed on one of your laptop. Remove them if you have access to the access point control panel, or use another access point
- the access point is overloaded, too many clients connected and its cpu can't keep up. Use another access point
- you are using 2.4Ghz band and it has a lot of interference in your area, try switching to 5Ghz or 6Ghz band if possible
- use adhoc transfer, directly connect to the other machine without using an access point: https://help.gnome.org/users/gnome-help/stable/net-wireless-...
Re: Ask HN: Best modern file transfer/synchronization protocol?
#59Earlier quoted context omitted.
I shall check the speed on Cloudflare but the speed is not much improved on Python HTTP server too. :(
Then the issue might be in your wireless access point, maybe one of these: - there is a max speed limit rule added to your access point to limit download/upload speed on one of your laptop. Remove them if you have access to the access point control panel, or use another access point - the access point is overloaded, too many clients connected and its cpu can't keep up. Use another access point - you are using 2.4Ghz…
(Sorry for replying late, I forgot to check back for replies)