Live data from Hacker News

Ask HN: Best modern file transfer/synchronization protocol?

news.ycombinator.com

41–50 of 59 posts

Re: Ask HN: Best modern file transfer/synchronization protocol?

#42

Grab an S3 bucket on amazon. Do a 3 way sync with the s3 command line tool. That way, you have a neat cloud backup as well. Wouldn't take any more than 20 minutes total to set up.

Respectfully disagree. You get charged 9 cents per GB after the first 100 GB xfer each month. This doesn't fit in well with the OP's environment, which is a LAN.

Re: Ask HN: Best modern file transfer/synchronization protocol?

#43
post #41

https://iroh.computer/sendme https://iroh.computer/ Iroh is what you’re looking for. You can embed into your code, and it handled wire encryption, verification, and NAT hole punching. All over QUIC.

iroh team member here. OP we’d be happy to help! https://iroh.computer/discord if you’d like to chat

Re: Ask HN: Best modern file transfer/synchronization protocol?

#45
On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)?

scp, rsync, wormhole give me only 2-3 mb/s.

For the context, I'm trying to transfer about 50-70 GB files.

What's causing the bottleneck here and what am I missing? Thanks in advance!

https://github.com/magic-wormhole/magic-wormhole

Re: Ask HN: Best modern file transfer/synchronization protocol?

#46
post #28
post #10

Earlier quoted context omitted.

If you are looking to integrate into another app, maybe check https://librsync.github.io/ out.

Unfortunately one of the caveats about what librsync is not (from the link): librsync also does not include any network functions for talking to SSH or any other server. To access a remote filesystem, you need to provide your own code or make use of some other virtual filesystem layer. Having this seems to be one of the primary requirements.

I did not read the OP that way: cross platform support, fault-tolerance and ability to integrate into a bespoke client/server solution (iow, there is already a network client and a server).

Even with that, librsync highlights that rsync is really a protocol rather than the CLI tool GP post referred to.

Re: Ask HN: Best modern file transfer/synchronization protocol?

#47

On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)? scp, rsync, wormhole give me only 2-3 mb/s. For the context, I'm trying to transfer about 50-70 GB files. What's causing the bottleneck here and what am I missing? Thanks in advance! https://github.com/magic-wormhole/magic-wormhole

Filezilla server + client is very fast and has a resume option

Re: Ask HN: Best modern file transfer/synchronization protocol?

#49
post #30

Earlier quoted context omitted.

rclone is garbage if you need performance or just copy between two points you control. it shines when you need to sprinkle your data over many "clouds"

I'd argue the opposite. Rclone's parallelization options are unmatched.

why parellization matters if you are sending from/to points you control? that's usually from one machine's ssd to another's.

Re: Ask HN: Best modern file transfer/synchronization protocol?

#50
post #30

Earlier quoted context omitted.

I'd argue the opposite. Rclone's parallelization options are unmatched.

why parellization matters if you are sending from/to points you control? that's usually from one machine's ssd to another's.

Because the transfer will happen faster if you're copying more than one file at a time.
Post reply on HN