Iroh is what you’re looking for. You can embed into your code, and it handled wire encryption, verification, and NAT hole punching. All over QUIC.
Ask HN: Best modern file transfer/synchronization protocol?
41–50 of 59 posts
Re: Ask HN: Best modern file transfer/synchronization protocol?
#42Grab an S3 bucket on amazon. Do a 3 way sync with the s3 command line tool. That way, you have a neat cloud backup as well. Wouldn't take any more than 20 minutes total to set up.
Re: Ask HN: Best modern file transfer/synchronization protocol?
#43https://iroh.computer/sendme https://iroh.computer/ Iroh is what you’re looking for. You can embed into your code, and it handled wire encryption, verification, and NAT hole punching. All over QUIC.
Re: Ask HN: Best modern file transfer/synchronization protocol?
#44Re: Ask HN: Best modern file transfer/synchronization protocol?
#45scp, rsync, wormhole give me only 2-3 mb/s.
For the context, I'm trying to transfer about 50-70 GB files.
What's causing the bottleneck here and what am I missing? Thanks in advance!
Re: Ask HN: Best modern file transfer/synchronization protocol?
#46Earlier quoted context omitted.
If you are looking to integrate into another app, maybe check https://librsync.github.io/ out.
Unfortunately one of the caveats about what librsync is not (from the link): librsync also does not include any network functions for talking to SSH or any other server. To access a remote filesystem, you need to provide your own code or make use of some other virtual filesystem layer. Having this seems to be one of the primary requirements.
Even with that, librsync highlights that rsync is really a protocol rather than the CLI tool GP post referred to.
Re: Ask HN: Best modern file transfer/synchronization protocol?
#47On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)? scp, rsync, wormhole give me only 2-3 mb/s. For the context, I'm trying to transfer about 50-70 GB files. What's causing the bottleneck here and what am I missing? Thanks in advance! https://github.com/magic-wormhole/magic-wormhole
Re: Ask HN: Best modern file transfer/synchronization protocol?
#48Re: Ask HN: Best modern file transfer/synchronization protocol?
#49Earlier quoted context omitted.
rclone is garbage if you need performance or just copy between two points you control. it shines when you need to sprinkle your data over many "clouds"
I'd argue the opposite. Rclone's parallelization options are unmatched.
Re: Ask HN: Best modern file transfer/synchronization protocol?
#50Earlier quoted context omitted.
I'd argue the opposite. Rclone's parallelization options are unmatched.
why parellization matters if you are sending from/to points you control? that's usually from one machine's ssd to another's.