Retroshare
Neat! Glad someone knows about it, heh. :D
Ask HN: What is your favorite method of sending large files?
191–200 of 363 posts
Re: Ask HN: What is your favorite method of sending large files?
#192WDT from Facebook - https://github.com/facebook/wdt/
We use it for copying hundreds of TiB's regularly, occasionally over a PiB.
Re: Ask HN: What is your favorite method of sending large files?
#193Magic Wormhole ( https://magic-wormhole.readthedocs.io/en/latest/ ) if it's between OSes. Between OSX, AirDrop works very well. I have sent >10GB files between Macs, quite quick as well. I have never send a 10TB file so I wouldn't know. None of my drives are that large yet :)
I use the magic of AirDrop as well :) Unfortunately, sometimes I'm on my Linux machine (in which case python3 -m http.server works just fine), or need to send a file to someone else and then I'd like to have at least some form of monitoring/progress. Edit: magic wormhole is awesome! Thanks! :D
There's a moderately useful one I've used quite a few times: https://snapdrop.net/
It _imitates_ the AirDrop UI, but is not compatible.
Use case is you open up snapdrop.net on both devices (nearby? same wifi?) and you can send files between, but I believe it all goes through a central server. Great for sending a few photos from phone to laptop or linux device when AirDrop isn't an option.
Re: Ask HN: What is your favorite method of sending large files?
#194Bittorrent. No, really. Lots of nice behaviors when transferring large amounts of data between arbitrary endpoints. Transferring the torrent metadata is pretty trivial and can be done via a wide range of methods, and having that flexibility can be nice. Unlike HTTP, you get reasonable retry behavior on network hiccups. Also, more robust data integrity guarantees, though a manual hash test is probably a good idea eith…
Just be careful - unless you mark that torrent private it'll get posted to the DHT and crawlers like BtDig will pick it up and list it publicly. For this reason I prefer using something like Syncthing which is designed more with this purpose in mind.
You could also gpg encrypt the file first which is a little more work but bulletproof. Maybe someone should make a tool that creates a torrent and encrypts it for you and presents a password box on the other end.
Re: Ask HN: What is your favorite method of sending large files?
#195Bittorrent. No, really. Lots of nice behaviors when transferring large amounts of data between arbitrary endpoints. Transferring the torrent metadata is pretty trivial and can be done via a wide range of methods, and having that flexibility can be nice. Unlike HTTP, you get reasonable retry behavior on network hiccups. Also, more robust data integrity guarantees, though a manual hash test is probably a good idea eith…
Sometimes I wonder if the bad connotation due to piracy made this protocol not standard (in a sense, that's not widely adopted, and people need dedicated clients, instead of it working for example in browsers). I don't know enough, maybe it has security issues, or some limits... but the fact is that it's still widely used, by tech literate people, so it still stands the test of time and it must be doing something rig…
It was probably phones and datacaps that really did it. Torrents are really only ok on laptops/desktops and the unexpected data usage for customers is much worse than the costs of distributing data.
Steam could probably benefit loads from torrents but they do have extremely good distribution servers already.
Re: Ask HN: What is your favorite method of sending large files?
#196Earlier quoted context omitted.
> Unlike HTTP, you get reasonable retry behavior on network hiccups Seriously. Zmodem/resume was doing better in 1986.
wget -c, it ain't hard.
The problem isn't the clients.
The HTTP server needs to provide optional support for range requests on that resource. (RFC 7233) Not all do.
Re: Ask HN: What is your favorite method of sending large files?
#197Earlier quoted context omitted.
Since credit cards go through the mail, I assume you can send SDs in an envelope for a few cents, right? Fast and cheap. Although this anecdote says USPS radiation scanning might wipe it, anyone have experience? https://www.thewanderinglensman.com/2014/01/warning-dont-mai...
> USPS radiation scanning might wipe it I'm skeptical of this, since when I order microSD cards online they arrive via USPS and have a perfectly valid partition table and FAT filesystem on them.
I've sent flash media through mail without problems. As well as hard drives with disks. Never had an issue.
Re: Ask HN: What is your favorite method of sending large files?
#198Earlier quoted context omitted.
Just be careful - unless you mark that torrent private it'll get posted to the DHT and crawlers like BtDig will pick it up and list it publicly. For this reason I prefer using something like Syncthing which is designed more with this purpose in mind.
You could also gpg encrypt the file first which is a little more work but bulletproof. Maybe someone should make a tool that creates a torrent and encrypts it for you and presents a password box on the other end.
Like magic warmhole?
Re: Ask HN: What is your favorite method of sending large files?
#199>10Gb - Stick it on a bitlocker encrypted USB stick and chuck it in the post. Next day download if you send it 1st class here.
<10Gb - chuck it on S3 and send a link to the other person.
Re: Ask HN: What is your favorite method of sending large files?
#2005GB on my local network: Windows File Share, Rsync, or HTTP depending on source/destination 5GB on Internet: Upload to my OVH VPS and HTTP or Rsync it to its destination 10TB, local or Internet: Physical Hard Drive. Never underestimate the bandwidth of a station wagon full of backup tapes! https://www.tidbitsfortechs.com/2013/09/never-underestimate-... And since you now buy 1TB micro SD cards, so perhaps I'd split th…
10TB, local or Internet: Physical Hard Drive. Never underestimate the bandwidth of a station wagon full of backup tapes! In Poland there is an option to send package via train for 8$. Just go to station and give package to conductor/train guard, few hours later receiver can get it at destination station. Sending HDDs full of raw video footage this way is very popular among video editors here.
In the US, you can ship using Greyhound bus lines. I wouldn't recommend it for this scenario, but I know people that ship auto parts around this way. Ship up to 100lbs for some incredibly cheap rates.