Earlier quoted context omitted.
10 different tools? Ridiculous! We need to develop one universal tool that covers everyone's use cases.
And then we'll have 11.
Pretty sure that was the intended joke, as many people came across the XKCD [1] already.
Magic Wormhole: get things from one computer to another, safely
111–120 of 262 posts
Re: Magic Wormhole: get things from one computer to another, safely
#112To send a file from one computer to the other by internet (although often internet should not be needed for this), I think netcat should do. Use tar or something else like that if you want to send multiple files. Use programs to calculate the hash if you want to verify the hash of the file. For large files, it does help to make resumable transfer; fortunately, that can be done easily, too (you can see what the file size is and use the "tail" program to skip some).
You should not need HTTP, FTP, etc. You should be able to use something which can work on any computers, such as just TCP/IP. Unfortunately, some systems (especially some Windows systems) will make that difficult. Using the more complicated such as Magic Wormhole and other programs means you will need two computers that support such a thing. I did once try to transfer a file from Windows to Linux, and had to install ncat to do so but Windows deletes it by default if you try to do that, but I was able to make it to not to do that.
Re: Magic Wormhole: get things from one computer to another, safely
#113What do all the brilliant folk here think of Resilio Sync?
Re: Magic Wormhole: get things from one computer to another, safely
#114A similar project with some nice features that I use is croc: https://github.com/schollz/croc
I've used https://file.pizza a bunch before, only because of the memorable name
It was useless for large files when I tried it, at least on Firefox. It seemed to be trying to pull the entire file into RAM.
Re: Magic Wormhole: get things from one computer to another, safely
#115Earlier quoted context omitted.
It took this far down in the comments to get to some inkling of the meat of this. It relys on some singular or small set of donated servers? NAT NAT traversal is obviously the biggest motivator, since otherwise you just scp or rsync or sftp if you don't have the dual barrier. Is the relay server configurable? Seemed to be implied it is somewhat hardcoded.
Yes, it relies on two servers, both of which I run. All connections use the "mailbox server", to exchange short messages, which are used to do the cryptographic negotiation, and then trade instructions like "I want to send you a file, please tell me what IP addresses to try". Then, to send the bulk data, if the two sides can't establish a direct connection, they fall back to the "transit relay helper" server. You onl…
Can you turn the magic wormhole into an API for receiving a JSON payload directly into your magic wormhole ontop of whatever youre running in a fastAPI to route that incoming wormhole listener?
Re: Magic Wormhole: get things from one computer to another, safely
#116To send a file from one computer to the other by internet (although often internet should not be needed for this), I think netcat should do. Use tar or something else like that if you want to send multiple files. Use programs to calculate the hash if you want to verify the hash of the file. For large files, it does help to make resumable transfer; fortunately, that can be done easily, too (you can see what the file s…
How do you transfer between computers behind NAT or firewalls without an intermediary?
If you have to install software anyway why not install wormhole directly?
Netcat works in some circumstances and it’s fine to use it in those. But wormhole covers different scenarios and your netcat proposal doesn’t cover or have advantages in some of them.
Re: Magic Wormhole: get things from one computer to another, safely
#117I realize this is a dumb question, but what's a good way to do this between an iPhone and a MacBook? Airdrop is disabled (by policy), iCloud storage is full (because I'm lazy), and I use syncthing on every other device, but I haven't found a client I can use on my work iPhone.
Pairdrop.net is my go-to in these cases. Easy to remember, just add a P to Airdrop :)
Re: Magic Wormhole: get things from one computer to another, safely
#118I've used this for years when passing large files between systems in weird network environments, it's almost always flawless. For some more exotic testing, I was able to run my own magic wormhole relay[1], which let me tweak some things for faster/more reliable huge file copies. I still hate how often Google Drive will fall over when you throw a 10s-of-GB file at it. [1] https://www.jeffgeerling.com/blog/2023/my-own-…
> For some more exotic testing, I was able to run my own magic wormhole relay[1], which let me tweak some things for faster/more reliable huge file copies. The lack of improvement in these tools is pretty devastating. There was a flurry of activity around PAKEs like 6 years ago now, but we're still missing: * reliable hole punching so you don't need a slow relay server * multiple simultaneous TCP streams (or a carefu…
I overall agree, but "reliable holpunching" is an oxymoron. Hole punching is by definition an exploit of undefined behavior, and I don't see the specs getting updated to support it. UPnP IGD was supposed to be that, but well...
Re: Magic Wormhole: get things from one computer to another, safely
#119Earlier quoted context omitted.
> you need a machine that can handle whatever link speeds you need I would have expected the relay server only being used for initial handshake to punch through NAT, after which the transfer is P2P. Only in the case of some network restrictions the data really flows through the relay. How could they afford running the free relay otherwise?
You cant make a p2p connection over a NAT without exposing a port on the public side of the NAT.
Go check out STUN and ICE.
The best article I've found about NAT traversal is this article from Tailscale: https://tailscale.com/blog/how-nat-traversal-works
Re: Magic Wormhole: get things from one computer to another, safely
#120I wasn't yet planning for it, but what the heck. https://zynk.it is a new project I've been working on together with a small team aimed at delivering a truly easy, fast, efficient, unlimited, privacy-respecting and pain free file-sharing experience. It’s peer-to-peer, E2EE and avoids centralized storage, aligning with the ethos of control and transparency we often discuss here. It allows users to send and receive any…
It's login/email walled. If you do want people to try it, the try button shouldn't immediately greet you with a popup to provide your full name and email address. I stopped at that point.