Live data from Hacker News

Minbox - a faster workflow for sending files

minbox.com

11–20 of 39 posts

Re: Minbox - a faster workflow for sending files

#11
I had an idea a while back to make an SMTP server that would automatically strip out attachments, dump them on a web server, and re-write the email with a link to the attachments.

I would still love to see something that does this type of thing automatically (such as through an Outlook plugin or SMTP relay) so you can use don't have to change your workflow to get the benefit.

Re: Minbox - a faster workflow for sending files

#12
I misread the title as faster sending, rather than faster workflow. For dropbox we just use shared folders which work no matter what else is going on (network connectivity, machines sleeping, reboots etc).

I'd be overjoyed if someone could figure out faster sending. My DSL maxes out at 100 kbytes/sec upstream. Sending someone something like a mongodb dump involves a long wait while I locally compress it, and an even longer wait while it gets uploaded. I'd gladly have all 4 cores (plus another 4 hyperthreaded) plus 32GB of RAM dedicated to getting the files uploaded quicker. In theory some of the compression tools can do this, but some aren't multithreaded, or require a lot of research to figure out workable command line options and even then they consider 4GB to be an outrageous amount of memory. Often you have to wait for the compression to finish before you can even start the sending.

Re: Minbox - a faster workflow for sending files

#13
If you could stuff a download URL signed for S3's PUT in a custom header (in order to do a bucket to bucket copy), this would make a great large file uploader for SaaS services that store user files on S3 too. User would send the file to something like upload@thesaasservice.com and some kind of mechanism to validate identity.

Then get resuming working as well as Dropbox of course :)

Re: Minbox - a faster workflow for sending files

#16
post #14

The video is probably gonna be offputting for some people but it's hilarious. I actually laughed out loud at it.

While I understand it technically I feel like the video is incredibly misleading. It's demonstrating time-to-share a link which (at some point) will contain a file. It's not demonstrating time-to-upload a file like the video suggests by comparing directly against dropbox.

Re: Minbox - a faster workflow for sending files

#20

I misread the title as faster sending, rather than faster workflow. For dropbox we just use shared folders which work no matter what else is going on (network connectivity, machines sleeping, reboots etc). I'd be overjoyed if someone could figure out faster sending. My DSL maxes out at 100 kbytes/sec upstream. Sending someone something like a mongodb dump involves a long wait while I locally compress it, and an even…

Perhaps you should have a look at pigz, a multi-threaded implementation of gzip. It uses the same flags as gzip, so -# specifies speed (-1 runs the fastest with the least compression ... -9 runs the slowest with the best compression), and by default it spawns as many processes as you have processors. I've never done any formal benchmarks, so I'm not qualified to speak as to its efficiency, however.

Based on your late-90's upload rate (and assuming you're working with large files that compress nicely), I'd say the more time you spend on compression, the less overall time you're looking at. That 100kb/s (theoretical) limit is really the first bottleneck you should be fixing, though.

[edit]: I completely misread that as kilobits/s. Point still stands minus the 90's bit.

Post reply on HN