Live data from Hacker News

Common problems with large file uploads

blog.filepicker.io

31–36 of 36 posts

Re: Common problems with large file uploads

#32
post #25

Given the title I was expecting the article to provide a solution. From personal experience, the bigger the file, the more likely you will experience a connection cut in the middle of the upload. That is why the most important thing it to support resumable uploads. At the moment there is no clear consensus on how to handle that. Amazon S3 has one protocol, Google uses two revisions of a different protocol, one on You…

I miss the ZMODEM protocol. Resumable file transfers over 56kbps was the bomb. Made me feel whole again (pun partially intended) back in '89.

Re: Common problems with large file uploads

#33
post #31

Excuse me if this is a stupid question, but why would timeout issues on large files affect something like Heroku more often than other types of hosting services?

Heroku enforces the timeout.

https://devcenter.heroku.com/articles/request-timeout

https://devcenter.heroku.com/articles/s3#file_uploads

http://stackoverflow.com/questions/7854239/heroku-timeout-wh...

Re: Common problems with large file uploads

#34

8gb+ files? I found a way but you have to use a JAVA FTP Applet. I tested these two here: http://jupload.sourceforge.net/ and http://www.jfileupload.com/ Dragged and dropped an 8gb+ file and left it on for 5 hours. Worked perfectly. No time outs, no errors, and I'm on a shared hosting account at 1and1. My problem with them is that it wasn't possible to hide the FTP username and password, they were always in javascrip…

It's been a long time since I've been on shared hosting, but I thought they usually offered some kind of anonymous upload-only FTP directory. Couldn't your users upload to that and then your application can read from that directory?

Re: Common problems with large file uploads

#35
post #32
post #25

Given the title I was expecting the article to provide a solution. From personal experience, the bigger the file, the more likely you will experience a connection cut in the middle of the upload. That is why the most important thing it to support resumable uploads. At the moment there is no clear consensus on how to handle that. Amazon S3 has one protocol, Google uses two revisions of a different protocol, one on You…

I miss the ZMODEM protocol. Resumable file transfers over 56kbps was the bomb. Made me feel whole again (pun partially intended) back in '89.

Goddamn I had forgotten all about that haha. Rush of nostalgia from BBS scene.

XMODEM was painful. ZMODEM was leet.

Post reply on HN