[Erlyaws-list] Uploading very large files to Yaws

[Edwin F. <erl...@us...>]

If you upload a large (>> 100MB) file to Yaws, using the example upload.yaws
script, something dies with an enomem. Now this isn't Yaws's fault as such;
AFAIK, it's pretty common across most Web browsers, and from Googling, it
sems to be a general problem. It appears that this happens because doing a
multipart POST of a large file from most browsers results in the entire file
being buffered in the Web server's memory, which is bad if the file is very
large.

I'm thinking of adding a feature to Yaws to allow -- in a standard
form/multipart POST -- the data to be "streamed" directly to the file
without buffering more than a few MB in memory. Looking at the code, it
should be doable. This will allow files limited only by disk space to be
uploaded. It would have to include some notion of maximum size allowed to
prevent DoS-style attacks or just plain cluelessness from making the host
run out of disk space.

Does anyone think this is (a) feasible and (b) desirable?

Edwin
-- 
For every expert there is an equal and opposite expert - Arthur C. Clarke