Webmin

On 30/Nov/2006 18:36 Murray Trainer wrote ..
> Hi Jamie,
> 
> Just wondering if the change below to the Users and Groups module should
> also apply to the LDAP Users and Groups module if it doesn't already?
> 
> Thanks
> 
> Murray
> 
> Changes since Webmin version 1.300
> 
> Users and Groups
>         
> Use the nscd -i command to refresh its cache after adding a user or
> group. 

Yes, they will apply to that module too..
Although it is not as useful, as ncsd running on other systems that
talk to the LDAP server will not have their nscd refreshed.

  - Jamie

> 
> Webmin version 1.310 is now available for download from
> http://www.webmin.com/ and mirror sites. This release includes
> the following changes :



Downloading http://www.webmin.com/cgi-bin/redirect.cgi/upgrade/http://osdn.dl.sourceforge.net/sourceforge/webadmin/webmin-1.310.tar.gz ..
Failed to upgrade from http://www.webmin.com : Download timed out

On 30/Nov/2006 17:51 boricua wrote ..
> > 
> > Webmin version 1.310 is now available for download from
> > http://www.webmin.com/ and mirror sites. This release includes
> > the following changes :
> 
> 
> 
> Downloading http://www.webmin.com/cgi-bin/redirect.cgi/upgrade/http://osdn.dl.sourceforge.net/sourceforge/webadmin/webmin-1.310.tar.gz
> ..
> Failed to upgrade from http://www.webmin.com : Download timed out

Sourceforge recently made a change to their mirror servers which breaks
Webmin's auto-update. Instead, you can upgrade from the URL :

http://umn.dl.sourceforge.net/sourceforge/webadmin/webmin-1.310-1.noarch.rpm

This can be done on the upgrade page, using the 'From ftp or http URL' option.

 - Jamie

I make mistake and i try to install src.rpm, with noarch.rpm Is OK now


2006/11/30, Jamie Cameron <jcameron@...>:
> Hi Petros,
> Did you actually install the new RPM, with the command :
> rpm -U webmin-1.310-1.noarch.rpm ?
>
> If that runs OK, you should see the version at the bottom of the main page when you login. Also, it will be written to the file /usr/libexec/webmin/version .
>
>  - Jamie
>

On 29/Nov/2006 22:44 The Nice Spider wrote ..
> First, I already try several config of webmin iptables
> but still no lucky.
> Here my problem:
> -  I need to move any request to port 5001 to this
> computer: IP=192.168.0.100 
> port=807

If you want to redirect connections to port 5001 on your
server to another machine, I would suggest using the 
Extended Internal Services module (if you have xinetd installed).
It makes this much easier, as xinetd was designed for this
kind of thing..

 - Jamie

That sounds scary.
I think separation from apache is a good thing...  That is, you can 
still use webmin with other servers (like apache) turned off.

Kevin Cook
Roper Bioscience

Dave Isaacs wrote:
> I've been looking at fronting Webmin with Apache, instead of miniserv, 
> since we have Apache running on our servers anyway.  I found an 
> informative page on the webmin.com site which instructs how this can 
> be done.  But there was one big stumbling block: You must use the 
> default theme since Apache does not support the Webmin theming system.
>  
> Is there any way around this limitation?  For example, hacking the 
> default Webmin theme to be a different theme of choice? Or would such 
> a hack be complex enough to merit a "don't bother."
>  
> Thanks
>  
> Dave I
>  
>  
> ------------------------------------------------------------------------
>
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share your
> opinions on IT & business topics through brief surveys - and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> ------------------------------------------------------------------------
>
> -
> Forwarded by the Webmin mailing list at webadmin-list@...
> To remove yourself from this list, go to
> http://lists.sourceforge.net/lists/listinfo/webadmin-list
>

Dave Isaacs wrote:
> I've been looking at fronting Webmin with Apache, instead of miniserv, 
> since we have Apache running on our servers anyway.  I found an 
> informative page on the webmin.com site which instructs how this can 
> be done.  But there was one big stumbling block: You must use the 
> default theme since Apache does not support the Webmin theming system.
>  
> Is there any way around this limitation?  For example, hacking the 
> default Webmin theme to be a different theme of choice? Or would such 
> a hack be complex enough to merit a "don't bother."
>  
> Thanks
>  
> Dave I
>  
I had this same thought earlier myself... why miniserv instead of 
apache. It soon became evident. There is very little need to ever be 
tweaking the settings in miniserv, whereas it is pretty easy to bork an 
apache config and it won't restart. Of course this leaves you staring at 
a page that will not reload nor any method to get into Webmin and back 
to the apache config to fix it.

Just a thought....

John Hinton

On 28/Nov/2006 07:30 Chrietzberg, Aletha wrote ..
<blockquote type=3D"cite">

<!-- Converted from text/rtf format -->

<p><font size=3D"2" face=3D"Arial">I just have a quick question. Not to take up too much of your time.</font>
</p>

<p><font size=3D"2" face=3D"Arial">I have been looking for documentation on configuring the LDAP modules.=A0 I cannot seem to find any documentation on it.=A0 I do see the forum questions but that's it.=A0 Also I can't tell if I can use these modules with the IBM LDAP server.=A0 They should work with most LDAP servers though, right?</font></p>

<p><font size=3D"2" face=3D"Arial">Just point me in the right direction.</font>

<br /><font size=3D"2" face=3D"Arial">Any help is greatly appreciated.</font>
</p>


</blockquote>I have never actually tested Webmin's LDAP module with IBM's server, only with OpenLDAP ... however, assuming that it implements the LDAP spec, it should work.<br />What specific problems are you running into? This list is the best place to post them ..<br /><br />=A0- Jamie<br /><br />

Hi Dave,<br />Yes, this has been fixed for a few versions now ..<br /><br />=A0- Jamie<br /><br />On 27/Nov/2006 12:42 Dave Isaacs wrote ..
<blockquote type=3D"cite">


<p><font size=3D"2">Jamie,</font>
</p>

<p><font size=3D"2">Almost a year ago I posted this question about restricting file upload size.=A0 At the time you admitted to some miniserv.pl limitations and said that you would take care of this.=A0 </font></p>

<p><font size=3D"2">Have you?=A0 If yes, great!=A0 If not, any estimates on when this can get in?</font>
</p>

<p><font size=3D"2">Thanks</font>
</p>

<p><font size=3D"2">Dave I</font>
</p>

<p><font size=3D"2">From: Jamie Cameron &lt;jcameron@...>
<br /><font size=3D"2">To: webadmin-list@...>
<br /><font size=3D"2">Reply-To: webadmin-list@...>
<br /><font size=3D"2">Date: Feb 10 2006 - 6:38pm</font>
</p>

<p><font size=3D"2">On 11/Feb/2006 03:19 Dave Isaacs wrote ..</font>
<br /><font size=3D"2">&gt; My experience shows that this does not work.</font>
<br /><font size=3D"2">&gt;</font>
<br /><font size=3D"2">&gt; I put a 1000000 limit in my call to ReadParseMime then attempted to upload</font>
<br /><font size=3D"2">&gt; a</font>
<br /><font size=3D"2">&gt; 1GB file. Using top, I watched the miniserv.pl process climb to about</font>
<br /><font size=3D"2">&gt; 600MB</font>
<br /><font size=3D"2">&gt; before crashing. ReadParseMime was never called because my module was</font>
<br /><font size=3D"2">&gt; never</font>
<br /><font size=3D"2">&gt; invoked.</font>
<br /><font size=3D"2">&gt;</font>
<br /><font size=3D"2">&gt; If I look at miniserv.pl, at around line 1740, I see</font>
<br /><font size=3D"2">&gt;</font>
<br /><font size=3D"2">&gt; $clen =3D $header{&quot;content-length&quot;};</font>
<br /><font size=3D"2">&gt; if ($method eq &quot;POST&quot; &amp;&amp; $clen_read &lt; $clen) {</font>
<br /><font size=3D"2">&gt; # Still some more POST data to read</font>
<br /><font size=3D"2">&gt; while(length($postinput) &lt; $clen) {</font>
<br /><font size=3D"2">&gt; $buf =3D &amp;read_data($clen - length($postinput));</font>
<br /><font size=3D"2">&gt; if (!length($buf)) {</font>
<br /><font size=3D"2">&gt; &amp;http_error(500, &quot;Failed to read &quot;.</font>
<br /><font size=3D"2">&gt; &quot;POST request&quot;);</font>
<br /><font size=3D"2">&gt; }</font>
<br /><font size=3D"2">&gt; $postinput .=3D $buf;</font>
<br /><font size=3D"2">&gt; }</font>
<br /><font size=3D"2">&gt; }</font>
<br /><font size=3D"2">&gt;</font>
<br /><font size=3D"2">&gt; This looks an awful lot like reading in the entire file upload. As a test,</font>
<br /><font size=3D"2">&gt; I wrote the length($postinput) value to a log file (right before the call</font>
<br /><font size=3D"2">&gt; to</font>
<br /><font size=3D"2">&gt; read_data) and found that miniserv.pl was looping in an attempt to read</font>
<br /><font size=3D"2">&gt; the</font>
<br /><font size=3D"2">&gt; entire file upload.</font>
</p>

<p><font size=3D"2">Hi Dave,</font>
<br /><font size=3D"2">You are absolutely correct .. Webmin really does the whole posted input into</font>
<br /><font size=3D"2">memory! Sorry, I totally forgot about that..</font>
</p>

<p><font size=3D"2">&gt; Then I stumbled upon the forkcgis configuration setting, which appears</font>
<br /><font size=3D"2">&gt; to</font>
<br /><font size=3D"2">&gt; switch on a alternative method of invoking the webmin modules. This method</font>
<br /><font size=3D"2">&gt; has miniserv.pl forwarding the file upload to the forked process as it</font>
<br /><font size=3D"2">&gt; is</font>
<br /><font size=3D"2">&gt; received. Unfortunately, this does not work either. Now when I upload</font>
<br /><font size=3D"2">&gt; a</font>
<br /><font size=3D"2">&gt; large file, something goes wrong and there is never a response. The log</font>
<br /><font size=3D"2">&gt; messages I put in the miniserv loop shows that about 7500 bytes are read</font>
<br /><font size=3D"2">&gt; in,</font>
<br /><font size=3D"2">&gt; and then everything stops. Although this is better than crashing the</font>
<br /><font size=3D"2">&gt; server, it is still not correct.</font>
</p>

<p><font size=3D"2">I looked into this too, and found that Webmin is currently terminating the</font>
<br /><font size=3D"2">browser connection if the uploaded data is more than the set limit. Unfortunately,</font>
<br /><font size=3D"2">no browsers take kindly to this, and display an error message about the connection</font>
<br /><font size=3D"2">being closed.</font>
</p>

<p><font size=3D"2">In the next release of Webmin, it will handle this better by reading all the data</font>
<br /><font size=3D"2">submitted by the browser, but not actually storing it in memory if the limit is exceeded.</font>
<br /><font size=3D"2">That is not quite ideal, but still better than the current situation.</font>
</p>

<p><font size=3D"2">- Jamie</font>
</p>

</blockquote><br />

Thanks!
 
Did you also fix the forkcgis path?  We now have the requirement to upload
500MB files to the server, so instead of limiting the file size we need to
ensure that the file is not uploaded into memory first.  If I remember
correctly, the forkcgis path in miniserv.pl would do just that, but was not
working correctly?
 
Forgive me if I am remembering this wrong.  I am still working on dredging
up all the details from my head.
 
Thanks
 
Dave I
 

-----Original Message-----
From: webadmin-list-bounces@...
[mailto:webadmin-list-bounces@...] On Behalf Of Jamie
Cameron
Sent: Monday, November 27, 2006 3:52 PM
To: Webmin users list
Subject: Re: [webmin-l] Restricting file upload size


Hi Dave,
Yes, this has been fixed for a few versions now ..

 - Jamie

On 27/Nov/2006 12:42 Dave Isaacs wrote .. 

Jamie, 

Almost a year ago I posted this question about restricting file upload size.
At the time you admitted to some miniserv.pl limitations and said that you
would take care of this.  

Have you?  If yes, great!  If not, any estimates on when this can get in? 

Thanks 

Dave I 

From: Jamie Cameron <jcameron@...> 
To: webadmin-list@... 
Reply-To: webadmin-list@... 
Date: Feb 10 2006 - 6:38pm 

On 11/Feb/2006 03:19 Dave Isaacs wrote .. 
> My experience shows that this does not work. 
> 
> I put a 1000000 limit in my call to ReadParseMime then attempted to upload

> a 
> 1GB file. Using top, I watched the miniserv.pl process climb to about 
> 600MB 
> before crashing. ReadParseMime was never called because my module was 
> never 
> invoked. 
> 
> If I look at miniserv.pl, at around line 1740, I see 
> 
> $clen = $header{"content-length"}; 
> if ($method eq "POST" && $clen_read < $clen) { 
> # Still some more POST data to read 
> while(length($postinput) < $clen) { 
> $buf = &read_data($clen - length($postinput)); 
> if (!length($buf)) { 
> &http_error(500, "Failed to read ". 
> "POST request"); 
> } 
> $postinput .= $buf; 
> } 
> } 
> 
> This looks an awful lot like reading in the entire file upload. As a test,

> I wrote the length($postinput) value to a log file (right before the call 
> to 
> read_data) and found that miniserv.pl was looping in an attempt to read 
> the 
> entire file upload. 

Hi Dave, 
You are absolutely correct .. Webmin really does the whole posted input into

memory! Sorry, I totally forgot about that.. 

> Then I stumbled upon the forkcgis configuration setting, which appears 
> to 
> switch on a alternative method of invoking the webmin modules. This method

> has miniserv.pl forwarding the file upload to the forked process as it 
> is 
> received. Unfortunately, this does not work either. Now when I upload 
> a 
> large file, something goes wrong and there is never a response. The log 
> messages I put in the miniserv loop shows that about 7500 bytes are read 
> in, 
> and then everything stops. Although this is better than crashing the 
> server, it is still not correct. 

I looked into this too, and found that Webmin is currently terminating the 
browser connection if the uploaded data is more than the set limit.
Unfortunately, 
no browsers take kindly to this, and display an error message about the
connection 
being closed. 

In the next release of Webmin, it will handle this better by reading all the
data 
submitted by the browser, but not actually storing it in memory if the limit
is exceeded. 
That is not quite ideal, but still better than the current situation. 

- Jamie

Hi Dave,<br />Yes, for both forked and internally-executed Perl scripts it no longer reads the entire input into memory, at least not in miniserv.pl.<br /><br />=A0- Jamie<br /><br />On 27/Nov/2006 12:58 Dave Isaacs wrote ..
<blockquote type=3D"cite">

<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Thanks!</font></span></div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Did 
you also fix the forkcgis path?=A0 We now have the requirement to upload 
500MB files to the server, so instead of limiting the file size we need to 
ensure that the file is not uploaded into memory first.=A0 If I remember 
correctly, the forkcgis path in miniserv.pl would do just that, but was not 
working correctly?</font></span></div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Forgive me if I am remembering this wrong.=A0 I am still working on 
dredging up all the details from my head.</font></span></div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Thanks</font></span></div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Dave 
I</font></span></div>
<div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<blockquote style=3D"margin-right: 0px;">
  <div></div>
  <div lang=3D"en-us" dir=3D"ltr" align=3D"left" class=3D"OutlookMessageHeader"><font size=3D"2" face=3D"Tahoma">-----Original Message-----<br /><b>From:</b> 
  webadmin-list-bounces@... 
  [mailto:webadmin-list-bounces@...] <b>On Behalf Of </b>Jamie 
  Cameron<br /><b>Sent:</b> Monday, November 27, 2006 3:52 PM<br /><b>To:</b> Webmin 
  users list<br /><b>Subject:</b> Re: [webmin-l] Restricting file upload 
  size<br /><br /></font></div>Hi Dave,<br />Yes, this has been fixed for a few 
  versions now ..<br /><br />=A0- Jamie<br /><br />On 27/Nov/2006 12:42 Dave Isaacs 
  wrote .. 
  <blockquote type=3D"cite">
    <p><font size=3D"2">Jamie,</font> </p>
    <p><font size=3D"2">Almost a year ago I posted this question about restricting 
    file upload size.=A0 At the time you admitted to some miniserv.pl 
    limitations and said that you would take care of this.=A0 </font></p>
    <p><font size=3D"2">Have you?=A0 If yes, great!=A0 If not, any estimates 
    on when this can get in?</font> </p>
    <p><font size=3D"2">Thanks</font> </p>
    <p><font size=3D"2">Dave I</font> </p>
    <p><font size=3D"2">From: Jamie Cameron &lt;jcameron@...> 
    <br /><font size=3D"2">To: webadmin-list@...> <br /><font size=3D"2">Reply-To: webadmin-list@...> <br /><font size=3D"2">Date: Feb 10 2006 - 6:38pm</font> </p>
    <p><font size=3D"2">On 11/Feb/2006 03:19 Dave Isaacs wrote ..</font> <br /><font size=3D"2">&gt; My experience shows that this does not work.</font> <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; I put a 1000000 limit in my call to 
    ReadParseMime then attempted to upload</font> <br /><font size=3D"2">&gt; a</font> 
    <br /><font size=3D"2">&gt; 1GB file. Using top, I watched the miniserv.pl process 
    climb to about</font> <br /><font size=3D"2">&gt; 600MB</font> <br /><font size=3D"2">&gt; before crashing. ReadParseMime was never called because my 
    module was</font> <br /><font size=3D"2">&gt; never</font> <br /><font size=3D"2">&gt; 
    invoked.</font> <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; If I look 
    at miniserv.pl, at around line 1740, I see</font> <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; $clen =3D 
    $header{&quot;content-length&quot;};</font> <br /><font size=3D"2">&gt; if ($method eq 
    &quot;POST&quot; &amp;&amp; $clen_read &lt; $clen) {</font> <br /><font size=3D"2">&gt; # 
    Still some more POST data to read</font> <br /><font size=3D"2">&gt; 
    while(length($postinput) &lt; $clen) {</font> <br /><font size=3D"2">&gt; $buf =3D 
    &amp;read_data($clen - length($postinput));</font> <br /><font size=3D"2">&gt; if 
    (!length($buf)) {</font> <br /><font size=3D"2">&gt; &amp;http_error(500, &quot;Failed 
    to read &quot;.</font> <br /><font size=3D"2">&gt; &quot;POST request&quot;);</font> <br /><font size=3D"2">&gt; }</font> <br /><font size=3D"2">&gt; $postinput .=3D $buf;</font> 
    <br /><font size=3D"2">&gt; }</font> <br /><font size=3D"2">&gt; }</font> <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; This looks an awful lot like 
    reading in the entire file upload. As a test,</font> <br /><font size=3D"2">&gt; I 
    wrote the length($postinput) value to a log file (right before the 
    call</font> <br /><font size=3D"2">&gt; to</font> <br /><font size=3D"2">&gt; read_data) 
    and found that miniserv.pl was looping in an attempt to read</font> 
    <br /><font size=3D"2">&gt; the</font> <br /><font size=3D"2">&gt; entire file 
    upload.</font> </p>
    <p><font size=3D"2">Hi Dave,</font> <br /><font size=3D"2">You are absolutely correct 
    .. Webmin really does the whole posted input into</font> <br /><font size=3D"2">memory! Sorry, I totally forgot about that..</font> </p>
    <p><font size=3D"2">&gt; Then I stumbled upon the forkcgis configuration 
    setting, which appears</font> <br /><font size=3D"2">&gt; to</font> <br /><font size=3D"2">&gt; switch on a alternative method of invoking the webmin modules. 
    This method</font> <br /><font size=3D"2">&gt; has miniserv.pl forwarding the file 
    upload to the forked process as it</font> <br /><font size=3D"2">&gt; is</font> 
    <br /><font size=3D"2">&gt; received. Unfortunately, this does not work either. 
    Now when I upload</font> <br /><font size=3D"2">&gt; a</font> <br /><font size=3D"2">&gt; large file, something goes wrong and there is never a response. 
    The log</font> <br /><font size=3D"2">&gt; messages I put in the miniserv loop 
    shows that about 7500 bytes are read</font> <br /><font size=3D"2">&gt; in,</font> 
    <br /><font size=3D"2">&gt; and then everything stops. Although this is better 
    than crashing the</font> <br /><font size=3D"2">&gt; server, it is still not 
    correct.</font> </p>
    <p><font size=3D"2">I looked into this too, and found that Webmin is currently 
    terminating the</font> <br /><font size=3D"2">browser connection if the uploaded 
    data is more than the set limit. Unfortunately,</font> <br /><font size=3D"2">no 
    browsers take kindly to this, and display an error message about the 
    connection</font> <br /><font size=3D"2">being closed.</font> </p>
    <p><font size=3D"2">In the next release of Webmin, it will handle this better by 
    reading all the data</font> <br /><font size=3D"2">submitted by the browser, but 
    not actually storing it in memory if the limit is exceeded.</font> <br /><font size=3D"2">That is not quite ideal, but still better than the current 
    situation.</font> </p>
    <p><font size=3D"2">- Jamie</font> </p></blockquote><br /></blockquote></blockquote><br />

I must be missing something.  I've rerun my tests and they show the entire
file being uploaded before my module is being called.  This is in the case
when forkcgis=0.
 
When I set forkcgis=1, Webmin stops working completely.  I just get a file
permissions error showing up the in browser.
 
I am using Webmin version 1.290 on RedHat EL3.
 
Thanks
 
Dave I

-----Original Message-----
From: webadmin-list-bounces@...
[mailto:webadmin-list-bounces@...] On Behalf Of Jamie
Cameron
Sent: Monday, November 27, 2006 5:51 PM
To: Webmin users list
Subject: Re: [webmin-l] Restricting file upload size


Hi Dave,
Yes, for both forked and internally-executed Perl scripts it no longer reads
the entire input into memory, at least not in miniserv.pl.

 - Jamie

On 27/Nov/2006 12:58 Dave Isaacs wrote .. 

Thanks!
 
Did you also fix the forkcgis path?  We now have the requirement to upload
500MB files to the server, so instead of limiting the file size we need to
ensure that the file is not uploaded into memory first.  If I remember
correctly, the forkcgis path in miniserv.pl would do just that, but was not
working correctly?
 
Forgive me if I am remembering this wrong.  I am still working on dredging
up all the details from my head.
 
Thanks
 
Dave I
 

-----Original Message-----
From: webadmin-list-bounces@...
[mailto:webadmin-list-bounces@...] On Behalf Of Jamie
Cameron
Sent: Monday, November 27, 2006 3:52 PM
To: Webmin users list
Subject: Re: [webmin-l] Restricting file upload size


Hi Dave,
Yes, this has been fixed for a few versions now ..

 - Jamie

On 27/Nov/2006 12:42 Dave Isaacs wrote .. 

Jamie, 

Almost a year ago I posted this question about restricting file upload size.
At the time you admitted to some miniserv.pl limitations and said that you
would take care of this.  

Have you?  If yes, great!  If not, any estimates on when this can get in? 

Thanks 

Dave I 

From: Jamie Cameron <jcameron@...> 
To: webadmin-list@... 
Reply-To: webadmin-list@... 
Date: Feb 10 2006 - 6:38pm 

On 11/Feb/2006 03:19 Dave Isaacs wrote .. 
> My experience shows that this does not work. 
> 
> I put a 1000000 limit in my call to ReadParseMime then attempted to upload

> a 
> 1GB file. Using top, I watched the miniserv.pl process climb to about 
> 600MB 
> before crashing. ReadParseMime was never called because my module was 
> never 
> invoked. 
> 
> If I look at miniserv.pl, at around line 1740, I see 
> 
> $clen = $header{"content-length"}; 
> if ($method eq "POST" && $clen_read < $clen) { 
> # Still some more POST data to read 
> while(length($postinput) < $clen) { 
> $buf = &read_data($clen - length($postinput)); 
> if (!length($buf)) { 
> &http_error(500, "Failed to read ". 
> "POST request"); 
> } 
> $postinput .= $buf; 
> } 
> } 
> 
> This looks an awful lot like reading in the entire file upload. As a test,

> I wrote the length($postinput) value to a log file (right before the call 
> to 
> read_data) and found that miniserv.pl was looping in an attempt to read 
> the 
> entire file upload. 

Hi Dave, 
You are absolutely correct .. Webmin really does the whole posted input into

memory! Sorry, I totally forgot about that.. 

> Then I stumbled upon the forkcgis configuration setting, which appears 
> to 
> switch on a alternative method of invoking the webmin modules. This method

> has miniserv.pl forwarding the file upload to the forked process as it 
> is 
> received. Unfortunately, this does not work either. Now when I upload 
> a 
> large file, something goes wrong and there is never a response. The log 
> messages I put in the miniserv loop shows that about 7500 bytes are read 
> in, 
> and then everything stops. Although this is better than crashing the 
> server, it is still not correct. 

I looked into this too, and found that Webmin is currently terminating the 
browser connection if the uploaded data is more than the set limit.
Unfortunately, 
no browsers take kindly to this, and display an error message about the
connection 
being closed. 

In the next release of Webmin, it will handle this better by reading all the
data 
submitted by the browser, but not actually storing it in memory if the limit
is exceeded. 
That is not quite ideal, but still better than the current situation. 

- Jamie

Hi Dave,<br />I checked my code again, and found that only with forkcgis=3D1 does it not read the uploaded data into memory, sorry.<br />However, in that mode you need to make sure that all your .cgi scripts are executable (with chmod +x *.cgi).<br /><br />=A0- Jamie<br /><br />On 28/Nov/2006 08:02 Dave Isaacs wrote ..
<blockquote type=3D"cite">

<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">I must 
be missing something.=A0 I've rerun my tests and they show the entire file 
being uploaded before my module is being called.=A0 This is in the case when 
forkcgis=3D0.</font></span></div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">When I 
set forkcgis=3D1, Webmin stops working completely.=A0 I just get a file 
permissions error showing up the in browser.</font></span></div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">I am 
using Webmin version 1.290 on RedHat EL3.</font></span></div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Thanks</font></span></div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
<div><span class=3D"146175715-28112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Dave 
I</font></span></div>
<blockquote style=3D"margin-right: 0px;">
  <div></div>
  <div lang=3D"en-us" align=3D"left" dir=3D"ltr" class=3D"OutlookMessageHeader"><font size=3D"2" face=3D"Tahoma">-----Original Message-----<br /><b>From:</b> 
  webadmin-list-bounces@... 
  [mailto:webadmin-list-bounces@...] <b>On Behalf Of </b>Jamie 
  Cameron<br /><b>Sent:</b> Monday, November 27, 2006 5:51 PM<br /><b>To:</b> Webmin 
  users list<br /><b>Subject:</b> Re: [webmin-l] Restricting file upload 
  size<br /><br /></font></div>Hi Dave,<br />Yes, for both forked and 
  internally-executed Perl scripts it no longer reads the entire input into 
  memory, at least not in miniserv.pl.<br /><br />=A0- Jamie<br /><br />On 
  27/Nov/2006 12:58 Dave Isaacs wrote .. 
  <blockquote type=3D"cite">
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Thanks!</font></span></div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Did you also fix the forkcgis path?=A0 We now have the requirement 
    to upload 500MB files to the server, so instead of limiting the file size we 
    need to ensure that the file is not uploaded into memory first.=A0 If I 
    remember correctly, the forkcgis path in miniserv.pl would do just that, but 
    was not working correctly?</font></span></div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Forgive me if I am remembering this wrong.=A0 I am still working 
    on dredging up all the details from my head.</font></span></div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Thanks</font></span></div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff">Dave I</font></span></div>
    <div><span class=3D"810325420-27112006"><font size=3D"2" face=3D"Arial" color=3D"#0000ff"></font></span>=A0</div>
    <blockquote style=3D"margin-right: 0px;">
      <div></div>
      <div lang=3D"en-us" align=3D"left" dir=3D"ltr" class=3D"OutlookMessageHeader"><font size=3D"2" face=3D"Tahoma">-----Original Message-----<br /><b>From:</b> 
      webadmin-list-bounces@... 
      [mailto:webadmin-list-bounces@...] <b>On Behalf Of 
      </b>Jamie Cameron<br /><b>Sent:</b> Monday, November 27, 2006 3:52 
      PM<br /><b>To:</b> Webmin users list<br /><b>Subject:</b> Re: [webmin-l] 
      Restricting file upload size<br /><br /></font></div>Hi Dave,<br />Yes, this has 
      been fixed for a few versions now ..<br /><br />=A0- Jamie<br /><br />On 
      27/Nov/2006 12:42 Dave Isaacs wrote .. 
      <blockquote type=3D"cite">
        <p><font size=3D"2">Jamie,</font> </p>
        <p><font size=3D"2">Almost a year ago I posted this question about 
        restricting file upload size.=A0 At the time you admitted to some 
        miniserv.pl limitations and said that you would take care of this.=A0 
        </font></p>
        <p><font size=3D"2">Have you?=A0 If yes, great!=A0 If not, any 
        estimates on when this can get in?</font> </p>
        <p><font size=3D"2">Thanks</font> </p>
        <p><font size=3D"2">Dave I</font> </p>
        <p><font size=3D"2">From: Jamie Cameron &lt;jcameron@...> 
        <br /><font size=3D"2">To: webadmin-list@...> 
        <br /><font size=3D"2">Reply-To: webadmin-list@...> 
        <br /><font size=3D"2">Date: Feb 10 2006 - 6:38pm</font> </p>
        <p><font size=3D"2">On 11/Feb/2006 03:19 Dave Isaacs wrote ..</font> 
        <br /><font size=3D"2">&gt; My experience shows that this does not 
        work.</font> <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; I put a 
        1000000 limit in my call to ReadParseMime then attempted to 
        upload</font> <br /><font size=3D"2">&gt; a</font> <br /><font size=3D"2">&gt; 1GB 
        file. Using top, I watched the miniserv.pl process climb to about</font> 
        <br /><font size=3D"2">&gt; 600MB</font> <br /><font size=3D"2">&gt; before 
        crashing. ReadParseMime was never called because my module was</font> 
        <br /><font size=3D"2">&gt; never</font> <br /><font size=3D"2">&gt; invoked.</font> 
        <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; If I look at 
        miniserv.pl, at around line 1740, I see</font> <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; $clen =3D 
        $header{&quot;content-length&quot;};</font> <br /><font size=3D"2">&gt; if ($method eq 
        &quot;POST&quot; &amp;&amp; $clen_read &lt; $clen) {</font> <br /><font size=3D"2">&gt; 
        # Still some more POST data to read</font> <br /><font size=3D"2">&gt; 
        while(length($postinput) &lt; $clen) {</font> <br /><font size=3D"2">&gt; $buf 
        =3D &amp;read_data($clen - length($postinput));</font> <br /><font size=3D"2">&gt; if (!length($buf)) {</font> <br /><font size=3D"2">&gt; 
        &amp;http_error(500, &quot;Failed to read &quot;.</font> <br /><font size=3D"2">&gt; 
        &quot;POST request&quot;);</font> <br /><font size=3D"2">&gt; }</font> <br /><font size=3D"2">&gt; $postinput .=3D $buf;</font> <br /><font size=3D"2">&gt; }</font> 
        <br /><font size=3D"2">&gt; }</font> <br /><font size=3D"2">&gt;</font> <br /><font size=3D"2">&gt; This looks an awful lot like reading in the entire file 
        upload. As a test,</font> <br /><font size=3D"2">&gt; I wrote the 
        length($postinput) value to a log file (right before the call</font> 
        <br /><font size=3D"2">&gt; to</font> <br /><font size=3D"2">&gt; read_data) and 
        found that miniserv.pl was looping in an attempt to read</font> 
        <br /><font size=3D"2">&gt; the</font> <br /><font size=3D"2">&gt; entire file 
        upload.</font> </p>
        <p><font size=3D"2">Hi Dave,</font> <br /><font size=3D"2">You are absolutely 
        correct .. Webmin really does the whole posted input into</font> 
        <br /><font size=3D"2">memory! Sorry, I totally forgot about that..</font> 
</p>
        <p><font size=3D"2">&gt; Then I stumbled upon the forkcgis configuration 
        setting, which appears</font> <br /><font size=3D"2">&gt; to</font> <br /><font size=3D"2">&gt; switch on a alternative method of invoking the webmin 
        modules. This method</font> <br /><font size=3D"2">&gt; has miniserv.pl 
        forwarding the file upload to the forked process as it</font> <br /><font size=3D"2">&gt; is</font> <br /><font size=3D"2">&gt; received. Unfortunately, 
        this does not work either. Now when I upload</font> <br /><font size=3D"2">&gt; a</font> <br /><font size=3D"2">&gt; large file, something goes 
        wrong and there is never a response. The log</font> <br /><font size=3D"2">&gt; messages I put in the miniserv loop shows that about 7500 
        bytes are read</font> <br /><font size=3D"2">&gt; in,</font> <br /><font size=3D"2">&gt; and then everything stops. Although this is better than 
        crashing the</font> <br /><font size=3D"2">&gt; server, it is still not 
        correct.</font> </p>
        <p><font size=3D"2">I looked into this too, and found that Webmin is 
        currently terminating the</font> <br /><font size=3D"2">browser connection if 
        the uploaded data is more than the set limit. Unfortunately,</font> 
        <br /><font size=3D"2">no browsers take kindly to this, and display an error 
        message about the connection</font> <br /><font size=3D"2">being 
        closed.</font> </p>
        <p><font size=3D"2">In the next release of Webmin, it will handle this 
        better by reading all the data</font> <br /><font size=3D"2">submitted by the 
        browser, but not actually storing it in memory if the limit is 
        exceeded.</font> <br /><font size=3D"2">That is not quite ideal, but still 
        better than the current situation.</font> </p>
        <p><font size=3D"2">- Jamie</font> 
  </p></blockquote><br /></blockquote></blockquote><br /></blockquote></blockquote><br />

Grant Peel wrote:
> However, as long as I have recusion turned off in bind, (and I do), and I 
> use authoritive nameserver only for reverse, I can use the /24 arpa zone, as 
> somehow they map my specific CIDR address to me.
> 
> I have tested and it does work.

Hmm.  Does rDNS for other people in the same /24 show up correctly for 
you?  That would be my only concern in doing that.

> I notice when I setup and delete a zone in webmin, there is the option of 
> 'Update reverse in other zones". I am hoping this really says: When you add 
> or delete (for example) a zone:
> 
> mydomain.ext ip 1.2.3.4,
> 
> it will update (add or delete the line)
> 
> 4 PTR mydomain.ext.
> 
> in the arpa zone:
> 
> 3.2.1.in-addr.arpa
> 
> Is this correct?

That's how it would appear to me.

-kgd