You can subscribe to this list here.
2005 |
Jan
|
Feb
(53) |
Mar
(62) |
Apr
(88) |
May
(55) |
Jun
(204) |
Jul
(52) |
Aug
|
Sep
(1) |
Oct
(94) |
Nov
(15) |
Dec
(68) |
---|---|---|---|---|---|---|---|---|---|---|---|---|
2006 |
Jan
(130) |
Feb
(105) |
Mar
(34) |
Apr
(61) |
May
(41) |
Jun
(92) |
Jul
(176) |
Aug
(102) |
Sep
(247) |
Oct
(69) |
Nov
(32) |
Dec
(140) |
2007 |
Jan
(58) |
Feb
(51) |
Mar
(11) |
Apr
(20) |
May
(34) |
Jun
(37) |
Jul
(18) |
Aug
(60) |
Sep
(41) |
Oct
(105) |
Nov
(19) |
Dec
(14) |
2008 |
Jan
(3) |
Feb
|
Mar
(7) |
Apr
(5) |
May
(123) |
Jun
(5) |
Jul
(1) |
Aug
(29) |
Sep
(15) |
Oct
(21) |
Nov
(51) |
Dec
(3) |
2009 |
Jan
|
Feb
(36) |
Mar
(29) |
Apr
|
May
|
Jun
(7) |
Jul
(4) |
Aug
|
Sep
(4) |
Oct
|
Nov
(13) |
Dec
|
2010 |
Jan
|
Feb
|
Mar
(9) |
Apr
(11) |
May
(16) |
Jun
|
Jul
|
Aug
|
Sep
(1) |
Oct
|
Nov
|
Dec
|
2011 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(1) |
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2012 |
Jan
(7) |
Feb
(3) |
Mar
|
Apr
|
May
|
Jun
(3) |
Jul
|
Aug
|
Sep
|
Oct
(92) |
Nov
(28) |
Dec
(16) |
2013 |
Jan
(9) |
Feb
(2) |
Mar
|
Apr
(4) |
May
(4) |
Jun
(6) |
Jul
(14) |
Aug
(12) |
Sep
(4) |
Oct
(13) |
Nov
(1) |
Dec
(6) |
2014 |
Jan
(23) |
Feb
(19) |
Mar
(10) |
Apr
(14) |
May
(11) |
Jun
(6) |
Jul
(11) |
Aug
(15) |
Sep
(41) |
Oct
(95) |
Nov
(23) |
Dec
(11) |
2015 |
Jan
(3) |
Feb
(9) |
Mar
(19) |
Apr
(3) |
May
(1) |
Jun
(3) |
Jul
(11) |
Aug
(1) |
Sep
(15) |
Oct
(5) |
Nov
(2) |
Dec
|
2016 |
Jan
(7) |
Feb
(11) |
Mar
(8) |
Apr
(1) |
May
(3) |
Jun
(17) |
Jul
(12) |
Aug
(3) |
Sep
(5) |
Oct
(19) |
Nov
(12) |
Dec
(6) |
2017 |
Jan
(30) |
Feb
(23) |
Mar
(12) |
Apr
(32) |
May
(27) |
Jun
(7) |
Jul
(13) |
Aug
(16) |
Sep
(6) |
Oct
(11) |
Nov
|
Dec
(12) |
2018 |
Jan
(1) |
Feb
(5) |
Mar
(6) |
Apr
(7) |
May
(23) |
Jun
(3) |
Jul
(2) |
Aug
(1) |
Sep
(6) |
Oct
(6) |
Nov
(10) |
Dec
(3) |
2019 |
Jan
(26) |
Feb
(15) |
Mar
(9) |
Apr
|
May
(8) |
Jun
(14) |
Jul
(10) |
Aug
(10) |
Sep
(4) |
Oct
(2) |
Nov
(20) |
Dec
(10) |
2020 |
Jan
(10) |
Feb
(14) |
Mar
(29) |
Apr
(11) |
May
(25) |
Jun
(21) |
Jul
(23) |
Aug
(12) |
Sep
(19) |
Oct
(6) |
Nov
(8) |
Dec
(12) |
2021 |
Jan
(29) |
Feb
(9) |
Mar
(8) |
Apr
(8) |
May
(2) |
Jun
(2) |
Jul
(9) |
Aug
(9) |
Sep
(3) |
Oct
(4) |
Nov
(12) |
Dec
(13) |
2022 |
Jan
(4) |
Feb
|
Mar
(4) |
Apr
(12) |
May
(15) |
Jun
(7) |
Jul
(10) |
Aug
(2) |
Sep
|
Oct
(1) |
Nov
(8) |
Dec
|
2023 |
Jan
(15) |
Feb
|
Mar
(23) |
Apr
(1) |
May
(2) |
Jun
(10) |
Jul
|
Aug
(22) |
Sep
(19) |
Oct
(2) |
Nov
(20) |
Dec
|
2024 |
Jan
(1) |
Feb
|
Mar
(16) |
Apr
(15) |
May
(6) |
Jun
(4) |
Jul
(1) |
Aug
(1) |
Sep
|
Oct
(13) |
Nov
(18) |
Dec
(6) |
2025 |
Jan
(12) |
Feb
|
Mar
(2) |
Apr
(1) |
May
(11) |
Jun
(5) |
Jul
(4) |
Aug
(1) |
Sep
|
Oct
|
Nov
|
Dec
|
From: John B. <jo...@ma...> - 2009-11-23 04:15:55
|
I've enabled debugging to try to find the spooler-on-linux problem I'm having. Unfortunately, I don't think it's very enlightening: [-driver:nssock-] Debug: Spooler: 0: started fd=7: 1687742 bytes [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: create nslog:initinterp /usr/local/naviserver/logs/access.log [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: allocate ns:tcltrace ns_init [-conn:amagnatune:0] Notice: upload.tcl: /upload.tcl: [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: deallocate ns:tcltrace ns_cleanup Once, I also saw this (but not on repeated runs) which shows the driver debug info is being logged: [-driver:nssock-] Debug(ns:driver): SockRelease: Unable to shutdown socket (9: Bad file descriptor), sock: -1, peer: 64.62.148.4:3361, request: I'm using Vlad's upload.tcl example, to keep things simple. I'm attaching the larger naviserver startup log, in case that helps. When I set ns_param maxupload 2048000000 the debug log implies the spooler is working correctly, it's just that the old-style MIME parser kicks in at the end, using lots of memory: [-driver:nssock-] Debug: Spooler: 0: started fd=7: 1687742 bytes [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: create nslog:initinterp /usr/local/naviserver/logs/access.log [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: allocate ns:tcltrace ns_init [-conn:amagnatune:0] Notice: upload.tcl: /upload.tcl: 778212 1687742 [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: deallocate ns:tcltrace ns_cleanup [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: allocate ns:tcltrace ns_init [-conn:amagnatune:0] Notice: upload.tcl: /upload.tcl: 1074812 1687742 [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: deallocate ns:tcltrace ns_cleanup [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: allocate ns:tcltrace ns_init [-conn:amagnatune:0] Notice: upload.tcl: /upload.tcl: 1383236 1687742 [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: deallocate ns:tcltrace ns_cleanup [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: allocate ns:tcltrace ns_init [-conn:amagnatune:0] Notice: upload.tcl: /upload.tcl: 1687316 1687742 [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: deallocate ns:tcltrace ns_cleanup [-spooler0-] Debug: spooling content to file: readahead=1024, filesize=1687743 [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: allocate ns:tcltrace ns_init [-conn:amagnatune:1] Debug: ns:interptrace[amagnatune]: create nslog:initinterp /usr/local/naviserver/logs/access.log [-conn:amagnatune:1] Debug: ns:interptrace[amagnatune]: allocate ns:tcltrace ns_init [-conn:amagnatune:0] Debug: ns:interptrace[amagnatune]: deallocate ns:tcltrace ns_cleanup [-conn:amagnatune:1] Notice: upload.tcl: /upload.tcl: [-conn:amagnatune:1] Debug: ns:interptrace[amagnatune]: deallocate ns:tcltrace ns_cleanup Other question you guys had: - CVS -- I had previously used the sourceforge CVS from my memory, there wasn't a link I followed. I'm now using the bitbucket source. - nslog - I added "ns_logctl severity Debug(ns:driver) true" to my config file. -john |
From: Stephen D. <sd...@gm...> - 2009-11-22 13:29:36
|
On Sun, Nov 22, 2009 at 3:26 AM, Vlad Seryakov <vl...@cr...> wrote: > Once the server started, connect to nscp console and issue > > ns_logctl severity Debug(ns:driver) true > > now in the nsd.log there must be a lot of driver and spooler related > messages I think you should be able to do this at any time, not just in the control port. So for example, you could just stick it in the config file. http://naviserver.sourceforge.net/n/naviserver/files/ns_log.html |
From: Stephen D. <sd...@gm...> - 2009-11-22 13:21:01
|
On Sun, Nov 22, 2009 at 2:58 AM, John Buckman <jo...@ma...> wrote: > > Perhaps the problem is how I built my naviserver on linux? I simply ran "autogen.sh" from the cvs tree, and I also tried it with > ./autogen.sh --enable-threads --enable-symbols --with-tcl=/usr/local/lib The latest source is here, not in CVS: http://bitbucket.org/naviserver/naviserver/ (If you've found an old link to CVS, let us know so we can change it) |
From: Vlad S. <vl...@cr...> - 2009-11-22 06:33:33
|
Once the server started, connect to nscp console and issue ns_logctl severity Debug(ns:driver) true now in the nsd.log there must be a lot of driver and spooler related messages Vlad Seryakov wrote: > I am using it on 32 and 64 bit with default configure, so it is > something different. > > First, enable debug > > ns_section ns/parameters > ns_param logdebug true > > ns_section ns/server/server/module/nssock > ns_param readahead 1024 > ns_param maxupload 1024 > > > maxupload and readahead are used for uploads and readahead is the limit > when to use spooler, maxupload is used to decide what temp file to use, > by default temp file which is deleted is used, just for mmap, if length > > maxupload, then regular temp file with name. > > Try with it, also debugging would be good to enable but i forgot how to > enable driver debug, now it uses special severity and i am not sure it > works via config file. It's beed a while since i used it. > > John Buckman wrote: >> I put naviserver into production today, and found that the spooler >> wouldn't work for me, on my production linux (32bit) machine. >> However, the same config file works perfectly under OSX. All >> spooler-enabled uploads get an immediate "The connection was reset" >> error in Firefox. >> >> My config has: >>> ns_param maxinput 3000000000 >>> ns_param maxupload 1024 >>> ns_param spoolerthreads 1 >> >> and nsd reports: >>> [21/Nov/2009:17:42:35][18975.1065a6000][-spooler0-] Notice: spooler0: >>> accepting connections >> >> >> --> Any ideas on how to go about debugging the problem? >> >> -john >> >> ps: >> Changing "maxupload" to a large value makes uploads work the old >> (memory hogging) way. >> >> Perhaps the problem is how I built my naviserver on linux? I simply >> ran "autogen.sh" from the cvs tree, and I also tried it with >> ./autogen.sh --enable-threads --enable-symbols --with-tcl=/usr/local/lib >> >> >> >> ------------------------------------------------------------------------------ >> >> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 >> 30-Day trial. Simplify your report design, integration and deployment >> - and focus on what you do best, core application coding. Discover >> what's new with >> Crystal Reports now. http://p.sf.net/sfu/bobj-july >> _______________________________________________ >> naviserver-devel mailing list >> nav...@li... >> https://lists.sourceforge.net/lists/listinfo/naviserver-devel >> > -- Vlad Seryakov vl...@cr... http://www.crystalballinc.com/vlad/ |
From: Vlad S. <vl...@cr...> - 2009-11-22 05:53:36
|
I am using it on 32 and 64 bit with default configure, so it is something different. First, enable debug ns_section ns/parameters ns_param logdebug true ns_section ns/server/server/module/nssock ns_param readahead 1024 ns_param maxupload 1024 maxupload and readahead are used for uploads and readahead is the limit when to use spooler, maxupload is used to decide what temp file to use, by default temp file which is deleted is used, just for mmap, if length > maxupload, then regular temp file with name. Try with it, also debugging would be good to enable but i forgot how to enable driver debug, now it uses special severity and i am not sure it works via config file. It's beed a while since i used it. John Buckman wrote: > I put naviserver into production today, and found that the spooler wouldn't work for me, on my production linux (32bit) machine. However, the same config file works perfectly under OSX. All spooler-enabled uploads get an immediate "The connection was reset" error in Firefox. > > My config has: >> ns_param maxinput 3000000000 >> ns_param maxupload 1024 >> ns_param spoolerthreads 1 > > and nsd reports: >> [21/Nov/2009:17:42:35][18975.1065a6000][-spooler0-] Notice: spooler0: accepting connections > > > --> Any ideas on how to go about debugging the problem? > > -john > > ps: > Changing "maxupload" to a large value makes uploads work the old (memory hogging) way. > > Perhaps the problem is how I built my naviserver on linux? I simply ran "autogen.sh" from the cvs tree, and I also tried it with > ./autogen.sh --enable-threads --enable-symbols --with-tcl=/usr/local/lib > > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > naviserver-devel mailing list > nav...@li... > https://lists.sourceforge.net/lists/listinfo/naviserver-devel > -- Vlad Seryakov vl...@cr... http://www.crystalballinc.com/vlad/ |
From: John B. <jo...@ma...> - 2009-11-22 02:58:16
|
I put naviserver into production today, and found that the spooler wouldn't work for me, on my production linux (32bit) machine. However, the same config file works perfectly under OSX. All spooler-enabled uploads get an immediate "The connection was reset" error in Firefox. My config has: > ns_param maxinput 3000000000 > ns_param maxupload 1024 > ns_param spoolerthreads 1 and nsd reports: > [21/Nov/2009:17:42:35][18975.1065a6000][-spooler0-] Notice: spooler0: accepting connections --> Any ideas on how to go about debugging the problem? -john ps: Changing "maxupload" to a large value makes uploads work the old (memory hogging) way. Perhaps the problem is how I built my naviserver on linux? I simply ran "autogen.sh" from the cvs tree, and I also tried it with ./autogen.sh --enable-threads --enable-symbols --with-tcl=/usr/local/lib |
From: John B. <jo...@ma...> - 2009-11-22 02:41:13
|
On Nov 19, 2009, at 9:36 AM, Vlad Seryakov wrote: > Yes, regular form parser uses mmap, so for huge files it is not good > I use 1-2GB file pretty easily with the spooler. > In the script, just check if the file is spooled > > set tmpfile [ns_conn contentfile] > if { $tmpfile != "" } { > # Rename to keep it from being deleted on session exit > file rename $tmpfile $tmpfile.mpg > > # Call offline parser > set form [ns_set create] > ns_parseformfile $tmpfile $form [ns_set iget [ns_conn headers] content-type] > } Thank you Vlad, for this source code, which led me in the right direction. This all works now and my nsd process never goes about 50mb in handling a 2gb zip file upload. In case anyone else has to ever deal with this, here were the issues with handling a large file upload with the spooler: A) the spooler wasn't being used, rather the old form handler was, so I changed the config.tcl file to: ns_param maxinput 3000000000 ns_param maxupload 1024 to force the spooler to be almost always used. B) form vars are not parsed when the spooler is used, so ns_queryget doesn't work, and instead something like this needs to be used to get to the form vars: set form [ns_set create] ns_parseformfile $tmpfile $form [ns_set iget [ns_conn headers] content-type] array set formdata [ns_set array $form] ---- Vlad, in the code sample you gave above, I don't think you want to do this: > # Rename to keep it from being deleted on session exit > file rename $tmpfile $tmpfile.mpg because if you do that, the ns_parseformfile command immediately afterward fails because the temp file is no longer there. Your code sample doesn't work. Here is the code I finally settled on, which works great. ###################### #### NAVISERVER SPOOLER UPLOAD HANDLER CODE set tmpfile [ns_conn contentfile] if { $tmpfile == "" } { ns_adp_puts {Something is wrong.} return } set form [ns_set create] ns_parseformfile $tmpfile $form [ns_set iget [ns_conn headers] content-type] array set formdata [ns_set array $form] puts "array: [array get formdata]" # this code fills in the variables I need rather than using ns_queryget set inemail $formdata(email) set inpw $formdata(pw) set desc $formdata(desc) ###################### |
From: John B. <jo...@bo...> - 2009-11-20 00:41:38
|
On Nov 19, 2009, at 9:36 AM, Vlad Seryakov wrote: > Yes, regular form parser uses mmap, so for huge files it is not good > I use 1-2GB file pretty easily with the spooler. > In the script, just check if the file is spooled > > set tmpfile [ns_conn contentfile] > if { $tmpfile != "" } { > # Rename to keep it from being deleted on session exit > file rename $tmpfile $tmpfile.mpg > > # Call offline parser > set form [ns_set create] > ns_parseformfile $tmpfile $form [ns_set iget [ns_conn headers] content-type] > } Thank you Vlad, for this source code, which led me in the right direction. This all works now and my nsd process never goes about 50mb in handling a 2gb zip file upload. In case anyone else has to ever deal with this, here were the issues with handling a large file upload with the spooler: A) the spooler wasn't being used, rather the old form handler was, so I changed the config.tcl file to: ns_param maxinput 3000000000 ns_param maxupload 1024 to force the spooler to be almost always used. B) form vars are not parsed when the spooler is used, so ns_queryget doesn't work, and instead something like this needs to be used to get to the form vars: set form [ns_set create] ns_parseformfile $tmpfile $form [ns_set iget [ns_conn headers] content-type] array set formdata [ns_set array $form] ---- Vlad, in the code sample you gave above, I don't think you want to do this: > # Rename to keep it from being deleted on session exit > file rename $tmpfile $tmpfile.mpg because if you do that, the ns_parseformfile command immediately afterward fails because the temp file is no longer there. Your code sample doesn't work. Here is the code I finally settled on, which works great. ###################### #### NAVISERVER SPOOLER UPLOAD HANDLER CODE set tmpfile [ns_conn contentfile] if { $tmpfile == "" } { ns_adp_puts {Something is wrong.} return } set form [ns_set create] ns_parseformfile $tmpfile $form [ns_set iget [ns_conn headers] content-type] array set formdata [ns_set array $form] puts "array: [array get formdata]" # this code fills in the variables I need rather than using ns_queryget set inemail $formdata(email) set inpw $formdata(pw) set desc $formdata(desc) ###################### |
From: Vlad S. <vl...@cr...> - 2009-11-19 17:49:22
|
Yes, regular form parser uses mmap, so for huge files it is not good I use 1-2GB file pretty easily with the spooler. In the script, just check if the file is spooled set tmpfile [ns_conn contentfile] if { $tmpfile != "" } { # Rename to keep it from being deleted on session exit file rename $tmpfile $tmpfile.mpg # Call offline parser set form [ns_set create] ns_parseformfile $tmpfile $form [ns_set iget [ns_conn headers] content-type] } Stephen Deasey wrote: > On Thu, Nov 19, 2009 at 2:25 AM, John Buckman <jo...@ma...> wrote: >> I'm writing an app that accepts large file uploads, and trying to lower the memory requirements. >> >> When I upload large files, at the point where the files are completely uploaded, Naviserver consumes an equivalent amount of memory as the file uploaded size, as it hands control over to my form handler. Memory is released once my form handler returns. Virtually no memory is used (thanks, spooler) as the large file is being uploaded, only once the upload completes. >> >> I'm not sure why Naviserver needs to hold the file in memory. >> >> So, questions: >> >> a) is this by design? >> b) has anyone on this list worked on this section of code? >> c) any fixes, or should I plunge into the nsd/form.c code (is that right?) to try to fix this? > > > We originally talked about this way back in 2005: > > http://sourceforge.net/mailarchive/message.php?msg_id=37583D44-1F17-401D-8BCA-26F816831B92%40archiware.com > > Spooling got implemented later. > > What didn't didn't get implemented, and what you're tripping over, is > the on-the-fly parsing of file-upload mime headers so that *only* the > contents of the actual file becomes a file spooled on disk, and not > the file topped and tailed with mime headers. As you've discovered, > the way the form parsing is implemented it just reads the whole thing > back into memory anyway, negating the benefit of spooling to disk. > > Ideally, the spooler thread would parse the form as it is read in > chunks from the socket, placing variables in the form structure, and > spooling file contents to disk. If more than one file is in the form > then multiple spool files would be used. > > Watch out for encoding. IIRC the way it currently works forms can be > reparsed if the encoding changes. Perhaps everything but the file > parts of a multipart form could be saved in a buffer..? ie. you strip > out the large files from the input stream and leave the rest for > normal form processing. > > Also watch out for which temp directory files are being spooled to. If > it is on a separate partition then the final rename() will actually be > a file copy. Large files should probably be sent to a configured > spool directory. > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > naviserver-devel mailing list > nav...@li... > https://lists.sourceforge.net/lists/listinfo/naviserver-devel > |
From: Stephen D. <sd...@gm...> - 2009-11-19 15:15:24
|
On Thu, Nov 19, 2009 at 2:25 AM, John Buckman <jo...@ma...> wrote: > I'm writing an app that accepts large file uploads, and trying to lower the memory requirements. > > When I upload large files, at the point where the files are completely uploaded, Naviserver consumes an equivalent amount of memory as the file uploaded size, as it hands control over to my form handler. Memory is released once my form handler returns. Virtually no memory is used (thanks, spooler) as the large file is being uploaded, only once the upload completes. > > I'm not sure why Naviserver needs to hold the file in memory. > > So, questions: > > a) is this by design? > b) has anyone on this list worked on this section of code? > c) any fixes, or should I plunge into the nsd/form.c code (is that right?) to try to fix this? We originally talked about this way back in 2005: http://sourceforge.net/mailarchive/message.php?msg_id=37583D44-1F17-401D-8BCA-26F816831B92%40archiware.com Spooling got implemented later. What didn't didn't get implemented, and what you're tripping over, is the on-the-fly parsing of file-upload mime headers so that *only* the contents of the actual file becomes a file spooled on disk, and not the file topped and tailed with mime headers. As you've discovered, the way the form parsing is implemented it just reads the whole thing back into memory anyway, negating the benefit of spooling to disk. Ideally, the spooler thread would parse the form as it is read in chunks from the socket, placing variables in the form structure, and spooling file contents to disk. If more than one file is in the form then multiple spool files would be used. Watch out for encoding. IIRC the way it currently works forms can be reparsed if the encoding changes. Perhaps everything but the file parts of a multipart form could be saved in a buffer..? ie. you strip out the large files from the input stream and leave the rest for normal form processing. Also watch out for which temp directory files are being spooled to. If it is on a separate partition then the final rename() will actually be a file copy. Large files should probably be sent to a configured spool directory. |
From: John B. <jo...@ma...> - 2009-11-19 06:35:06
|
I'm writing an app that accepts large file uploads, and trying to lower the memory requirements. When I upload large files, at the point where the files are completely uploaded, Naviserver consumes an equivalent amount of memory as the file uploaded size, as it hands control over to my form handler. Memory is released once my form handler returns. Virtually no memory is used (thanks, spooler) as the large file is being uploaded, only once the upload completes. I'm not sure why Naviserver needs to hold the file in memory. So, questions: a) is this by design? b) has anyone on this list worked on this section of code? c) any fixes, or should I plunge into the nsd/form.c code (is that right?) to try to fix this? -john |
From: Stephen D. <sd...@gm...> - 2009-09-22 14:33:27
|
On Tue, Sep 22, 2009 at 1:13 PM, Christian A Vogl <c....@ki...> wrote: > Yes, you're right, Stephen, thank you! > > Responsible's my own ns_returnforbidden, and I was misguided by the > different behaviour for files and directories. In detail, for maybe > helping other misguided half-blinds like me: > > I checked file access using TCL's "file normalize", > which returns > "/path/to/real/file.ext" > for requests of "/path/to/webserver/pages/symdir/file.ext" in a > symbolically linked directory (symbolic link > "symdir --> /path/to/real" > in physical naviserver page root "/path/to/webserver/pages"), > > but returns > "/path/to/webserver/pages/physdir/file.ext" > if only "file.ext" links symbolically somewhere else (symbolic link > "file.ext --> /path/to/real/file.ext" > in physical directory "/path/to/webserver/pages/realdir") > > > So I just had to drop the normalizing. Check out ns_register_fasturl2file: http://naviserver.sourceforge.net/n/naviserver/files/ns_register_url2file.html It's like the 'mount' command in linux, or like symlinking one directory to another. Some examples (bit obscure...) here: http://bitbucket.org/naviserver/naviserver/src/tip/tests/url2file.test#cl-73 |
From: Christian A V. <c....@ki...> - 2009-09-22 13:08:43
|
Yes, you're right, Stephen, thank you! Responsible's my own ns_returnforbidden, and I was misguided by the different behaviour for files and directories. In detail, for maybe helping other misguided half-blinds like me: I checked file access using TCL's "file normalize", which returns "/path/to/real/file.ext" for requests of "/path/to/webserver/pages/symdir/file.ext" in a symbolically linked directory (symbolic link "symdir --> /path/to/real" in physical naviserver page root "/path/to/webserver/pages"), but returns "/path/to/webserver/pages/physdir/file.ext" if only "file.ext" links symbolically somewhere else (symbolic link "file.ext --> /path/to/real/file.ext" in physical directory "/path/to/webserver/pages/realdir") So I just had to drop the normalizing. Thanks again, Stephen, and best regards to the list! On Tue, 22 Sep 2009, Stephen Deasey wrote: > On Tue, Sep 22, 2009 at 11:23 AM, Christian A Vogl <ca...@ki...> wrote: > > Hi all! > > > > I'm wondering if it's a misconfiguration of mine or a feature of > > NaviServer: > > > > whenever I want to symbolically link to a folder in "pages" directory, > > I run into a 403 ("Forbidden") error. > > > > Symbolically linking to individual files works fine. > > Did I miss a configuration parameter? > > > I don't think there's any code in the fastpath (static files) or > adp/tcl path which returns a 403 response. > > Maybe you have some code which calls ns_forbidden or > Ns_ConnReturnForbidden? In a filter, or a directory listing proc/adp? > > If there is also a file/directory permission error, it should show up > in the error log. > > Come build with us! The BlackBerry® Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9-12, 2009. Register now! > http://p.sf.net/sfu/devconf > _______________________________________________ > naviserver-devel mailing list > nav...@li... > https://lists.sourceforge.net/lists/listinfo/naviserver-devel |
From: Stephen D. <sd...@gm...> - 2009-09-22 11:18:00
|
On Tue, Sep 22, 2009 at 11:23 AM, Christian A Vogl <ca...@ki...> wrote: > Hi all! > > I'm wondering if it's a misconfiguration of mine or a feature of > NaviServer: > > whenever I want to symbolically link to a folder in "pages" directory, > I run into a 403 ("Forbidden") error. > > Symbolically linking to individual files works fine. > Did I miss a configuration parameter? I don't think there's any code in the fastpath (static files) or adp/tcl path which returns a 403 response. Maybe you have some code which calls ns_forbidden or Ns_ConnReturnForbidden? In a filter, or a directory listing proc/adp? If there is also a file/directory permission error, it should show up in the error log. |
From: Christian A V. <ca...@ki...> - 2009-09-22 10:49:38
|
Hi all! I'm wondering if it's a misconfiguration of mine or a feature of NaviServer: whenever I want to symbolically link to a folder in "pages" directory, I run into a 403 ("Forbidden") error. Symbolically linking to individual files works fine. Did I miss a configuration parameter? Testing configurations were Ubuntu/Debian 8.10 and 9.04 and SuSE Enterprise 10 (Kernel 2.6.16). By the way: I vaguely remember symbolically linking to a mounted CD-ROM in AOLserver 4 on a SuSE system, some years ago. -- Regards, Christian |
From: Vlad S. <vl...@cr...> - 2009-07-14 02:18:06
|
Hi, Anyone encountered something like this: i am compiling current HEAD naviserver version on my new 64bit Archlinux Linux video.mpower.net 2.6.29-ARCH #1 SMP PREEMPT Sat May 9 14:09:36 CEST 2009 x86_64 Intel(R) Xeon(R) CPU X5355 @ 2.66GHz GenuineIntel GNU/Linux All okay until i start the server, i get [01/Jul/2009:01:07:13][10722.7fe1f388b6f0][-main-] Notice: driver: starting: nssock [01/Jul/2009:01:07:13][10722.7fe1f388b6f0][-main-] Fatal: binder: sendmsg() failed: 'Bad file descriptor' I have older (1 year code running without problems, i can start that binary, but even old code when i compile, i get this error). Any hints? -- Vlad Seryakov vl...@cr... http://www.crystalballinc.com/vlad/ |
From: Vlad S. <vl...@cr...> - 2009-07-14 02:13:24
|
I actually can understand her, being left with the code with nobody knowing it you can expect negativity towards previous old system which nobody maintains anymore. Plus, it is pretty "old" and kinda "weird". I am myself find myself having more and more doubts starting anything new in Naviserver/Tcl. For example, testing recently Jetty Java servlet, i could achieve same performance as cached Tcl/Adp pages from Naviserver. I was surprised but then i realized i was hiding behind old claim that we are the fastest Web server in the planet (that's my problem, i am talking about myself only). Jeff Rogers wrote: > Stephen Deasey wrote: >> Some pretty funny miss-statements in this history of AOLserver running aol.com: >> >> http://velocityconference.blip.tv/file/2286110/ > > Wow, the hatred for tcl is palpable. This is something I've never > understood. > > -J > > ------------------------------------------------------------------------------ > Enter the BlackBerry Developer Challenge > This is your chance to win up to $100,000 in prizes! For a limited time, > vendors submitting new applications to BlackBerry App World(TM) will have > the opportunity to enter the BlackBerry Developer Challenge. See full prize > details at: http://p.sf.net/sfu/Challenge > _______________________________________________ > naviserver-devel mailing list > nav...@li... > https://lists.sourceforge.net/lists/listinfo/naviserver-devel > -- Vlad Seryakov vl...@cr... http://www.crystalballinc.com/vlad/ |
From: Jeff R. <dv...@di...> - 2009-07-14 00:27:09
|
Stephen Deasey wrote: > Some pretty funny miss-statements in this history of AOLserver running aol.com: > > http://velocityconference.blip.tv/file/2286110/ Wow, the hatred for tcl is palpable. This is something I've never understood. -J |
From: Stephen D. <sd...@gm...> - 2009-07-13 16:39:28
|
Some pretty funny miss-statements in this history of AOLserver running aol.com: http://velocityconference.blip.tv/file/2286110/ But the punchline is that their shiny new apache/tomcat setup can barely manage half the 45 reqs/sec she derides the old AOLserver on 6 year old hardware achieving. The other videos from this conference are actually interesting -- check 'em out. |
From: Vlad S. <vl...@cr...> - 2009-06-26 14:39:02
|
Bernd Eidenschink wrote: > silent list and working servers... that's how it should be :-) Yes, it is true. And also i recently discovered Scala and LiftWeb which we are going to use in our company, so working servers are still there but new development almost halted on Ns/Tcl side :-((( > btw: am I the only one that gets a lot of (real) spam lately via the SF > address? > yes, me too |
From: Bernd E. <eid...@we...> - 2009-06-26 08:30:39
|
hi zoran, no, the list is perfectly ok. It's the SF address (...@users.sourceforge.net) that forwards mail to me which as a bonus is marked in the subject as [SPAM], but only lately the SPAM increased so I have to filter it on my side. cu BE |
From: Vasiljevic Z. <zv...@ar...> - 2009-06-26 08:05:40
|
On 26.06.2009, at 09:48, Bernd Eidenschink wrote: > btw: am I the only one that gets a lot of (real) spam lately via the > SF > address? hmhmhm... you should not. I normally delete all before they are delivered to the list. Zoran |
From: Bernd E. <eid...@we...> - 2009-06-26 07:48:46
|
silent list and working servers... that's how it should be :-) btw: am I the only one that gets a lot of (real) spam lately via the SF address? cu BE |
From: Vlad S. <vl...@cr...> - 2009-06-25 18:16:30
|
Yes, well and busy and i am not doing anything with naviserver for now Ian Harding wrote: > Haven't seen any messages for a while.... > > Hope everyone is well! > > - Ian > > ------------------------------------------------------------------------------ > _______________________________________________ > naviserver-devel mailing list > nav...@li... > https://lists.sourceforge.net/lists/listinfo/naviserver-devel > |
From: Vasiljevic Z. <zv...@ar...> - 2009-06-25 16:34:12
|
On 25.06.2009, at 18:28, Ian Harding wrote: > Haven't seen any messages for a while.... > > Hope everyone is well! Well, but very busy. Obviously, everybody is. Cheers Zoran |