naviserver-devel — Developer discussion

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Zoran V. <zv...@ar...>]

On Fri, 7 Jun 2019 11:25:19 +0200
Gustaf Neumann <ne...@wu...> wrote:

> Working with the numeric file descriptors has the advantage that it can be
> passed around between interpreters/threads, etc., so it is well suited
> for multi threaded applications, the FDs of open files can be kept
> in nsvs, etc.).

... but has the disadvantage of leaving
the Tcl way of handling IO :-(

With the Tcl's ability to cut/splice channels between
threads, you could achieve the same thing AND be Tcl 
compatible. For this to work the writer thread needs
to do Tcl_Write/Tcl_Read and not only write/read so 
there should be changes there of course.

I am telling this because I just completed the ns_http
rewrite that handles more/less similar issue w.r.t
queued http reads/writes and I was using the same
cut/splice technique to open a channel in one and
read/write to it in the other thread.

In order to keep this option open and not to clutter
the Tcl API, the "ns_asyncwrite" should allow for

  ns_asyncwrite ?-channel chan | -fd fd? content

At some time, if needed, the writer can be expanded
to understand Tcl channels as well.
 
 

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Gustaf N. <ne...@wu...>]

On 06.06.19 23:09, Gustaf Neumann wrote:
> Not sure, what your performance constraints are, but open/close
> is pretty fast these days (measured under linux on openacs.org):
>     % time {set F [open /tmp/foo a]; puts $F x; close $F} 1000
>     55.333 microseconds per iteration
>
> if this is too slow for you, one can experiment with ramdisks,
> and other already mentioned approaches.
>
i did some more experiments and implemented a "ns_asyncwrite"
wrapper for NaviServer's internal function:

     time {ns_asyncwrite 55 hello\n} 1000
     0.957 microseconds per iteration

This is pretty cool. Since the AsyncWriterThread is build around
a queue, this is also protected against concurrent write() operations.
this means, one can do ~1mio simple write operations per second
in the thread protected way, independent from file system blocks
(measured on the same machine with the same load as above).

The only disadvantage is that one needs commands for opening/closing
based on the numeric file descriptors (not on Tcl file handles), which
means at the end small wrappers on top of NaviServer's 
ns_write()/ns_close().
Working with the numeric file descriptors has the advantage that it can be
passed around between interpreters/threads, etc., so it is well suited
for multi threaded applications, the FDs of open files can be kept
in nsvs, etc.).

I see also potentials for this in some of our projects (e.g. writing 
application
specific log-files e.g. for ingest in elasticsearch, etc.).

If nobody objects, i'll try to bring this to a state for committing this 
the next
days.

-g

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Zoran V. <zv...@ar...>]

On Thu, 6 Jun 2019 15:49:29 -0400
Andrew Piskorski <at...@pi...> wrote:

> However, (particularly given my small writes to many files), clearly
> asynchronous file IO should be more efficient, and scale better, so
> I'd like to understand how to do that.  The ease of simply calling
> "fconfigure" on a file handle is attractive, but I don't yet
> understand what else I'd need to do to make that seemingly simple
> approach actually work in the NaviServer context.

OK. You need an extra thread that sits in event loop.
Unfortunately NS does not have this setup built-in.
But the Tcl threading extension does!

You could open the file in your main thread then pass
the channel to the special async thread that sits 
in the event loop (by design) and handle writing, 
completely asynchhronously, using fconfigure and
write-callbacks there. I however do not know if this would
save you something, since writing into files, especially
if you write small amounts, is heavily cached by the OS.
I guess you need to try it yourself.

You would need to use [ns_ictl trace create] to load 
the extension into each interp. 

This would work. Again, stock NS does not have this
kind of (threading) functionality. Over the course of
years I wanted to add this but never really got time...

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Gustaf N. <ne...@wu...>]

On 06.06.19 21:49, Andrew Piskorski wrote:
> The easiest thing to do is call Tcl's open, puts, close every single
> time I need to write data, but that's blocking, and I'm worried that
> it could easily degrade the latency of my main processing thread.
by "main thread" you refer probably to the "current connection thread".
> I don't necessarily need async IO to the files, but I WOULD like to get
> the latency of writing the files out of the main thread.
Not sure, what your performance constraints are, but open/close
is pretty fast these days (measured under linux on openacs.org):

    % time {set F [open /tmp/foo a]; puts $F x; close $F} 1000
    55.333 microseconds per iteration

if this is too slow for you, one can experiment with ramdisks,
and other already mentioned approaches.

> However, (particularly given my small writes to many files), clearly
> asynchronous file IO should be more efficient, and scale better, so
> I'd like to understand how to do that.  The ease of simply calling
> "fconfigure" on a file handle is attractive, but I don't yet
> understand what else I'd need to do to make that seemingly simple
> approach actually work in the NaviServer context.
whatever "work" means.

you can do that when you have at no time more then 1024 file descriptors
open under Linux. For windows, the maximum is probably lower [1].
Doing async I/O in a connection thread does not yield anything (every
thread has its own interpreter, therefore its own open files). 
Furthermore you have
to consider write synchronization (handling concurrent writes from multiple
connection/background threads to the same file). The previously mentioned
approach with  the AsyncDiskWriter cares about this.

all the best

-gn

[1] 
https://stackoverflow.com/questions/47675410/python-asyncio-aiohttp-valueerror-too-many-file-descriptors-in-select-on-win

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Andrew P. <at...@pi...>]

On Thu, Jun 06, 2019 at 09:23:12PM +0200, Gustaf Neumann wrote:

> The main question is, why are you interested in async writes?

My original use case wasn't clear?  I have one thread busy processing
data and sending it various places.  I want to log some of that data
to a bunch of files, probably 10 to 100 different small files at any
given time.  Each write is only a small amount of data, but for easier
use later I'd rather keep the data organized into separate files,
rather than e.g. dump it all into one great big file.

The easiest thing to do is call Tcl's open, puts, close every single
time I need to write data, but that's blocking, and I'm worried that
it could easily degrade the latency of my main processing thread.  I
don't necessarily need async IO to the files, but I WOULD like to get
the latency of writing the files out of the main thread.

If I create my own writer thread for this, it could do the writes
synchronously (blocking), that would still accomplish my main goal of
getting the file write latency out of my main thread.

However, (particularly given my small writes to many files), clearly
asynchronous file IO should be more efficient, and scale better, so
I'd like to understand how to do that.  The ease of simply calling
"fconfigure" on a file handle is attractive, but I don't yet
understand what else I'd need to do to make that seemingly simple
approach actually work in the NaviServer context.

-- 
Andrew Piskorski <at...@pi...>

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Gustaf N. <ne...@wu...>]

On 06.06.19 18:26, Andrew Piskorski wrote:
>>>  From inside NaviServer, I'd like to repeatedly write data to some
>>> files in the background,
>> I assume you want to consume data from remote?
> No, the data isn't being uploaded by clients, it's received or
> generated server-side.  Think a streaming data feed from some other
> server.  The nssock module isn't involved at all, so I don't think
> there's any way for me to use its spoolerthreads or maxupload feature
> here.
In OpenACS there is the background writer, which works via a separate
tclthead (using the tcl thread library, called "AsyncDiskWriter" see 
[1], used
e.g. in [2]) which was to avoid blocking the server when the file-system
blocks. File system blocks were an issue years ago in Linux, but i have
not noticed this problem lately (maybe because of the "asynclogwriter"
in NaviServer (see sample config file for OpenACS in the NaviServer distro),
or due to the mentioned AsyncDiskWriter.

I am rather planing to reduce the usage of the Tcl-based
AsyncDiskWriter, since this depends on select() in current Tcl
implementations, which will run into problems when there are
more than 1024 fds are open. It is however quite easy to
provide a Tcl Interface to NsAsyncWrite() in NaviServer,
to implement this when needed, sine the base infrastructure is
already there.

The main question is, why are you interested in async writes?

-g

[1] 
https://github.com/openacs/xotcl-core/blob/oacs-5-10/tcl/bgdelivery-procs.tcl#L228
[2] 
https://github.com/openacs/xotcl-request-monitor/blob/master/tcl/throttle_mod-procs.tcl#L68

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Andrew P. <at...@pi...>]

On Thu, Jun 06, 2019 at 07:22:08PM +0200, Zoran Vasiljevic wrote:
> There are also writer threads that spool files in a dedicated thread thus offloading the connection threads.

I see AsyncWriterThread() in "naviserver/nsd/driver.c", but I don't
really understand the code, nor how it could be useful to my
situation.  I thought that stuff was only for NaviServer's own log
files; is it actually for general purpose use?

-- 
Andrew Piskorski <at...@pi...>

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Zoran V. <zv...@ar...>]

There are also writer threads that spool files in a dedicated thread thus offloading the connection threads.

Am 6. Juni 2019 18:26:52 MESZ schrieb Andrew Piskorski <at...@pi...>:
>On Thu, Jun 06, 2019 at 05:23:38PM +0200, Zoran Vasiljevic wrote:
>> > From inside NaviServer, I'd like to repeatedly write data to some
>> > files in the background, 
>
>> I assume you want to consume data from remote?
>
>No, the data isn't being uploaded by clients, it's received or
>generated server-side.  Think a streaming data feed from some other
>server.  The nssock module isn't involved at all, so I don't think
>there's any way for me to use its spoolerthreads or maxupload feature
>here.

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Andrew P. <at...@pi...>]

On Thu, Jun 06, 2019 at 05:23:38PM +0200, Zoran Vasiljevic wrote:
> > From inside NaviServer, I'd like to repeatedly write data to some
> > files in the background, 

> I assume you want to consume data from remote?

No, the data isn't being uploaded by clients, it's received or
generated server-side.  Think a streaming data feed from some other
server.  The nssock module isn't involved at all, so I don't think
there's any way for me to use its spoolerthreads or maxupload feature
here.

-- 
Andrew Piskorski <at...@pi...>

Re: [naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Zoran V. <zv...@ar...>]

On Thu, 6 Jun 2019 10:41:02 -0400
Andrew Piskorski <at...@pi...> wrote:

> From inside NaviServer, I'd like to repeatedly write data to some
> files in the background, 

I assume you want to consume data
from remote? In that case you may
want to use spooler thread(s):

    #                                                                           
    # Spooling Threads                                                          
    #                                                                           
    #ns_param   spoolerthreads 0   ;# default: 0; number of upload spooler threads
    #ns_param   maxupload      0   ;# default: 0, when specified, spool uploads larger than this value to a temp file

[naviserver-devel] Tcl nonblocking file IO in NaviServer?

[Andrew P. <at...@pi...>]

>From inside NaviServer, I'd like to repeatedly write data to some
files in the background, while letting the thread that schedules the
writes go on to do other work.  The obvious way to do that might seem
be simply calling Tcl's "open" on each file and then doing:

  fconfigure $fd -blocking 0

However, the Tcl docs clearly say that:

  http://www.tcl.tk/man/tcl8.6/TclCmd/puts.htm

  The application must use the Tcl event loop for nonblocking output to
  work; otherwise Tcl never finds out that the file or device is ready
  for more output data.

I believe most threads in NaviServer never enter the Tcl event loop,
and therefore Tcl nonblocking IO won't work at all.  Is that correct?

Is there another simple approach I should use from NaviServer instead,
perhaps something analogous to the "background delivery" (ns_writer)
scheme for writing to network sockets?  Or would I need to roll my own?

For rolling my own, what approach and APIs would make the most sense
to use?  So far I'm guessing something like this:

1. Temporarily store the data to be written in an nsv somewhere,
   and have a special write-to-file thread running in the background,
   which reads from the nsv.
2. The write-to-file thread can itself use Tcl noblocking IO to do
   the actual writes, and enter the Tcl event loop whenever it's idle.
3. Send a signal to the write-to-file thread telling it, "Wake up, you
   have work to do."

But how should I do step 3 above?  Normally I'd use ns_cond (ns_event),
but that can't work if my write-to-file thread is waiting in the Tcl
event loop, instead of waiting on a conditional variable, right?  So
what's the right way to send a signal to a thread that's using the Tcl
event loop?

Should I be using "thread::send" for that?  Or is there some other or
better approach?  (I don't currently have the Tcl Threads Extension
built for my NaviServer.)  Hm, if I need to use thread::send anyway,
maybe I can (should?) simply include all the data in each message, and
skip queuing it temporarily in an nsv?

  https://www.tcl.tk/man/tcl8.6/ThreadCmd/thread.htm#M17

Thanks in advance for your advice!

-- 
Andrew Piskorski <at...@pi...>

[naviserver-devel] nsphp with PHP 7

[Gustaf N. <ne...@wu...>]

Dear NaviServer developers,

Last week, i've updated nsphp from supporting PHP version 5
to PHP version 7 (tested with PHP 7.3.5) since PHP 5 reached it
EOL by Jan 2019.

PHP 7 has substantial changes e.g. in memory and thread management
compared to PHP 5, several interfaces and API calls have changed,
such that it is not possible to compile the new version of nsphp with
the old PHP 5.

If you are using nsphp, you might consider updating...

all the best

-gn

[1] https://bitbucket.org/naviserver/nsphp/

Re: [naviserver-devel] Tcl8.6 tdbc::mysql under NaviServer

[David O. <da...@qc...>]

Thank you for that Gustaf!

On Wed, 8 May 2019 at 11:26, Gustaf Neumann <ne...@wu...> wrote:

> On 07.05.19 18:03, David Osborne wrote:
>
> Thanks again.
>
> Does this config snippet look OK?
>
> The snippet looks OK, but something went wrong during compilation
> (you should have seen an error message during linking). The Makefile in
> the repository
> (and tar file) contained an outdated library name, and it was missing the
> "-lndsb" flag ... all since many years.
>
> I've updated the default Makefile on bitbucket. At lease it links now fine
> and
> loades the module cleanly.
>
> -g
>
>
> Getting the following error on startup using both the tip code versions,
> and the versions in the 4.99.18 tarballs:
>
> [03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Notice: modload:
> loading module ns/db/driver/mysql from file nsdbmysql
> [03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Error: modload:
> /usr/local/ns/bin/nsdbmysql.so: couldn't load file
> "/usr/local/ns/bin/nsdbmysql.so": /usr/local/ns/bin/nsdbmysql.so: undefined
> symbol: Ns_DbDriverName
> [03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Error: dbdrv: failed to
> load driver 'mysql'
>
>
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>


-- 

*David Osborne | Software Engineer*
Qcode Software, Castle House, Fairways Business Park, Inverness, IV2 6AA
*Email:* da...@qc... | *Phone:* 01463 896 484
www.qcode.co.uk

Re: [naviserver-devel] Tcl8.6 tdbc::mysql under NaviServer

[Gustaf N. <ne...@wu...>]

On 07.05.19 18:03, David Osborne wrote:
> Thanks again.
>
> Does this config snippet look OK?
The snippet looks OK, but something went wrong during compilation
(you should have seen an error message during linking). The Makefile in 
the repository
(and tar file) contained an outdated library name, and it was missing the
"-lndsb" flag ... all since many years.

I've updated the default Makefile on bitbucket. At lease it links now 
fine and
loades the module cleanly.

-g

>
> Getting the following error on startup using both the tip code 
> versions, and the versions in the 4.99.18 tarballs:
>
> [03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Notice: modload: 
> loading module ns/db/driver/mysql from file nsdbmysql
> [03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Error: modload: 
> /usr/local/ns/bin/nsdbmysql.so: couldn't load file 
> "/usr/local/ns/bin/nsdbmysql.so": /usr/local/ns/bin/nsdbmysql.so: 
> undefined symbol: Ns_DbDriverName
> [03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Error: dbdrv: 
> failed to load driver 'mysql'
>

Re: [naviserver-devel] Tcl8.6 tdbc::mysql under NaviServer

[David O. <da...@qc...>]

Thanks again.

Does this config snippet look OK?

Getting the following error on startup using both the tip code versions,
and the versions in the 4.99.18 tarballs:

[03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Notice: modload: loading
module ns/db/driver/mysql from file nsdbmysql
[03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Error: modload:
/usr/local/ns/bin/nsdbmysql.so: couldn't load file
"/usr/local/ns/bin/nsdbmysql.so": /usr/local/ns/bin/nsdbmysql.so: undefined
symbol: Ns_DbDriverName
[03/May/2019:20:52:12][25299.7fcd9d1de700][-main-] Error: dbdrv: failed to
load driver 'mysql'

<---->

ns_section "ns/server/default/modules" {
    ns_param    nscp                nscp
    ns_param    nssock              nssock
    ns_param    nslog               nslog
    ns_param    nscgi               nscgi
    ns_param    nsdb               nsdb
}

ns_section "ns/db/drivers" {
    ns_param   mysql        nsdbmysql.so  ;# Load MySQL driver
}

ns_section "ns/db/pools" {
    ns_param   dbpool       "MySQL Pool"
}

ns_section "ns/db/pool/dbpool" {
    ns_param        driver                  mysql
    ns_param        connections             5
    ns_param        user                    dbuser
    ns_param        password                xxxx
    ns_param        datasource              hostname:3306:databasename
    ns_param        verbose                 on
}





On Tue, 7 May 2019 at 15:20, Gustaf Neumann <ne...@wu...> wrote:

> On 07.05.19 15:25, David Osborne wrote:
> > Trying nsdbmysql now.
> >
> > Getting a few compiler warnings when building - are these all fairly
> > benign?
>
> yes
>
> if you take the released version of the module (from the modules tar
> file) and compiled this
> against the latest released version of NaviServer you see less warnings.
>
> however, i have just now updated the module on bitbucket to compile
> cleanly with "-wall -pedantic"
>
> all the best
>
> -gn
>
>
>
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>


-- 

*David Osborne | Software Engineer*
Qcode Software, Castle House, Fairways Business Park, Inverness, IV2 6AA
*Email:* da...@qc... | *Phone:* 01463 896 484
www.qcode.co.uk

Re: [naviserver-devel] Tcl8.6 tdbc::mysql under NaviServer

[Gustaf N. <ne...@wu...>]

On 07.05.19 15:25, David Osborne wrote:
> Trying nsdbmysql now.
>
> Getting a few compiler warnings when building - are these all fairly 
> benign?

yes

if you take the released version of the module (from the modules tar 
file) and compiled this
against the latest released version of NaviServer you see less warnings.

however, i have just now updated the module on bitbucket to compile 
cleanly with "-wall -pedantic"

all the best

-gn

Re: [naviserver-devel] Tcl8.6 tdbc::mysql under NaviServer

[David O. <da...@qc...>]

Thanks Gustaf,

Trying nsdbmysql now.

Getting a few compiler warnings when building - are these all fairly benign?

gcc -I/usr/include/mysql -g -Wall -fPIC -g -O2
-fdebug-prefix-map=/build/tcl8.6-EAf4Te/tcl8.6-8.6.6+dfsg=.
-fstack-protector-strong -Wformat -Werror=format-security
-fno-unit-at-a-time -pipe -Wdate-time -D_FORTIFY_SOURCE=2
-I/usr/local/ns/include -I"/usr/include/tcl8.6"  -DHAVE_CONFIG_H    -c -o
nsdbmysql.o nsdbmysql.c
nsdbmysql.c: In function ‘Ns_DbDriverInit’:
nsdbmysql.c:120:29: warning: passing argument 1 of ‘Ns_RegisterProcInfo’
from incompatible pointer type [-Wincompatible-pointer-types]
         Ns_RegisterProcInfo(AtExit, "dbimy:cleanshutdown", NULL);
                             ^~~~~~
In file included from nsdbmysql.c:36:0:
/usr/local/ns/include/ns.h:2151:1: note: expected ‘ns_funcptr_t {aka void
(*)(void)}’ but argument is of type ‘void (*)(void *)’
 Ns_RegisterProcInfo(ns_funcptr_t procAddr, const char *desc, Ns_ArgProc
*argProc)
 ^~~~~~~~~~~~~~~~~~~
nsdbmysql.c: In function ‘DbGetRow’:
nsdbmysql.c:339:61: warning: format ‘%d’ expects argument of type ‘int’,
but argument 3 has type ‘size_t {aka long unsigned int}’ [-Wformat=]
         Ns_Log(Error, "DbGetRow: Number of columns in row (%d)"
                                                             ^
nsdbmysql.c: In function ‘DbServerInit’:
nsdbmysql.c:690:34: warning: passing argument 2 of ‘Ns_TclRegisterTrace’
from incompatible pointer type [-Wincompatible-pointer-types]
     Ns_TclRegisterTrace(hServer, DbInterpInit, NULL, NS_TCL_TRACE_CREATE);
                                  ^~~~~~~~~~~~
In file included from nsdbmysql.c:36:0:
/usr/local/ns/include/ns.h:3039:1: note: expected ‘int (*)(Tcl_Interp *,
const void *) {aka int (*)(struct Tcl_Interp *, const void *)}’ but
argument is of type ‘int (*)(Tcl_Interp *, void *) {aka int (*)(struct
Tcl_Interp *, void *)}’
 Ns_TclRegisterTrace(const char *server, Ns_TclTraceProc *proc, const void
*arg, Ns_TclTraceType when)
 ^~~~~~~~~~~~~~~~~~~
nsdbmysql.c: In function ‘InitThread’:
nsdbmysql.c:743:19: warning: cast from pointer to integer of different size
[-Wpointer-to-int-cast]
     initialised = (int) Ns_TlsGet(&tls);
                   ^
nsdbmysql.c: In function ‘CleanupThread’:
nsdbmysql.c:754:23: warning: cast from pointer to integer of different size
[-Wpointer-to-int-cast]
     int initialised = (int) arg;
                       ^
At top level:
nsdbmysql.c:34:24: warning: ‘RCSID’ defined but not used [-Wunused-variable]
 static const char     *RCSID = "$Id$";
                        ^~~~~






On Fri, 3 May 2019 at 21:59, Gustaf Neumann <ne...@wu...> wrote:

> On 03.05.19 16:35, David Osborne wrote:
> > I was hoping someone could help us understand what's happening below.
> >
> > We use the nsdbpg driver to access our main PostgreSQL database, but
> > we have a requirement to occasionally access a MysQL server database
> also.
> >
> > We thought Tcl8.6's tdbc might be an easy way to do this...
>
> the recommended approach is to use one of the NaviServer drivers for
> mysql (e.g nsdbmysql or nsdbimy).
>
> The problem seems to be, that the Tcl package you are using is not
> serializable for the blueprints. In general, it is not so clear, what
> should happen with (maybe open) Tcl managed connections, when the
> blueprint is reloaded.  Using the connection pools of the NaviServer
> modules are probably faster, easier to manage and agnostic to blueprint
> reloading.
>
> all the best
> -gn
>
>
>
> --
> Univ.Prof. Dr. Gustaf Neumann
> WU Vienna
> Institute of Information Systems and New Media
> Welthandelsplatz 1, A-1020 Vienna, Austria
>
>
>
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>


-- 

*David Osborne | Software Engineer*
Qcode Software, Castle House, Fairways Business Park, Inverness, IV2 6AA
*Email:* da...@qc... | *Phone:* 01463 896 484
www.qcode.co.uk

Re: [naviserver-devel] Tcl8.6 tdbc::mysql under NaviServer

[Gustaf N. <ne...@wu...>]

On 03.05.19 16:35, David Osborne wrote:
> I was hoping someone could help us understand what's happening below.
>
> We use the nsdbpg driver to access our main PostgreSQL database, but 
> we have a requirement to occasionally access a MysQL server database also.
>
> We thought Tcl8.6's tdbc might be an easy way to do this...

the recommended approach is to use one of the NaviServer drivers for 
mysql (e.g nsdbmysql or nsdbimy).

The problem seems to be, that the Tcl package you are using is not 
serializable for the blueprints. In general, it is not so clear, what 
should happen with (maybe open) Tcl managed connections, when the 
blueprint is reloaded.  Using the connection pools of the NaviServer 
modules are probably faster, easier to manage and agnostic to blueprint 
reloading.

all the best
-gn



-- 
Univ.Prof. Dr. Gustaf Neumann
WU Vienna
Institute of Information Systems and New Media
Welthandelsplatz 1, A-1020 Vienna, Austria

[naviserver-devel] Tcl8.6 tdbc::mysql under NaviServer

[David O. <da...@qc...>]

Hi,

I was hoping someone could help us understand what's happening below.

We use the nsdbpg driver to access our main PostgreSQL database, but we
have a requirement to occasionally access a MysQL server database also.

We thought Tcl8.6's tdbc might be an easy way to do this... and it does
work, but after loading the module under NaviServer, if we try to update
the definition of any procs within the current interpreters (which we do
via ns_eval -sync source ..... ) we are encountering the error
"::tdbc::mysql::connection
does not refer to an object."

A demo test case of the error would be something like the following.

Everything else seems to work as expected and we can carry on using the
system, but we are obviously concerned that there's something going wrong.
Should tdbc::mysql function correctly under NaviServer?

# uname -a
Linux stretch 4.9.0-8-amd64 #1 SMP Debian 4.9.144-3.1 (2019-02-19) x86_64
GNU/Linux
#  cat /etc/debian_version
9.9
# apt-cache policy tcl8.6
tcl8.6:
  Installed: 8.6.6+dfsg-1+b1
  Candidate: 8.6.6+dfsg-1+b1
  Version table:
 *** 8.6.6+dfsg-1+b1 500
        500 http://ftp.uk.debian.org/debian stretch/main amd64 Packages
        100 /var/lib/dpkg/status

$ hg clone https://bitbucket.org/naviserver/naviserver
$ cd naviserver
$ ./autogen.sh --disable-ipv6 --with-tcl=/usr/lib/tcl8.6 --enable-rpath
--enable-threads --enable-symbols
$ make
$ make install
$ apt-get install tcl8.6-tdbc tcl8.6-tdbc-mysql
$ chown -R nsadmin:nsadmin /usr/local/ns/logs
$ /usr/local/ns/bin/nsd -u nsadmin -t /usr/local/ns/conf/nsd-config.tcl -c

% package require tdbc
1.0.4
% package require tdbc::mysql
1.0.4
% ns_eval source /usr/local/ns/tcl/file.tcl
[03/May/2019:15:11:10][17859.7f24c7ae5700][-command-] Notice: tcl[default]:
enabletclpages for {GET HEAD POST} requests
[03/May/2019:15:11:10][17859.7f24b57fa700][-ns_eval_q:default:0] Notice:
tcl[default]: enabletclpages for {GET HEAD POST} requests
% [03/May/2019:15:11:10][17859.7f24b57fa700][-ns_job_0-] Notice: update
interpreter to epoch 3, trace deallocate, time 0.000054 secs
[03/May/2019:15:11:10][17859.7f24b57fa700][-ns_job_0-] Error:
::tdbc::mysql::connection does not refer to an object
::tdbc::mysql::connection does not refer to an object
    while executing
"load {} Tdbcmysql"
    invoked from within
"ns_ictl update"
    (procedure "ns_cleanup" line 8)
    invoked from within
"ns_cleanup"
    while executing callback
ns:tcltrace ns_cleanup
(context: trace proc)
[03/May/2019:15:11:10][17859.7f24b57fa700][-ns_job_0-] Error:
::tdbc::mysql::connection does not refer to an object
::tdbc::mysql::connection does not refer to an object
    while executing
"load {} Tdbcmysql"
    invoked from within
"ns_ictl update"
    (procedure "ns_cleanup" line 8)
    invoked from within
"ns_cleanup"
    while executing callback
ns:tcltrace ns_cleanup
(context: trace proc)
(context: trace deallocate)

Regards,
-- 

*David Osborne | Software Engineer*
Qcode Software, Castle House, Fairways Business Park, Inverness, IV2 6AA
*Email:* da...@qc... | *Phone:* 01463 896 484
www.qcode.co.uk

Re: [naviserver-devel] NS_ModuleInit Error - Installation Script

[Gustaf N. <ne...@wu...>]

Dear Iuri,

you are right, there is a problem with the sample config file for OpenACS,
which is included in the tar file used by install-ns.sh. If have updated
naviserver-4.99.18.tar.gz on sourceforge to include a fixed sample
config file.

You have three options:
a) specify in install-ns.sh for "version_ns" the value "HEAD" .
b) refetch the tar ball
c) add in the config file the ".so" extension (see below).
    This is the traditional way of loading shared objects,
    which works in all versions.

many thanks for reporting
-gn

Background:
The problem was that "nsproxy" (without extension) is a binary program,
and "nsproxy.so" is the shared libray. When "nsproxy" (without extension)
is used for the module in the config file, naviserver 4.99.18 tries to load
the binary program as shared object and fails. I have fixed this
issue actually already on the weekend in the NaviServer source code,
so if one installs from bitbucket, the issue should be gone.


+++ b/openacs-config.tcl        Tue Mar 12 09:19:10 2019 +0100
@@ -693,7 +693,7 @@
  ns_section ns/server/${server}/modules {
      ns_param   nslog           ${bindir}/nslog
      ns_param   nsdb            ${bindir}/nsdb
-    ns_param   nsproxy         ${bindir}/nsproxy
+    ns_param   nsproxy         ${bindir}/nsproxy.so
  
      #
      # Load networking modules depending on existence of Tcl variables

Re: [naviserver-devel] NS_ModuleInit Error - Installation Script

[<iu...@iu...>]

<html><body><span style="font-family:Verdana; color:#000000; font-size:10pt;"><div style=""><font face="verdana, geneva" style="">FYI</font></div><div style=""><br></div><div style=""><font face="verdana, geneva" style="">make[1]: Leaving directory '/usr/local/src/naviserver-4.99.18/nsssl'</font></div><div style=""><font face="verdana, geneva" style="">make[1]: Entering directory '/usr/local/src/naviserver-4.99.18/nsproxy'</font></div><div style=""><font face="verdana, geneva" style="">/usr/local/src/naviserver-4.99.18/install-sh -c <a href="http://nsproxy.so">nsproxy.so</a> /usr/local/ns/bin/</font></div><div style=""><font face="verdana, geneva" style="">/usr/local/src/naviserver-4.99.18/install-sh -c <a href="http://libnsproxy.so">libnsproxy.so</a> /usr/local/ns/lib/</font></div><div style=""><font face="verdana, geneva" style="">/usr/local/src/naviserver-4.99.18/install-sh -c nsproxy&nbsp; /usr/local/ns/bin/</font></div><div style=""><span style="background-color: rgb(255, 255, 0);" mce_style="background-color: #ffff00;">for h in nsproxy.h; do \</span></div><div style=""><span style="background-color: rgb(255, 255, 0);" mce_style="background-color: #ffff00;">	/usr/local/src/naviserver-4.99.18/install-sh -c -m 644 $h /usr/local/ns/include/; \</span></div><div style=""><span style="background-color: rgb(255, 255, 0);" mce_style="background-color: #ffff00;">done</span></div><div style=""><span style="background-color: rgb(255, 255, 0);" mce_style="background-color: #ffff00;">make[1]: Leaving directory '/usr/local/src/naviserver-4.99.18/nsproxy'</span></div><div style=""><span style="background-color: rgb(255, 255, 0);" mce_style="background-color: #ffff00;">/usr/local/src/naviserver-4.99.18/install-sh -c install-sh /usr/local/ns/bin/</span></div><div style=""><font face="verdana, geneva" style=""><br style=""></font></div><div style=""><font face="verdana, geneva" style="">The documentation is installed under: /usr/local/ns/pages/doc</font></div><div style=""><font face="verdana, geneva" style=""><br style=""></font></div><div style=""><font face="verdana, geneva" style=""><br style=""></font></div><div style=""><font face="verdana, geneva" style="">Congratulations, you have installed NaviServer.</font></div><div style=""><br style=""></div><div><br></div>
<blockquote id="replyBlockquote" webmail="1" style="color: black; font-family: verdana; font-size: 10pt; border-left: 2px solid blue; margin-left: 8px; padding-left: 8px;">
<div id="wmQuoteWrapper">
-------- Original Message --------<br>
Subject: [naviserver-devel] NS_ModuleInit Error - Installation Script<br>
From: Iuri Sampaio &lt;<a href="mailto:iu...@iu...">iu...@iu...</a>&gt;<br>
Date: Mon, March 11, 2019 12:27 pm<br>
To: <a href="mailto:nav...@li...">nav...@li...</a><br>
<br>
Hi there,<div class=""><br class=""></div><div class="">Has anyone tried to run NS 4.99.18, using the installation script available at <a target="_blank" href="https://github.com/gustafn/install-ns.git" class="">https://github.com/gustafn/install-ns.git</a>&nbsp;, in a KVM Debian 9 machine?</div><div class=""><br class=""></div><div class="">I had ran "<a href="http://install-ns.sh">install-ns.sh</a> build”, and it completed successfully. Then tried to boot up NS and I got the following error.</div><div class=""><br class=""></div><div class="">It claims for nsproxy not being located. However, both files exist within /bin directory, plus permission settings aren’t the issue. See ls -la bellow.</div><div class=""><div class=""><br class=""></div><div class="">What must be the approach to debug and fix this problem?</div><div class=""><br class=""></div><div class="">NS 4.99.17 script doesn’t have this bug.&nbsp;</div></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #afad24" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #afad24;"><b class="">&nbsp;</b></span><span style="font-variant-ligatures: no-common-ligatures; color: #5230e1" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #5230e1;"><b class="">~</b></span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;"># ls -la /usr/local/ns/bin/&nbsp; &nbsp; &nbsp; &nbsp;</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">total 460</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">drwxrwsr-x&nbsp; 2 root nsadmin&nbsp; 4096 Mar 11 19:07 </span><span style="font-variant-ligatures: no-common-ligatures; color: #5230e1" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #5230e1;"><b class="">.</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">drwxrwsr-x 13 root nsadmin&nbsp; 4096 Mar 11 16:57 </span><span style="font-variant-ligatures: no-common-ligatures; color: #5230e1" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #5230e1;"><b class="">..</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin &nbsp; 837 Aug&nbsp; 7&nbsp; 2017 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">dtplite</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rw-rw-r--&nbsp; 1 root nsadmin 17326 Mar 11 19:06 init.tcl</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 13868 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">install-sh</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 7234 Aug&nbsp; 7&nbsp; 2017 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nns</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 3373 Aug&nbsp; 7&nbsp; 2017 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nnsd</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 4485 Aug&nbsp; 7&nbsp; 2017 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nnslog</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 29088 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nscgi.so">nscgi.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 19448 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nscp.so">nscp.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 8712 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nsd</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 8560 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nsdb.so">nsdb.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 37872 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nsdbpg.so">nsdbpg.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 12872 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nsdbtest.so">nsdbtest.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 29208 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nslog.so">nslog.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 28208 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nsperm.so">nsperm.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="background-color: rgb(245, 236, 0);" class="" mce_style="background-color: #f5ec00;"><span style="font-variant-ligatures: no-common-ligatures;" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 8712 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: rgb(52, 188, 38);" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nsproxy</b></span></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="background-color: rgb(245, 236, 0);" class="" mce_style="background-color: #f5ec00;"><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 8648 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nsproxy.so">nsproxy.so</a></b></span></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 13312 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nssock.so">nssock.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 25736 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><a href="http://nsssl.so">nsssl.so</a></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 24784 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nsthreadtest</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin &nbsp; 671 Mar 11 19:07 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nxsh</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin &nbsp; 710 Mar 11 19:07 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">nxwish</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 19490 Aug&nbsp; 7&nbsp; 2017 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">page</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 4168 Aug&nbsp; 7&nbsp; 2017 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">pt</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 29841 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">sqlite3_analyzer</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin 13695 Aug&nbsp; 7&nbsp; 2017 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">tcldocstrip</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">lrwxrwxrwx&nbsp; 1 root nsadmin&nbsp; &nbsp; 26 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #33bbc8" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #33bbc8;"><b class="">tclsh</b></span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;"> -&gt; </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">/usr/local/ns/bin/tclsh8.6</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin&nbsp; 8904 Mar 11 19:06 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">tclsh8.6</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin &nbsp; 773 Mar 11 19:07 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">xotclsh</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">-rwxrwxr-x&nbsp; 1 root nsadmin &nbsp; 792 Mar 11 19:07 </span><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class="">xowish</b></span></div></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><br class=""></b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;"><b class=""><br class=""></b></span></div><div class=""><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(52, 188, 38); background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">[11/Mar/2019:09:41:25][686.7f9b027fc700][-sched:idle1-] </span><span style="font-variant-ligatures: no-common-ligatures; color: #000000" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #000000;">Notice: starting</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:09:41:25][686.7f9b027fc700][-sched:16-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: update interpreter to epoch 1, trace none, time 0.533963 secs</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:09:46:19][686.7f9b28d49700][::throttle] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: === user 192.168.1.160 left system at 1552322779 reason inactive after 560 seconds clicks 1</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:09:46:19][686.7f9b28d49700][::throttle] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: === user 192.168.1.169 left system at 1552322779 reason inactive after 574 seconds clicks 2</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: nsmain: NaviServer/4.99.18 (tar-4.99.18) starting</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: nsmain: security info: uid=1001, euid=1001, gid=1000, egid=1000</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(52, 188, 38); background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures; color: #000000" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #000000;">Notice: nsmain: Tcl version: 8.6.8</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: nsmain: max files: soft limit 1048576, hard limit 1048576</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;"><b class="">Warning: nsmain: rl_cur (1048576) &gt; FD_SETSIZE (1024), select() calls should not be used</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: pool default: queueLength 90 low water 9 high water 90</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: nsd/init.tcl[litli]: booting virtual server:&nbsp; Tcl system encoding: "utf-8"</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: modload: loading module nslog from file /usr/local/ns/bin/nslog</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: nslog: opened '/var/www/litli/log//access.log'</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: modload: loading module nsdb from file /usr/local/ns/bin/nsdb</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: modload: loading module ns/db/driver/postgres from file /usr/local/ns/bin/nsdbpg</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: nsdbpg: version 2.3 loaded, based on PostgreSQL 9.6.11 and libbpq 90611</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: dbinit: set LogMinDuration for pool pool1 over 0.01 to 0.010000</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: dbinit: set LogMinDuration for pool pool2 over 0.01 to 0.010000</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;">Notice: modload: loading module nsproxy from file /usr/local/ns/bin/nsproxy</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(195, 55, 32); background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;"><b class="">Error: modload: /usr/local/ns/bin/nsproxy: cannot find symbol "Ns_ModuleInit": /usr/local/ns/bin/nsproxy: undefined symbol: _Ns_ModuleInit</b></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(195, 55, 32); background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #34bc26" class="" mce_style="font-variant-ligatures: no-common-ligatures; color: #34bc26;">[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] </span><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;"><b class="">Fatal: modload: failed to load module '/usr/local/ns/bin/nsproxy'</b></span></div></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class="" mce_style="font-variant-ligatures: no-common-ligatures;"><b class=""><br class=""></b></span></div><hr><hr>_______________________________________________<br>
naviserver-devel mailing list<br>
<a href="mailto:nav...@li...">nav...@li...</a><br>
<a href="https://lists.sourceforge.net/lists/listinfo/naviserver-devel">https://lists.sourceforge.net/lists/listinfo/naviserver-devel</a><br>

</div>
</blockquote></span></body></html>

[naviserver-devel] NS_ModuleInit Error - Installation Script

[Iuri S. <iu...@iu...>]

Hi there,

Has anyone tried to run NS 4.99.18, using the installation script available at https://github.com/gustafn/install-ns.git <https://github.com/gustafn/install-ns.git> , in a KVM Debian 9 machine?

I had ran "install-ns.sh build”, and it completed successfully. Then tried to boot up NS and I got the following error.

It claims for nsproxy not being located. However, both files exist within /bin directory, plus permission settings aren’t the issue. See ls -la bellow.

What must be the approach to debug and fix this problem?

NS 4.99.17 script doesn’t have this bug. 



 ~# ls -la /usr/local/ns/bin/       
total 460
drwxrwsr-x  2 root nsadmin  4096 Mar 11 19:07 .
drwxrwsr-x 13 root nsadmin  4096 Mar 11 16:57 ..
-rwxrwxr-x  1 root nsadmin   837 Aug  7  2017 dtplite
-rw-rw-r--  1 root nsadmin 17326 Mar 11 19:06 init.tcl
-rwxrwxr-x  1 root nsadmin 13868 Mar 11 19:06 install-sh
-rwxrwxr-x  1 root nsadmin  7234 Aug  7  2017 nns
-rwxrwxr-x  1 root nsadmin  3373 Aug  7  2017 nnsd
-rwxrwxr-x  1 root nsadmin  4485 Aug  7  2017 nnslog
-rwxrwxr-x  1 root nsadmin 29088 Mar 11 19:06 nscgi.so
-rwxrwxr-x  1 root nsadmin 19448 Mar 11 19:06 nscp.so
-rwxrwxr-x  1 root nsadmin  8712 Mar 11 19:06 nsd
-rwxrwxr-x  1 root nsadmin  8560 Mar 11 19:06 nsdb.so
-rwxrwxr-x  1 root nsadmin 37872 Mar 11 19:06 nsdbpg.so
-rwxrwxr-x  1 root nsadmin 12872 Mar 11 19:06 nsdbtest.so
-rwxrwxr-x  1 root nsadmin 29208 Mar 11 19:06 nslog.so
-rwxrwxr-x  1 root nsadmin 28208 Mar 11 19:06 nsperm.so
-rwxrwxr-x  1 root nsadmin  8712 Mar 11 19:06 nsproxy
-rwxrwxr-x  1 root nsadmin  8648 Mar 11 19:06 nsproxy.so
-rwxrwxr-x  1 root nsadmin 13312 Mar 11 19:06 nssock.so
-rwxrwxr-x  1 root nsadmin 25736 Mar 11 19:06 nsssl.so
-rwxrwxr-x  1 root nsadmin 24784 Mar 11 19:06 nsthreadtest
-rwxrwxr-x  1 root nsadmin   671 Mar 11 19:07 nxsh
-rwxrwxr-x  1 root nsadmin   710 Mar 11 19:07 nxwish
-rwxrwxr-x  1 root nsadmin 19490 Aug  7  2017 page
-rwxrwxr-x  1 root nsadmin  4168 Aug  7  2017 pt
-rwxrwxr-x  1 root nsadmin 29841 Mar 11 19:06 sqlite3_analyzer
-rwxrwxr-x  1 root nsadmin 13695 Aug  7  2017 tcldocstrip
lrwxrwxrwx  1 root nsadmin    26 Mar 11 19:06 tclsh -> /usr/local/ns/bin/tclsh8.6
-rwxrwxr-x  1 root nsadmin  8904 Mar 11 19:06 tclsh8.6
-rwxrwxr-x  1 root nsadmin   773 Mar 11 19:07 xotclsh
-rwxrwxr-x  1 root nsadmin   792 Mar 11 19:07 xowish


[11/Mar/2019:09:41:25][686.7f9b027fc700][-sched:idle1-] Notice: starting
[11/Mar/2019:09:41:25][686.7f9b027fc700][-sched:16-] Notice: update interpreter to epoch 1, trace none, time 0.533963 secs
[11/Mar/2019:09:46:19][686.7f9b28d49700][::throttle] Notice: === user 192.168.1.160 left system at 1552322779 reason inactive after 560 seconds clicks 1
[11/Mar/2019:09:46:19][686.7f9b28d49700][::throttle] Notice: === user 192.168.1.169 left system at 1552322779 reason inactive after 574 seconds clicks 2
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: nsmain: NaviServer/4.99.18 (tar-4.99.18) starting
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: nsmain: security info: uid=1001, euid=1001, gid=1000, egid=1000
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: nsmain: Tcl version: 8.6.8
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: nsmain: max files: soft limit 1048576, hard limit 1048576
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Warning: nsmain: rl_cur (1048576) > FD_SETSIZE (1024), select() calls should not be used
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: pool default: queueLength 90 low water 9 high water 90
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: nsd/init.tcl[litli]: booting virtual server:  Tcl system encoding: "utf-8"
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: modload: loading module nslog from file /usr/local/ns/bin/nslog
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: nslog: opened '/var/www/litli/log//access.log'
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: modload: loading module nsdb from file /usr/local/ns/bin/nsdb
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: modload: loading module ns/db/driver/postgres from file /usr/local/ns/bin/nsdbpg
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: nsdbpg: version 2.3 loaded, based on PostgreSQL 9.6.11 and libbpq 90611
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: dbinit: set LogMinDuration for pool pool1 over 0.01 to 0.010000
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: dbinit: set LogMinDuration for pool pool2 over 0.01 to 0.010000
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Notice: modload: loading module nsproxy from file /usr/local/ns/bin/nsproxy
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Error: modload: /usr/local/ns/bin/nsproxy: cannot find symbol "Ns_ModuleInit": /usr/local/ns/bin/nsproxy: undefined symbol: _Ns_ModuleInit
[11/Mar/2019:17:24:53][21417.7fbf327c8700][-main-] Fatal: modload: failed to load module '/usr/local/ns/bin/nsproxy'

[naviserver-devel] NaviServer downloads

[Gustaf N. <ne...@wu...>]

Dear all,

below is a chart of the downloads of NaviServer from sourceforge
from its beginning in 2005. The good news is that these statistics
point in the right direction. Since 2010 we see a more or less
constant growth.

all the best

-g

Re: [naviserver-devel] nscgi question

[Ben B. <tek...@ya...>]

 Hi Gustaf,
Issue persists with test on platform Linux Mint 18.3 running Cinnamon Linux Desktop v3.6.7.
This OS is permissive with proprietary media, so not recommended for use with servers.So, I'm just noting it here for the record in case someone is thinking of running a local site/sdk. Wouldn't bother diagnosing any further.
As always, Gustaf, Thank you for your time and attention.Ben
    On Monday, March 4, 2019, 3:10:14 AM PST, Ben Brink via naviserver-devel <nav...@li...> wrote:  
 
 Hi Gustaf,

I just confirmed that the tests work on an Ubuntu 18.04 system.

Prior tests were on a MintLinux laptop. There's no particular reason to 
support Mint flavored Linux. Still, I'll report results of testing it 
later today.

cheers,
Ben

On 3/2/19 12:29 PM, Gustaf Neumann wrote:
> Dear Ben,
> 
> i have still not managed to reproduce an error. I have extended
> the hello-world.cgi script to include an image (see below) and tested
> this from the main www folder (R1) and from a mapped cgi-bin
> folder (R2) with a configuration without "allowstaticresources" set (C1)
> and once with this parameter set (C2).
> 
> The results:
> 
> - The main request of the script returns always the expected HTML
>     code with the HTML content type
> 
> - The image is shown in most cases
> 
>     R1+C1: yes
>     R1+C2: yes
>     R2+C1: no
>     R2+C2: yes
> 
> - When the image requests returns success (200), the image mime type
>     is correctly set. When the image request fails, a 404 error with the
>     error page is returned
> 
> All this is with NaviServer 4.99.18 on macOS.
> Do you get on your platform different results for these tests?
> 
> -g
> 
> 
> REQUEST R1:http://localhost:8100/hello-world.cgi
> REQUEST R2:http://localhost:8100/cgi-bin/hello-world.cgi
> 
> CONFIG C1:
> ns_section "ns/server/${server}/module/nscgi" {
>      ns_param map    "GET  /*.cgi"
>      ns_param map    "GET  /cgi-bin /usr/local/cgi-bin"
>      ns_param map    "GET  /awstats /opt/local/libexec/w3m/cgi-bin"
>      ns_param Interps  cgi
> }
> 
> 
> CONFIG C2
> ns_section "ns/server/${server}/module/nscgi" {
>      ns_param map    "GET  /*.cgi"
>      ns_param map    "GET  /cgi-bin /usr/local/cgi-bin"
>      ns_param map    "GET  /awstats /opt/local/libexec/w3m/cgi-bin"
>      ns_param Interps  cgi
>      ns_param allowstaticresources true
> }
> 
> 
> ====== SCRIPT hello.cgi ======================================
> puts "HTTP/1.0 200 OK
> Date: Monday, 06-Nov-95 17:50:15 GMT
> Content-Type: text/html
> 
> <html>
> <body>
> Hello World <img src='DotLrnLogo.gif'>
> </body>
> "
> ==============================================================
> 
> On 01.03.19 14:04, Ben Brink via naviserver-devel wrote:
>> Hi Gustaf,
>>
>> Thank you for the example and the info in thread:
>> https://openacs.org/forums/message-view?message_id=4268249#msg_4268538
>>
>> Your test case works so I'll debug the legacy scripts.
>>
>>
>>
>> Still, static files are returned without a content-type value, and 
>> without content.
>>
>> The ns_param allowstaticresources does not change this, whether 
>> omitted, or set to true or false. For example, if allowstaticresources 
>> is true, and content/file is:
>>
>> test6.txt
>> ==================================================================
>> Hello World
>>
>> ==================================================================
>>
>> or any *.gif or *.png file.
>>
>> Static content is returned as expected when not in cgi-bin.
>>
>>
>> The legacy perl cgi scripts I'm testing produce the same results ie no 
>> content and no content type, which is why I decided to test static files.
>>
>>
>> For static content, the log shows errors like:
>>
>> Debug(cgi): nscgi: interp '(null)' exec '/usr/local/cgi-bin/test6.txt'
>> Error: exec /usr/local/cgi-bin/test4.txt: execve() failed: Unknown 
>> error 1275110264
>> Debug(cgi): nscgi: execute cgi script in directory 
>> '/usr/local/cgi-bin' returned pid -3
>> Error: waitpid(-3) failed: No child processes
>> Error: nscgi: wait for /usr/local/cgi-bin/test4.txt failed: No child 
>> processes
>>
>> ..when debug logging is invoked nscgi in section of config.tcl using:
>>
>> ns_logctl severity Debug(pl) on
>> ns_logctl severity Debug(cgi) on
>>
>>
>> cheers,
>> Ben
>>
> 
> 
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> 


_______________________________________________
naviserver-devel mailing list
nav...@li...
https://lists.sourceforge.net/lists/listinfo/naviserver-devel
  

Re: [naviserver-devel] nscgi question

[Ben B. <tek...@ya...>]

Hi Gustaf,

I just confirmed that the tests work on an Ubuntu 18.04 system.

Prior tests were on a MintLinux laptop. There's no particular reason to 
support Mint flavored Linux. Still, I'll report results of testing it 
later today.

cheers,
Ben

On 3/2/19 12:29 PM, Gustaf Neumann wrote:
> Dear Ben,
> 
> i have still not managed to reproduce an error. I have extended
> the hello-world.cgi script to include an image (see below) and tested
> this from the main www folder (R1) and from a mapped cgi-bin
> folder (R2) with a configuration without "allowstaticresources" set (C1)
> and once with this parameter set (C2).
> 
> The results:
> 
> - The main request of the script returns always the expected HTML
>     code with the HTML content type
> 
> - The image is shown in most cases
> 
>     R1+C1: yes
>     R1+C2: yes
>     R2+C1: no
>     R2+C2: yes
> 
> - When the image requests returns success (200), the image mime type
>     is correctly set. When the image request fails, a 404 error with the
>     error page is returned
> 
> All this is with NaviServer 4.99.18 on macOS.
> Do you get on your platform different results for these tests?
> 
> -g
> 
> 
> REQUEST R1:http://localhost:8100/hello-world.cgi
> REQUEST R2:http://localhost:8100/cgi-bin/hello-world.cgi
> 
> CONFIG C1:
> ns_section "ns/server/${server}/module/nscgi" {
>      ns_param map     "GET  /*.cgi"
>      ns_param map     "GET  /cgi-bin /usr/local/cgi-bin"
>      ns_param map     "GET  /awstats /opt/local/libexec/w3m/cgi-bin"
>      ns_param Interps  cgi
> }
> 
> 
> CONFIG C2
> ns_section "ns/server/${server}/module/nscgi" {
>      ns_param map     "GET  /*.cgi"
>      ns_param map     "GET  /cgi-bin /usr/local/cgi-bin"
>      ns_param map     "GET  /awstats /opt/local/libexec/w3m/cgi-bin"
>      ns_param Interps  cgi
>      ns_param allowstaticresources true
> }
> 
> 
> ====== SCRIPT hello.cgi ======================================
> puts "HTTP/1.0 200 OK
> Date: Monday, 06-Nov-95 17:50:15 GMT
> Content-Type: text/html
> 
> <html>
> <body>
> Hello World <img src='DotLrnLogo.gif'>
> </body>
> "
> ==============================================================
> 
> On 01.03.19 14:04, Ben Brink via naviserver-devel wrote:
>> Hi Gustaf,
>>
>> Thank you for the example and the info in thread:
>> https://openacs.org/forums/message-view?message_id=4268249#msg_4268538
>>
>> Your test case works so I'll debug the legacy scripts.
>>
>>
>>
>> Still, static files are returned without a content-type value, and 
>> without content.
>>
>> The ns_param allowstaticresources does not change this, whether 
>> omitted, or set to true or false. For example, if allowstaticresources 
>> is true, and content/file is:
>>
>> test6.txt
>> ==================================================================
>> Hello World
>>
>> ==================================================================
>>
>> or any *.gif or *.png file.
>>
>> Static content is returned as expected when not in cgi-bin.
>>
>>
>> The legacy perl cgi scripts I'm testing produce the same results ie no 
>> content and no content type, which is why I decided to test static files.
>>
>>
>> For static content, the log shows errors like:
>>
>> Debug(cgi): nscgi: interp '(null)' exec '/usr/local/cgi-bin/test6.txt'
>> Error: exec /usr/local/cgi-bin/test4.txt: execve() failed: Unknown 
>> error 1275110264
>> Debug(cgi): nscgi: execute cgi script in directory 
>> '/usr/local/cgi-bin' returned pid -3
>> Error: waitpid(-3) failed: No child processes
>> Error: nscgi: wait for /usr/local/cgi-bin/test4.txt failed: No child 
>> processes
>>
>> ..when debug logging is invoked nscgi in section of config.tcl using:
>>
>> ns_logctl severity Debug(pl) on
>> ns_logctl severity Debug(cgi) on
>>
>>
>> cheers,
>> Ben
>>
> 
> 
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>