naviserver-devel — Developer discussion

Re: [naviserver-devel] keep-alive

[Stephen D. <sd...@gm...>]

On 7/6/06, Vlad Seryakov <vl...@cr...> wrote:
> Oops, i missed that, ns_conn keepalive 1 sets keepalive regardless of
> headers or methods, but does not disable it completely, if not set,
> normal rules apply


So if you do:

    ns_conn keepalive 0

It doesn't disable keepalive?  Does this make sense?



> Stephen Deasey wrote:
> > On 7/6/06, Vlad Seryakov <vl...@cr...> wrote:
> >> You may do
> >> ns_set update [ns_conn outputheaders] Connection close
> >>
> >>
> >> There is no parameter to disable it
> >
> >
> > Then what's ns_conn keepalive about?
> >
> >
> >> Bernd Eidenschink wrote:
> >>> Hi, how to turn off keep-alive on the server?
> >>>
> >>> Should "ns_conn keepalive 0" work?
> >>> (BTW my testserver shows internal server error when calling
> >>> ns_conn keepalive "" )
> >>>
> >>> Or is there a config option?
> >>>
> >>> Using Tomcat but need to do more? Need to support web services, security?
> >>> Get stuff done quickly with pre-integrated technology to make your job easier
> >>> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> >>> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> >>> _______________________________________________
> >>> naviserver-devel mailing list
> >>> nav...@li...
> >>> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> >>>
> >> --
> >> Vlad Seryakov
> >> 571 262-8608 office
> >> vl...@cr...
> >> http://www.crystalballinc.com/vlad/
> >>
> >>
> >> Using Tomcat but need to do more? Need to support web services, security?
> >> Get stuff done quickly with pre-integrated technology to make your job easier
> >> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> >> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> >> _______________________________________________
> >> naviserver-devel mailing list
> >> nav...@li...
> >> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> >>
> >
> > Using Tomcat but need to do more? Need to support web services, security?
> > Get stuff done quickly with pre-integrated technology to make your job easier
> > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> > _______________________________________________
> > naviserver-devel mailing list
> > nav...@li...
> > https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> >
>
> --
> Vlad Seryakov
> 571 262-8608 office
> vl...@cr...
> http://www.crystalballinc.com/vlad/
>
>
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>

Re: [naviserver-devel] keep-alive

[Vlad S. <vl...@cr...>]

Oops, i missed that, ns_conn keepalive 1 sets keepalive regardless of 
headers or methods, but does not disable it completely, if not set, 
normal rules apply

Stephen Deasey wrote:
> On 7/6/06, Vlad Seryakov <vl...@cr...> wrote:
>> You may do
>> ns_set update [ns_conn outputheaders] Connection close
>>
>>
>> There is no parameter to disable it
> 
> 
> Then what's ns_conn keepalive about?
> 
> 
>> Bernd Eidenschink wrote:
>>> Hi, how to turn off keep-alive on the server?
>>>
>>> Should "ns_conn keepalive 0" work?
>>> (BTW my testserver shows internal server error when calling
>>> ns_conn keepalive "" )
>>>
>>> Or is there a config option?
>>>
>>> Using Tomcat but need to do more? Need to support web services, security?
>>> Get stuff done quickly with pre-integrated technology to make your job easier
>>> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>>> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>>> _______________________________________________
>>> naviserver-devel mailing list
>>> nav...@li...
>>> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>>>
>> --
>> Vlad Seryakov
>> 571 262-8608 office
>> vl...@cr...
>> http://www.crystalballinc.com/vlad/
>>
>>
>> Using Tomcat but need to do more? Need to support web services, security?
>> Get stuff done quickly with pre-integrated technology to make your job easier
>> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>> _______________________________________________
>> naviserver-devel mailing list
>> nav...@li...
>> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>>
> 
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> 

-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

Re: [naviserver-devel] keep-alive

[Stephen D. <sd...@gm...>]

On 7/6/06, Vlad Seryakov <vl...@cr...> wrote:
> You may do
> ns_set update [ns_conn outputheaders] Connection close
>
>
> There is no parameter to disable it


Then what's ns_conn keepalive about?


> Bernd Eidenschink wrote:
> > Hi, how to turn off keep-alive on the server?
> >
> > Should "ns_conn keepalive 0" work?
> > (BTW my testserver shows internal server error when calling
> > ns_conn keepalive "" )
> >
> > Or is there a config option?
> >
> > Using Tomcat but need to do more? Need to support web services, security?
> > Get stuff done quickly with pre-integrated technology to make your job easier
> > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> > _______________________________________________
> > naviserver-devel mailing list
> > nav...@li...
> > https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> >
>
> --
> Vlad Seryakov
> 571 262-8608 office
> vl...@cr...
> http://www.crystalballinc.com/vlad/
>
>
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>

Re: [naviserver-devel] ns_db

[Stephen D. <sd...@gm...>]

Don't forget to update the tests.


On 7/3/06, Vlad Seryakov <vl...@cr...> wrote:
> In the CVS version that has been fixed
>
> oss2:nscp 1> ns_db lalala
> bad option "lalala": must be pools, bouncepool, gethandle, exception,
> poolname, password, user, datasource, disconnect, dbtype, driver,
> cancel, bindrow, flush, releasehandle, resethandle, connected, sp_exec,
> sp_getparams, sp_returncode, getrow, dml, 1row, 0or1row, exec, select,
> sp_start, interpretsqlfile, verbose, setexception, or sp_setparam
>
> oss2:nscp 2> ns_db open
> bad option "open": must be pools, bouncepool, gethandle, exception,
> poolname, password, user, datasource, disconnect, dbtype, driver,
> cancel, bindrow, flush, releasehandle, resethandle, connected, sp_exec,
> sp_getparams, sp_returncode, getrow, dml, 1row, 0or1row, exec, select,
> sp_start, interpretsqlfile, verbose, setexception, or sp_setparam
>
>
> Bernd Eidenschink wrote:
> > Hi,
> >
> > (1)
> > Currently "ns_db" seems to throw the "Unknown command 'xy': should be..."
> > error message only when given also a database handle.
> >
> > Example:
> > % ns_db lalala
> > wrong # args: should be "ns_db lalala dbId ?args?"
> >
> > % ns_db gethandle
> > nsdb0
> > % ns_db lalala nsdb0
> > ns_db:  Unknown command "lalala":  should be 0or1row, 1row ...
> >
> > Does this qualify as a bug? If so, I'll file a report.
> >
> > (2)
> > There is also the special handling of "open" and "close":
> > % ns_db open
> > unsupported ns_db command: open
> > % ns_db close
> > unsupported ns_db command: close
> >
> > Is this testing still needed?
> >
> > Bernd.
> >
> > Using Tomcat but need to do more? Need to support web services, security?
> > Get stuff done quickly with pre-integrated technology to make your job easier
> > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> > _______________________________________________
> > naviserver-devel mailing list
> > nav...@li...
> > https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> >
>
> --
> Vlad Seryakov
> 571 262-8608 office
> vl...@cr...
> http://www.crystalballinc.com/vlad/
>
>
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
>

Re: [naviserver-devel] cache.c does not compile

[Stephen D. <sd...@gm...>]

Your build envornment is messed up -- you're compiling against some
old headers or something.


On 7/4/06, Zoran Vasiljevic <zv...@ar...> wrote:
> Hi !
>
> Just checked in my new code for adding
> user callbacks to ns_log and found out
> that the new cache code does not compile :-(
> Anybody knows why? I'm too tired now to look
> into this. If somebody can take care, that
> will be fine.
>
> Cheers,
> Zoran
>
> gcc -pipe -g -Wall -Wno-implicit-int -fno-common  -I../include -I"/
> Users/zoran/sf/tcl/generic"  -DHAVE_CONFIG_H   -c -o cache.o cache.c
> cache.c: In function 'Ns_CacheDestroy':
> cache.c:160: error: invalid use of void expression
> cache.c: At top level:
> cache.c:298: error: conflicting types for 'Ns_CacheWaitCreateEntry'
> ../include/ns.h:630: error: previous declaration of
> 'Ns_CacheWaitCreateEntry' was here
> cache.c: In function 'Ns_CacheSetValueSz':
> cache.c:404: warning: passing argument 4 of 'Ns_CacheSetValueExpires'
> makes integer from pointer without a cast
> cache.c: At top level:
> cache.c:410: error: conflicting types for 'Ns_CacheSetValueExpires'
> ../include/ns.h:654: error: previous declaration of
> 'Ns_CacheSetValueExpires' was here
> cache.c: In function 'Ns_CacheFirstEntry':
> cache.c:566: error: 'struct Tcl_HashSearch' has no member named 'now'
> cache.c:567: error: 'struct Tcl_HashSearch' has no member named
> 'hsearch'
> cache.c:571: error: 'struct Tcl_HashSearch' has no member named 'now'
> cache.c:577: error: 'struct Tcl_HashSearch' has no member named
> 'hsearch'
> cache.c: In function 'Ns_CacheNextEntry':
> cache.c:606: error: 'struct Tcl_HashSearch' has no member named
> 'hsearch'
> cache.c:610: error: 'struct Tcl_HashSearch' has no member named 'now'
> cache.c:616: error: 'struct Tcl_HashSearch' has no member named
> 'hsearch'
> cache.c: At top level:
> cache.c:802: error: conflicting types for 'Ns_CacheStats'
> ../include/ns.h:710: error: previous declaration of 'Ns_CacheStats'
> was here
> make[1]: *** [cache.o] Error 1
> make: *** [all] Error 1

Re: [naviserver-devel] keep-alive

[Vlad S. <vl...@cr...>]

You may do
ns_set update [ns_conn outputheaders] Connection close


There is no parameter to disable it

Bernd Eidenschink wrote:
> Hi, how to turn off keep-alive on the server?
> 
> Should "ns_conn keepalive 0" work?
> (BTW my testserver shows internal server error when calling 
> ns_conn keepalive "" )
> 
> Or is there a config option?
> 
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> 

-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

[naviserver-devel] keep-alive

[Bernd E. <eid...@we...>]

Hi, how to turn off keep-alive on the server?

Should "ns_conn keepalive 0" work?
(BTW my testserver shows internal server error when calling 
ns_conn keepalive "" )

Or is there a config option?

[naviserver-devel] cache.c does not compile

[Zoran V. <zv...@ar...>]

Hi !

Just checked in my new code for adding
user callbacks to ns_log and found out
that the new cache code does not compile :-(
Anybody knows why? I'm too tired now to look
into this. If somebody can take care, that
will be fine.

Cheers,
Zoran

gcc -pipe -g -Wall -Wno-implicit-int -fno-common  -I../include -I"/ 
Users/zoran/sf/tcl/generic"  -DHAVE_CONFIG_H   -c -o cache.o cache.c
cache.c: In function 'Ns_CacheDestroy':
cache.c:160: error: invalid use of void expression
cache.c: At top level:
cache.c:298: error: conflicting types for 'Ns_CacheWaitCreateEntry'
../include/ns.h:630: error: previous declaration of  
'Ns_CacheWaitCreateEntry' was here
cache.c: In function 'Ns_CacheSetValueSz':
cache.c:404: warning: passing argument 4 of 'Ns_CacheSetValueExpires'  
makes integer from pointer without a cast
cache.c: At top level:
cache.c:410: error: conflicting types for 'Ns_CacheSetValueExpires'
../include/ns.h:654: error: previous declaration of  
'Ns_CacheSetValueExpires' was here
cache.c: In function 'Ns_CacheFirstEntry':
cache.c:566: error: 'struct Tcl_HashSearch' has no member named 'now'
cache.c:567: error: 'struct Tcl_HashSearch' has no member named  
'hsearch'
cache.c:571: error: 'struct Tcl_HashSearch' has no member named 'now'
cache.c:577: error: 'struct Tcl_HashSearch' has no member named  
'hsearch'
cache.c: In function 'Ns_CacheNextEntry':
cache.c:606: error: 'struct Tcl_HashSearch' has no member named  
'hsearch'
cache.c:610: error: 'struct Tcl_HashSearch' has no member named 'now'
cache.c:616: error: 'struct Tcl_HashSearch' has no member named  
'hsearch'
cache.c: At top level:
cache.c:802: error: conflicting types for 'Ns_CacheStats'
../include/ns.h:710: error: previous declaration of 'Ns_CacheStats'  
was here
make[1]: *** [cache.o] Error 1
make: *** [all] Error 1

Re: [naviserver-devel] ns_db

[Vlad S. <vl...@cr...>]

In the CVS version that has been fixed

oss2:nscp 1> ns_db lalala
bad option "lalala": must be pools, bouncepool, gethandle, exception, 
poolname, password, user, datasource, disconnect, dbtype, driver, 
cancel, bindrow, flush, releasehandle, resethandle, connected, sp_exec, 
sp_getparams, sp_returncode, getrow, dml, 1row, 0or1row, exec, select, 
sp_start, interpretsqlfile, verbose, setexception, or sp_setparam

oss2:nscp 2> ns_db open
bad option "open": must be pools, bouncepool, gethandle, exception, 
poolname, password, user, datasource, disconnect, dbtype, driver, 
cancel, bindrow, flush, releasehandle, resethandle, connected, sp_exec, 
sp_getparams, sp_returncode, getrow, dml, 1row, 0or1row, exec, select, 
sp_start, interpretsqlfile, verbose, setexception, or sp_setparam


Bernd Eidenschink wrote:
> Hi,
> 
> (1)
> Currently "ns_db" seems to throw the "Unknown command 'xy': should be..." 
> error message only when given also a database handle.
> 
> Example:
> % ns_db lalala
> wrong # args: should be "ns_db lalala dbId ?args?"
> 
> % ns_db gethandle
> nsdb0
> % ns_db lalala nsdb0
> ns_db:  Unknown command "lalala":  should be 0or1row, 1row ...
> 
> Does this qualify as a bug? If so, I'll file a report.
> 
> (2)
> There is also the special handling of "open" and "close":
> % ns_db open
> unsupported ns_db command: open
> % ns_db close
> unsupported ns_db command: close
> 
> Is this testing still needed?
> 
> Bernd.
> 
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> 

-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

[naviserver-devel] ns_db

[Bernd E. <eid...@we...>]

Hi,

(1)
Currently "ns_db" seems to throw the "Unknown command 'xy': should be..." 
error message only when given also a database handle.

Example:
% ns_db lalala
wrong # args: should be "ns_db lalala dbId ?args?"

% ns_db gethandle
nsdb0
% ns_db lalala nsdb0
ns_db:  Unknown command "lalala":  should be 0or1row, 1row ...

Does this qualify as a bug? If so, I'll file a report.

(2)
There is also the special handling of "open" and "close":
% ns_db open
unsupported ns_db command: open
% ns_db close
unsupported ns_db command: close

Is this testing still needed?

Bernd.

Re: [naviserver-devel] Cache comands (Was: [naviserver-commits] naviserver ChangeLog, 1.405, 1.406)

[Zoran V. <zv...@ar...>]

Am 01.07.2006 um 18:17 schrieb Gustaf Neumann:

> Zoran Vasiljevic schrieb:
>> For my *personal* taste, the API is way too large
>> but what I do not use, I do not care for.
>> I have nothing against having all this in core
>> and I have nothing against maintaining this
>> code in future, if the need arises.
>>
>>
> The ns_cache interface resembles much similarity to the nsv interface.
> Essentially, it looks to me
> as an outsider that the main difference to nsv are the options for  
> pool
> size and timeout. Has anyone
> considered to converge nsv and ns_cache by e.g. providing storage  
> pools
> with size and timeout
> to nsv (binding nsv varnames to storage pools)?  Also, the eval
> subcommand makes sense for
> nsv.

Absolutely! This is what I told Vlad in one of the previous emails.
The only *real* difference is the time/size pruning of ns_cache what
nsv's do not have.
I havent examined what would be needed for this thing. Also I wanted to
port thread::tsv interface from the Tcl threading extension to NS.
In that effort I could examine if this would be feasible or not.

What do other people think?

Cheers
Zoran

Re: [naviserver-devel] Cache comands (Was: [naviserver-commits] naviserver ChangeLog, 1.405, 1.406)

[Gustaf N. <ne...@wu...>]

Zoran Vasiljevic schrieb:
> For my *personal* taste, the API is way too large
> but what I do not use, I do not care for.
> I have nothing against having all this in core
> and I have nothing against maintaining this
> code in future, if the need arises.
>
>   
The ns_cache interface resembles much similarity to the nsv interface. 
Essentially, it looks to me
as an outsider that the main difference to nsv are the options for pool 
size and timeout. Has anyone
considered to converge nsv and ns_cache by e.g. providing storage pools 
with size and timeout
to nsv (binding nsv varnames to storage pools)?  Also, the eval 
subcommand makes sense for
nsv.

-gustaf

[naviserver-devel] Cache comands (Was: [naviserver-commits] naviserver ChangeLog, 1.405, 1.406)

[Zoran V. <zv...@ar...>]

Am 30.06.2006 um 21:35 schrieb Vlad Seryakov:

> right
>

Now that we (at least Vlad an myself) have this consensus:

   ns_cache_create
   ns_cache_names
   ns_cache_flush
   ns_cache_eval
   ns_cache_keys
   ns_cache_get
   ns_cache_set
   ns_cache_append
   ns_cache_lappend
   ns_cache_incr
   ns_cache_exists
   ns_cache_lock
   ns_cache_stats

and that ns_cache_create should be able to
create size and time-constrained caches, are
there any other things we need to have there?

For my *personal* taste, the API is way too large
but what I do not use, I do not care for.
I have nothing against having all this in core
and I have nothing against maintaining this
code in future, if the need arises.

Now, please comment...

Stephen, I think that limits as done in AS 4.5 will
not be sufficient for us. As we really do not have,
or better say, do not use the server as pure webserver.
Hence, we need the ability to set time contraints on
cache per-se and not as a part of some larget limits
infrastructure.

Cheers,
Zoran

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Vlad S. <vl...@cr...>]

right

Zoran Vasiljevic wrote:
> Am 30.06.2006 um 21:10 schrieb Vlad Seryakov:
> 
>> It is not necessary, we have ns_cache_eval to such things.
> 
> Well. I *know* that. But the explicite lock is *needed* if
> you plan to use exists/set etc... So either you must create
> and use external ns_mutex or you use ns_cache_lock. Or go and debug
> for ages because of the race condition possible if you do not
> use it.
> 
> Cheers
> Zoran
> 
> 
> 
> 
> 
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> 

-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Zoran V. <zv...@ar...>]

Am 30.06.2006 um 21:10 schrieb Vlad Seryakov:

> It is not necessary, we have ns_cache_eval to such things.

Well. I *know* that. But the explicite lock is *needed* if
you plan to use exists/set etc... So either you must create
and use external ns_mutex or you use ns_cache_lock. Or go and debug
for ages because of the race condition possible if you do not
use it.

Cheers
Zoran

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Vlad S. <vl...@cr...>]

> 
> Be it. I do not have anything against. Developers should be warned
> though that exists/get or exists/set or any combianation of those
> must be protected by external mutex to avoid race conditions.
> In that case, one should/would add something like:
> 
>    ns_cache_lock cachename {
>       do whatever with the cache
>    }

This is ns_cache_eval

> which needs to be a recursive lock, OR
> 
>    ns_cache_lock cachename
>    ns_cache_unlock cachename
> 
> in which case developer should exercise caution
> to make sure to unlock the cache at all costs even
> in case of Tcl error happening between lock/unlock calls.
> 
> So. This is what I must add to it.

It is not necessary, we have ns_cache_eval to such things.

_set will do it with locking, _get will return consistent value as well. 
The only place when it needs when somebody will do
if { ns_cache_exist cache key] } {
   ...
   ns_cache_....
   ...
}

But again, it could perfectly correct in his case if cache entry never 
got flushed, but system need to act on his appearance, so check for 
existence will notify caller that he may do some thing already, so i 
would let developer decide, but putting notes in the docs would be of 
course helpful for someone who just started learning programming with 
threads and locks.

-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Zoran V. <zv...@ar...>]

Am 30.06.2006 um 19:50 schrieb Vlad Seryakov:

> To mimic Tcl variables usage or any memory access operations, by  
> having
> _set, _get, _exist, _unset with additional _eval will make it complete
> and will allow to use by the developer as he sees fit. These are basic
> operations, on top of that a developer can build different systems,  
> not
> just one way. It is development tool, not complete system, we can  
> never
> anticipate all possible usages of cache API, so providing low-level
> primitives in my opinion is good direction.

Be it. I do not have anything against. Developers should be warned
though that exists/get or exists/set or any combianation of those
must be protected by external mutex to avoid race conditions.
In that case, one should/would add something like:

   ns_cache_lock cachename {
      do whatever with the cache
   }

which needs to be a recursive lock, OR

   ns_cache_lock cachename
   ns_cache_unlock cachename

in which case developer should exercise caution
to make sure to unlock the cache at all costs even
in case of Tcl error happening between lock/unlock calls.

So. This is what I must add to it.

Cheers,
Zoran

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Vlad S. <vl...@cr...>]

To mimic Tcl variables usage or any memory access operations, by having 
_set, _get, _exist, _unset with additional _eval will make it complete 
and will allow to use by the developer as he sees fit. These are basic 
operations, on top of that a developer can build different systems, not 
just one way. It is development tool, not complete system, we can never 
anticipate all possible usages of cache API, so providing low-level 
primitives in my opinion is good direction.

> 
> But, do not get me wrong. I'm not in favour of stripping functionality.
> As far as I', concerned, ns_cache API can consist of only three
> calls:
> 
>     ns_cache_create
>     ns_cache_eval
>     ns_cache_flush
> 
> More is not needed for the "usual" cache operation. Now, one
> can imagine adding some operations on the cache vaules directly
> like
> 
>     incr
>     llength
>     lindex
> 
> and atomic operations lile
> 
>     set
>     exists
>     get
> 
> which is all allright but in some "sense" diverts from the
> base idea of cache: just temporary store values resulting
> from hard caclulations.


Tcl variable fall into this category as well and has more operations and 
other tools to work with. Why limiting cache, in some sens it is shared 
variables by more than one thread with locking, expiration if set, and 
timeouts if set. what is wrong to treat cache as more powerfull tool.


-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Zoran V. <zv...@ar...>]

Am 30.06.2006 um 00:43 schrieb Vlad Seryakov:

> I am not going to argue, it is just old ns_cache used to have all
> functionality and was very popular and useful. Now we have more  
> limited
> ns_cache_XXX family and standalone ns_cache does not work anymore.
> I do not see who benefits from all this.

The point is to have simpler, better and more stable cache code.
Quality of the API does not necessarily relate to the size i.e.
number of calls. So, API with 10 calls is not more limited than
the API with 100 calls, if the 10 calls is all people "really"
need.

But, do not get me wrong. I'm not in favour of stripping functionality.
As far as I', concerned, ns_cache API can consist of only three
calls:

    ns_cache_create
    ns_cache_eval
    ns_cache_flush

More is not needed for the "usual" cache operation. Now, one
can imagine adding some operations on the cache vaules directly
like

    incr
    llength
    lindex

and atomic operations lile

    set
    exists
    get

which is all allright but in some "sense" diverts from the
base idea of cache: just temporary store values resulting
from hard caclulations.

Frankly speeaking, I do not have anything against expanding
this API to accomodate all that. If you look at the threading
extension, you will see the "thread::tsv" (thread shared variables)
which is nsv on steroids. So, I went there and added tons of additional
options and commands because nsv is designed for cross-therad storage
of values. You never go and purge nsv arrays on size and on time
i.e you never go and prune the nsv automatically. So the question is:
wny using nscache when nsv *may* be the more appropriate vehicle?
I'm not saying that it is in your particular usage case. I just say
that I *think* it would serve better. But you should know this better
because you write your own code.

I will going to backport the thread::tsv code from the Tcl
threading extension into the NS and this will bring you much more
power into nsv than ns_cache will ever have. It is just the question:
do you need AUTOMATIC purging (on time or size constraints) for the
values you keep now in ns_cache?

Please do not think that I'm blocking you from anything. I' m just
trying to understand the needs and provide optimal solution. If at the
end we see the need to expand ns_cache to handle all that nsv does
PLUS automatic entry expiry, then we'l do that. But then we'll know the
reason why and this will justify adding and maintaining more code.

So, relax. I'm the last person on the earth to block anybody ideas.
We'll sort all this out. But I just need *some* insights on how
this code is used in your application.  To make a good example,
I will try to write how I see that code from our's perspective i.e.
what we need and what not. This will be a part of a new message
under different subject.

Cheers
Zoran

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Bernd E. <eid...@we...>]

Am Freitag, 30. Juni 2006 00:43 schrieb Vlad Seryakov:
> I am not going to argue, it is just old ns_cache used to have all
> functionality and was very popular and useful. Now we have more limited
> ns_cache_XXX family and standalone ns_cache does not work anymore.
> I do not see who benefits from all this.

This is something that should not happen. It might have happend because
a) there is a desire to straighten and improve code and logic of the "legacy" 
where appropriate (good!)
b) there is a desire to include new functionality (good!)
c) there is the need to use existing applications with naviserver "as is" and 
incompatibilities are to avoid. This is also a signal to new naviserver users  
(good!)
and while a,b,c are desirable for themselves it's not always easy or possible 
to achieve everything at once.

We should solve the reliance on a working HEAD so nobody is forced to code in 
god mode.

Tagging could be used more often. So it is possible for everyone of us to tell 
others things like "I use naviserver-pre-5.0-1 (...) for 3 weeks now in 
production and everything works" - and of course rollback if there is need.

There could at a minimum be one branch that allows everyone to implement and 
try new functionality that may even break usage for n days. Of course 
everyone can develop locally but than this effort is invisible and/or it just 
leads to monster commits. There would be no need to discuss everything 
everytime as the main branch is not affected; a merge can then be discussed 
without haste: "I refactored the whole xyz part - give it a try". So the ball 
keeps rolling at full speed.

Bernd.

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Vlad S. <vl...@cr...>]

I am not going to argue, it is just old ns_cache used to have all 
functionality and was very popular and useful. Now we have more limited 
ns_cache_XXX family and standalone ns_cache does not work anymore.
I do not see who benefits from all this.

Zoran Vasiljevic wrote:
> Am 29.06.2006 um 22:44 schrieb Vlad Seryakov:
> 
>> So, i am being told all the time that i do not use the ns_cache in  
>> right
>> way, then somebody can define what is the correct and the only  
>> right way
>> of using ns_cache facility in the server environment? I could be  
>> lost or
>> un-educated enough but i would like to know?
>>
> 
> It is not the question of "right" or "wrong"! Lets not misunderstand
> each other.
> I can't tell you what is "right" or what's "wrong" but I can try to
> explain how I see the "usual" cache usage....
> 
> Noormally I'd use cache to save data which is rather expensive to
> calculate. In that case I will temporary save (hard calculated)
> data into some (size-limited) storage and read it from there.
> I also expect that this data will not change for some (rather short)
> period of time and for that time I will retain it in the cache.
> 
> A real-world examnple would be DNS lookup, or SQL selection
> or things lie that. In our code, I extensively use caches
> to store ID's of elements in a tree structure (similar to
> directory) which is emulated in 2 dimension table(s).
> It is rather expensive to get that info and since it does not
> change that often, I put those things in the cache.
> 
> I will however NOT use cache structures to maintain values used
> for commumincation or decision purposes. I would use nsv's or
> files or similar.
> 
> Having said that, I must stress that it is perfectly allright
> for me that anybody uses whatever tools he needs to get the job
> done. It is just that I see cache module usage in a certain patterns
> which may or may not correspond to the view of other people.
> 
> So what we are all about here is to understand what EXACTLY you
> are after and perhaps see if the cache as-is is the optimal solution
> for that, because our experience may be different from yours.
> But: if you say: guys, I know what I need, then I'm allright with that
> and will support you all the way.
> 
> Allright?
> 
> Cheers,
> Zoran
> 
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> naviserver-devel mailing list
> nav...@li...
> https://lists.sourceforge.net/lists/listinfo/naviserver-devel
> 

-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Zoran V. <zv...@ar...>]

Am 29.06.2006 um 22:44 schrieb Vlad Seryakov:

> So, i am being told all the time that i do not use the ns_cache in  
> right
> way, then somebody can define what is the correct and the only  
> right way
> of using ns_cache facility in the server environment? I could be  
> lost or
> un-educated enough but i would like to know?
>

It is not the question of "right" or "wrong"! Lets not misunderstand
each other.
I can't tell you what is "right" or what's "wrong" but I can try to
explain how I see the "usual" cache usage....

Noormally I'd use cache to save data which is rather expensive to
calculate. In that case I will temporary save (hard calculated)
data into some (size-limited) storage and read it from there.
I also expect that this data will not change for some (rather short)
period of time and for that time I will retain it in the cache.

A real-world examnple would be DNS lookup, or SQL selection
or things lie that. In our code, I extensively use caches
to store ID's of elements in a tree structure (similar to
directory) which is emulated in 2 dimension table(s).
It is rather expensive to get that info and since it does not
change that often, I put those things in the cache.

I will however NOT use cache structures to maintain values used
for commumincation or decision purposes. I would use nsv's or
files or similar.

Having said that, I must stress that it is perfectly allright
for me that anybody uses whatever tools he needs to get the job
done. It is just that I see cache module usage in a certain patterns
which may or may not correspond to the view of other people.

So what we are all about here is to understand what EXACTLY you
are after and perhaps see if the cache as-is is the optimal solution
for that, because our experience may be different from yours.
But: if you say: guys, I know what I need, then I'm allright with that
and will support you all the way.

Allright?

Cheers,
Zoran

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Vlad S. <vl...@cr...>]

> 
> I believe Stephen is trying to say that if you use cache module
> to save values between two tasks executed by two serialized
> thredas, this is kind of unusual "usage".

I always thought that shared memory usage is usual as long as i am using 
public API. Limiting API in functionality will lead to workarounds.

Can you image file access API with only open,close,read,write without 
stat call? I can open file, read it and find out the size of course but 
does is look right?

So, i am being told all the time that i do not use the ns_cache in right 
way, then somebody can define what is the correct and the only right way 
of using ns_cache facility in the server environment? I could be lost or 
un-educated enough but i would like to know?

-- 
Vlad Seryakov
571 262-8608 office
vl...@cr...
http://www.crystalballinc.com/vlad/

Re: [naviserver-devel] ns_cache is still broken

[Zoran V. <zv...@ar...>]

Am 27.06.2006 um 18:52 schrieb Stephen Deasey:

>
> OK.  Just checking.
>

According to our customer, the increase from 3 to 60 secs
did the trick. Now we get no timeouts any more. So, the fix
I did was OK and the default timeout should be increased
If somebody asks me.

But as Stephen says, the timeout is removed from the last
checkin which leads =FAs to: WHERE?

I believe we should slowly start defining what and how
we are going to handle this (cache) params so we can slowly
move on.

Cheers,
Zoran=

Re: [naviserver-devel] [naviserver-commits] naviserver ChangeLog, 1.405, 1.406

[Zoran V. <zv...@ar...>]

Am 29.06.2006 um 19:21 schrieb Vlad Seryakov:

>>
>> Communication between serialized threads doesn't sound like a  
>> cache to me.
>> Anyway, the idea is that if you need to do weird stuff it should be
>> possible, and an ns_cache_info equivalent can be writen in ~3  
>> lines of
>> Tcl.
>
> Very sad.
>
> I'd suggest we define what is weird and what is not first.

I believe Stephen is trying to say that if you use cache module
to save values between two tasks executed by two serialized
thredas, this is kind of unusual "usage".
I must admit that Stephen is right. But, OTOH, we should not
question anybody's usage that deep. If you or Stephen
say that any feature is needed I will simply trust you and
try to arrange myself accordingly. Of course, this is what I
expect from you in return. I will never ask for a feature I
did not think over and am absolutely sure (and can convince you)
that it is better we add it in the core.

Addind something in the code is easily done but we should NOT
forget that we will have to maintain it for years to come.
So, if something can really be done in a small Tcl wrapper
and IS not performance hog I would vote to do it in Tcl.
Otherwise I would be the last to stand in the way to do it
in the C as part of the common core.

Just my 0.2 cents

Zoran
(who tries to keep the ball rolling)