queue-developers

[Queue-developers] single-machine == NFS-shared ???

[Christian P. <cp...@el...>]

Hello !

I tried following simple test:

./configure --prefix=/prefix --datadir=/datadir --sysconfdir=/sysconfdir
--sharedstatedir=/sharedstatedir --localstatedir=/localstatedir

NO_ROOT cookiefile is "/datadir/queue/queuecookiefile"
Host access control file is "/datadir/queue/qhostsfile"
NFS-shared Queue spool directory is "/localstatedir/spool/queue"
Local queued process id file prefix is "/localstatedir/run/queued.pid"
Error mail goes to "cpa"

Must I understand why the NFS-shared Queue spool directory is
"/localstatedir/spool/queue"
and configure --help says:

  --sharedstatedir=DIR    modifiable architecture-independent data in
DIR
                          [PREFIX/com]
  --localstatedir=DIR     modifiable single-machine data in DIR
[PREFIX/var]

"single-machine" sounds not like "NFS-shared" to me.
I think there is still something wrong, allthough I couldn't find any 
docu about the intended directories for queued data-exchange dir,
where to put profile-file (shared or local). Achitecture
depenpendent-independent
files. 
Are you really working with the sourceforge-CVS repository ? 
There is only one update (the man-page) since releasing the beta.

Please tell me if you are not interested in my reportings. 


Best regards,

	Christian

Re: [Queue-developers] single-machine == NFS-shared ???

[Mike C. <da...@ix...>]

On Fri, May 11, 2001 at 12:23:44PM +0200, Christian Parg wrote:
> I think there is still something wrong, allthough I couldn't find any 
> docu about the intended directories for queued data-exchange dir,

Actually info -f queue has the following;

  1. Run `./configure' .

     When installing as an ordinary user, configure sets the makefile
     to install GNU Queue into the current directory. `queue' will go
     in `./bin', `queued' daemon will go into `./sbin', `/com/queue'
     will be the shared spool directory, the host access control list
     file will go into `./share' and the queued pid files will go into
     `./var' . If you want things to go somewhere else, run
     `./configure --prefix=dir', where dir is the top-level directory
     where you want things to be installed.

And:

   If you want to just experiment with Queue on a single host, all you
need is a local directory that is protected to be root-accessible only.
For load-balancing, however, you will need an NFS directory mounted on
all your hosts with 'no_root_squash' (see NFS man pages) option turned
on. Unfortunately, the 'no_root_squash' option is required for
load-balancing because the file system is used to communicate
information about jobs to be run. The default spool directory is under
the default GNU sharedstatedir, `/usr/local/com/queue'.

mrc
-- 
       Mike Castle       Life is like a clock:  You can work constantly
  da...@ix...  and be right all the time, or not work at all
www.netcom.com/~dalgoda/ and be right at least twice a day.  -- mrc
    We are all of us living in the shadow of Manhattan.  -- Watchmen

Re: [Queue-developers] single-machine == NFS-shared ???

[Werner G. K. <wer...@ya...>]

What I think is going on is that you have somehow gotten a hold of older
documentation.

Above 1.20, Queue no longer uses NFS. Instead, the spool directory is
supposed to be local on each machine.

We're certainly interested in your reportings, we're just a bit disorganized
in how CVS is updated when patches come in (or who updates it). We're all
volunteers, so it's to be expected.

Christian Parg wrote:

> Hello !
>
> I tried following simple test:
>
> ./configure --prefix=/prefix --datadir=/datadir --sysconfdir=/sysconfdir
> --sharedstatedir=/sharedstatedir --localstatedir=/localstatedir
>
> NO_ROOT cookiefile is "/datadir/queue/queuecookiefile"
> Host access control file is "/datadir/queue/qhostsfile"
> NFS-shared Queue spool directory is "/localstatedir/spool/queue"
> Local queued process id file prefix is "/localstatedir/run/queued.pid"
> Error mail goes to "cpa"
>
> Must I understand why the NFS-shared Queue spool directory is
> "/localstatedir/spool/queue"
> and configure --help says:
>
>   --sharedstatedir=DIR    modifiable architecture-independent data in
> DIR
>                           [PREFIX/com]
>   --localstatedir=DIR     modifiable single-machine data in DIR
> [PREFIX/var]
>
> "single-machine" sounds not like "NFS-shared" to me.
> I think there is still something wrong, allthough I couldn't find any
> docu about the intended directories for queued data-exchange dir,
> where to put profile-file (shared or local). Achitecture
> depenpendent-independent
> files.
> Are you really working with the sourceforge-CVS repository ?
> There is only one update (the man-page) since releasing the beta.
>
> Please tell me if you are not interested in my reportings.
>
> Best regards,
>
>         Christian
>
> _______________________________________________
> Queue-developers mailing list Que...@li...
> To unsubscribe, subscribe, or set options:
> http://lists.sourceforge.net/lists/listinfo/queue-developers

Re: [Queue-developers] single-machine == NFS-shared ???

[Mike C. <da...@ix...>]

On Fri, May 11, 2001 at 03:17:54PM -0400, Werner G. Krebs wrote:
> 
> What I think is going on is that you have somehow gotten a hold of older
> documentation.

From the beta:

nexus@thune[2:01pm]queue/queue-1.40.1beta/doc(509) ls -l *info*
-rw-------   1 nexus    users       18360 May 17  2000 gpl.texinfo
-rw-------   1 nexus    users       63454 May 17  2000 queue.info
-rw-------   1 nexus    users       41661 Dec 27 11:10 queue.texinfo


So, yes, there IS older documentation.  In the distribution.  A packaging
bug I suppose (though also the Makefile SHOULD update it).  Hmmm.... there
IS no makefile in the doc directory.

> Above 1.20, Queue no longer uses NFS. Instead, the spool directory is
> supposed to be local on each machine.

The (updated) documentation states just the opposite:

     When installing with the `--enable-root' option, configure sets
     the Makefile to install GNU Queue under the `/usr/local' prefix.
     `queue' will go in `/usr/local/bin', `queued' daemon will go into
     `/usr/local/sbin', `/usr/local/com/queue' will be the shared spool
     directory, the host access control list file will go into
     `/usr/local/share' and the queued pid files will go into
     `/usr/local/var' . If you want things to go somewhere else, run
     `./configure --enable-root --prefix=dir', where dir is the
     top-level directory where you want things to be installed.

And:

   Under `/usr/spool/queue' you may create several directories for
batch jobs, each identified with the class of the batch job (e.g.,
`sas' or `splus'). You may then place restrictions on that class, such
as maximum number of jobs running, or total CPU time, by placing a
`profile' file like this one in that directory.


And:

   Note that `/usr/local/com/queue' is our spool directory, and `now' is
the job batch directory for the special `now' queue (run via the `-i'
or immediate-mode flag to the queue executable), so these files may
reside in the job batch directories.

Oh... and a typo:

   However, the `now' queue is mandatory; it is the directory used by
the `-i' mode (immediate moe) of queue to launch jobs over the network
                         ^^^

The file profile is obviously intended to be read from a shared area,
based upon the existence of the "host" lines.  Would patches that allow one
to look in 

There is ONE comment in the documentation about NFS and it's in the
"Install by Ordinary User" section:

   As of GNU Queue 1.20.1, a TCP/IP protocol has replaced the older
NFS-based protocol used to communicate job information, so spool
directories should be unique to each machine and should not be shared.

However, a few lines down it says:

     When installing as an ordinary user, configure sets the makefile
     to install GNU Queue into the current directory. `queue' will go
     in `./bin', `queued' daemon will go into `./sbin', `/com/queue'
     will be the shared spool directory, the host access control list

From the man queue page:

       PREFIX/share/qhostsfile       Host Access Control List File
       PREFIX/com/queue              spool directory
       PREFIX/local/com/queue/now    spool directory for immediate execution
       PREFIX/com/queue/wait         spool directory for the '-q' shorthand
       SPOOLDIR/profile              control file for the SPOOLDIR job queue
       PREFIX/com/queue/now/profile  control file for immediate jobs
       PREFIX/var/queue_pid_hostname temporary file

Again, this indicates sharing the spool directory.

> We're certainly interested in your reportings, we're just a bit disorganized
> in how CVS is updated when patches come in (or who updates it). We're all
> volunteers, so it's to be expected.

However, one should get at least the documenation in order before
releasing.

I've been banging my head against the way since the 1.20.1 release trying
to get it to work.  And now I know that the reason I've been having
problems is because I've been using a shared NFS spool directory, just like
every bit of documenation that comes with the program says to do!

And even now, I'm not certain what I'm supposed to do!

If I create a profile, do I copy that profile to each machine on the
network?  Ugh!  That's ugly.  I again refer back to a previous comment of
mine that says soemthing like using files in
/usr/share/queue/profile/{now,wait,sas,whatever}.   That way profile can be
distributed once, and queued can make local files in /var/spool/queue that
isn't NFS shared.  In otherwords, NFS share the profiles, but not the
spool.

mrc
-- 
       Mike Castle       Life is like a clock:  You can work constantly
  da...@ix...  and be right all the time, or not work at all
www.netcom.com/~dalgoda/ and be right at least twice a day.  -- mrc
    We are all of us living in the shadow of Manhattan.  -- Watchmen