babeldoc-devel — Babeldoc developer list

Re: [Babeldoc-devel] A few more questions

[bruce <br...@mc...>]

Erik,

You will not need to do it to the actuall IConfigService implementors - I will 
do it as a static method on ConfigService.

On Thursday 27 March 2003 10:47 am, ek...@ba... wrote:
> <<
> Yes, you do have a point Dejan - this issue can also apply to the simple
> cases
> -  I will add this and implement it.
>
>
> Bruce, if you program this, please let me know if you plan on doing it
> to all classes that implement IConfigService or if I will need to
> implement it for SQLConfigService ... which I probably won't plan on
> doing for a few weeks from now.  Thanks.
>
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[bruce <br...@mc...>]

Actually 

Its even simpler than that.  The configuration information is actually cached 
at the ConfigService - I will add a static to that to nuke the caches.

On Thursday 27 March 2003 10:43 am, ek...@ba... wrote:
> <<
> Maybe it is better idea to have such method in IConfigService too. Why
> not
> have option to reload configuration from properties files too?
>
>
> Sounds like a reasonable request.  Initially, I will implement it in
> SQLConfigService to get my solution working and then I will look into
> the effort (which I imagine is quite small) to implement it in the other
> classes that implement IConfigService.
>
> ... unless someone objects ...
>
>
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[<ek...@ba...>]

<<
Yes, you do have a point Dejan - this issue can also apply to the simple
cases
-  I will add this and implement it.
>>

Bruce, if you program this, please let me know if you plan on doing it
to all classes that implement IConfigService or if I will need to
implement it for SQLConfigService ... which I probably won't plan on
doing for a few weeks from now.  Thanks.

Re: [Babeldoc-devel] A few more questions

[<ek...@ba...>]

<<
Maybe it is better idea to have such method in IConfigService too. Why
not
have option to reload configuration from properties files too?
>>

Sounds like a reasonable request.  Initially, I will implement it in
SQLConfigService to get my solution working and then I will look into
the effort (which I imagine is quite small) to implement it in the other
classes that implement IConfigService.

... unless someone objects ...

Re: [Babeldoc-devel] A few more questions

[bruce <br...@mc...>]

Yes, you do have a point Dejan - this issue can also apply to the simple cases  
-  I will add this and implement it.

On Thursday 27 March 2003 10:37 am, Dejan Krsmanovic wrote:
> > It is possible to add a method to the SqlConfigService that clears the
>
> caches.
>
> > This gets called from your UI.  Remember the SqlConfigService just
>
> implements
>
> > the IConfigService interface.  So you would just have to cast it and call
>
> the
>
> > method.
>
> Maybe it is better idea to have such method in IConfigService too. Why not
> have option to reload configuration from properties files too?
>
> Dejan
>
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[<ek...@ba...>]

Thanks.  I thought of the clearCache idea after sending the email, but
thanks to both of you for directing me as to where it should be
implemented.

Re: [Babeldoc-devel] A few more questions

[Dejan K. <dej...@nb...>]

> It is possible to add a method to the SqlConfigService that clears the
caches.
> This gets called from your UI.  Remember the SqlConfigService just
implements
> the IConfigService interface.  So you would just have to cast it and call
the
> method.

Maybe it is better idea to have such method in IConfigService too. Why not
have option to reload configuration from properties files too?

Dejan

Re: [Babeldoc-devel] A few more questions

[bruce <br...@mc...>]

Yes, this is easiest way to do things here.

On Thursday 27 March 2003 10:19 am, Dejan Krsmanovic wrote:
> I guess first problem could be easily solved by adding clearCache method.
> After config table updating, this method should be called to empty cache.
> Next time an component needs a config db should be queried and get all data
> again.
>
> Dejan
>
> ----- Original Message -----
> From: <ek...@ba...>
> To: "bruce" <br...@mc...>
> Cc: "Babeldoc Developers List" <bab...@li...>
> Sent: Thursday, March 27, 2003 4:14 PM
> Subject: Re: [Babeldoc-devel] A few more questions
>
> > Hmmmm ... interesting.  I was planning on building an administrator UI
> > that would be used to update the CONFIG table.  My hope (and my
> > manager's demand) was that new and modified pipelines could be added to
> > the system by an administrator while the system was running.  This means
> > that we will need to possibly modify a pipeline online while the system
> > is running without a restart.  Additionally, we will need to add new
> > pipelines without a system restart.
> >
> > It appears that there may be two problems with this.
> > 1. The system caches the database information and does not go back to
> > the DB each time it needs it (for efficiency I'm sure).  Any chance of
> > there being a "switch"/"configuration parameter" to turn this feature
> > off?
> >
> > 2. My DBA will demand that I not append two fields together into one
> > (config_nm).  Additionally, it will be simpler for my UI to have this
> > field (pipeline name/id) broken out.
> >
> > Am I proposing something here that is going to cause me a lot of grief
> > to implement?  Am I "stirring things up" here that I am going to regret
> > later?
> >
> > Erik
> >
> >
> >
> >
> >
> > bruce <br...@mc...>@lists.sourceforge.net on 03/27/2003
> > 10:01:53 AM
> >
> > Sent by:    bab...@li...
> >
> >
> > To:    "Babeldoc Developers List" <bab...@li...>
> > cc:
> > Subject:    Re: [Babeldoc-devel] A few more questions
> >
> > On Thursday 27 March 2003 09:55 am, ek...@ba... wrote:
> > > Thanks again for your help.  I have quickly reviewed your comments
> > > below.  I *may* need to make a modification to the CONFIG table to
> >
> > break
> >
> > > out the Pipeline Name from the Config Name field to pacify my DBA.
> > > Hopefully it won't be a lot of additional coding on my part.  Thanks
> > > again Bruce.
> >
> > No problem.   There is no real need for breaking this out - its not like
> > the
> > configuration table is going to be a high-volume operation - in fact its
> > read
> > only too.  Additionally this table is never re-read (well the same rows
> > are
> > never re-read) - the configuration information is cached.
> >
> > > Erik
> > >
> > > bruce <br...@mc...> on 03/27/2003 09:37:44 AM
> > >
> > > To:    ek...@ba..., bab...@li...
> > > cc:
> > > Subject:    Re: [Babeldoc-devel] A few more questions
> > >
> > >
> > > OK,
> > >
> > > Erik here are the answers to your questions.  There is a command that
> > > might
> > > interest you:  sqlload:
> > >
> > > build\bin\babeldoc sqlload
> > >
> > > This loads configuration files into a database.
> > >
> > > Here goes....
> > >
> > > On Wednesday 26 March 2003 11:13 am, ek...@ba... wrote:
> > > > ... though CERTAINLY not the end of my questions ... most of these
> > > > questions are based off of reading all the properties files inside
> >
> > of
> >
> > > > babeldoc_core.jar, as this is my "starting point" ... so bear with
> >
> > me.
> >
> > > > -- What is the "<pipeline>.type" if I want to get my configuration
> > > > information via JDBC (i.e. Not simple or xml, right?)
> > >
> > > Correct - The type here is how do you define the pipeline - in the
> >
> > case
> >
> > > where
> > > you want to store the pipeline configuration in the database, you will
> > > want
> > > to choose "simple".  This means that the PipelineStageFactory will go
> >
> > to
> >
> > > the
> > > configuration service to get the pipeline configuration.  Remember
> >
> > that
> >
> > > you
> > > will be providing a SQL configuration service so all is well here.
> > >
> > > > -- What is the function of "compile=yes|no" in
> > > > pipeline/compiler.properties?
> > >
> > > This is do caching of the pipelinestages and preloading.  It is
> >
> > possible
> >
> > > to
> > > take this a lot futher and use something like BCEL and actually at
> > > runtime
> > > "glue" all of the pipelinestages together that form a pipeline using
> > > ByteCodes.  This is not implemented.
> > >
> > > > -- If I want to use database journaling for Sybase, I realize that I
> > > > will need to create a new class (most likely named
> > > > com.babeldoc.sql.journal.SybaseJournal) and make an entry for it in
> > >
> > > the
> > >
> > > > journal/config.properties file, right?  Additionally, I will need to
> > > > create the file journal/sybase/config.properties.  My question is
> >
> > what
> >
> > > > properties do I use in this file and what are the valid values?  Is
> >
> > it
> >
> > > > just "resourceName=babel-journal"?
> > >
> > > Correct and correct.  You will (most likely) need to write a class
> > > SybaseJournal which extends GenericJournal (which does most of the
> > > work).
> > > Now, however you set that up, all the sql code in babeldoc does not
> > > manage
> > > the JDBC connections directly.  They use a resource metaphor - you
> >
> > will
> >
> > > need
> > > to get a named resource (babel-journal) and then check-in and
> >
> > check-out
> >
> > > connections for your use.
> > >
> > > Now, you *DON'T* need to create a file
> >
> > journal/sybase/config.properties
> >
> > > unless
> > > there are parameters that you need to store in that file that are
> > > specifically necessary to configure your SybaseJournal (which I
> > > seriously
> > > doubt).  The configuration file journal/sql/config.properties informs
> > > the
> > > GenericSqlJournal the name of the resource to use to connect to the
> > > journal
> > > database - you dont even need to override this setting.  What you *DO*
> > > need
> > > to override is the resource setting for babel-journal.  This is done
> >
> > in
> >
> > > resource/babel-journal configuration.  Take a look at the one in the
> >
> > sql
> >
> > > module.
> > >
> > > > -- It appears that pipeline/config.properties contains entries for
> > >
> > > each
> > >
> > > > pipeline that is available.  If I am using JDBC to store my pipeline
> > > > configuration information, do I still need this file?  Is there a
> >
> > way
> >
> > > to
> > >
> > > > represent this in the database?
> > >
> > > No, every property file in the config directory gets placed into the
> > > database.
> > >
> > > > -- I've noticed that the Primary Key for the CONFIG table is
> >
> > cfg_name,
> >
> > > > which I believe represents a single "line" in a pipeline's
> > > > configuration, right?  If that is so, how do we distinguish between
> > > > configuration "lines" for different pipelines?  Should pipeline_id
> >
> > (or
> >
> > > > something like this) also be part of the primary key for the CONFIG
> > > > table?
> > >
> > > No, the CONFIG table stores the file and line number information in a
> > > single
> > > column - take a look at the SqlConfigService code.  This simply pastes
> > > the
> > > config "file" and the property name together (separated by a period)
> >
> > and
> >
> > > places in the first column.  This makes life simple - no joins.
> > >
> > > > -- Do entries need to be made in service/query.properties for
> >
> > Journal
> >
> > > > and PipelineStageFactory in order to support JDBC?  It appears that
> > > > there are already entries in there for "simple" and "xml".
> > >
> > > No, see above
> > >
> > > > -- From the "Source" and "Binary" installations that I did from
> > > > Babeldoc, I do not see directories for "config" files except for
> > > > multiple instances in the "src" subdirectories under each major
> > > > component (such as "core", "sql", etc.).  In a production /
> >
> > deployment
> >
> > > > environment, what is the structure for the directory(ies) in which
> >
> > the
> >
> > > > config files go?
> > >
> > > Let me investigate this.
> > >
> > > > I'm sorry if some of these questions seem ignorant ... I'm trying
> >
> > very
> >
> > > > hard to get up-to-speed as quickly as possible as I have tight
> > >
> > > deadlines
> > >
> > > > to meet.
> > > >
> > > > Erik
> > > > The information in this e-mail, and any attachment therein, is
> > > > confidential and for use by the addressee only. If you are not the
> > > > intended recipient, please return the e-mail to the sender and
> >
> > delete
> >
> > > it
> > >
> > > > from your computer. Although The Bank of New York attempts to sweep
> > > > e-mail and attachments for viruses, it does not guarantee that
> >
> > either
> >
> > > > are virus-free and accepts no liability for any damage sustained as
> >
> > a
> >
> > > > result of viruses.
> > > >
> > > >
> > > >
> > > >
> > > > -------------------------------------------------------
> > > > This SF.net email is sponsored by:
> > > > The Definitive IT and Networking Event. Be There!
> > > > NetWorld+Interop Las Vegas 2003 -- Register today!
> > > > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > > > _______________________________________________
> > > > Babeldoc-devel mailing list
> > > > Bab...@li...
> > > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> >
> >
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[bruce <br...@mc...>]

Erik,

On Thursday 27 March 2003 10:14 am, ek...@ba... wrote:
> Hmmmm ... interesting.  I was planning on building an administrator UI
> that would be used to update the CONFIG table.  My hope (and my
> manager's demand) was that new and modified pipelines could be added to
> the system by an administrator while the system was running.  This means
> that we will need to possibly modify a pipeline online while the system
> is running without a restart.  Additionally, we will need to add new
> pipelines without a system restart.

It is possible to add a method to the SqlConfigService that clears the caches.  
This gets called from your UI.  Remember the SqlConfigService just implements 
the IConfigService interface.  So you would just have to cast it and call the 
method.

> It appears that there may be two problems with this.
> 1. The system caches the database information and does not go back to
> the DB each time it needs it (for efficiency I'm sure).  Any chance of
> there being a "switch"/"configuration parameter" to turn this feature
> off?

See the solution above. 

> 2. My DBA will demand that I not append two fields together into one
> (config_nm).  Additionally, it will be simpler for my UI to have this
> field (pipeline name/id) broken out.

Yeah - this is possible too, its just that you will have to implement this.  I 
really dont have an opinion on this either way.

> Am I proposing something here that is going to cause me a lot of grief
> to implement?  Am I "stirring things up" here that I am going to regret
> later?

No, its just that you will have to be the one to implement this.  Also how 
important is it that you do this right away - why dont you do the 
Proof-of-concept first, get comfortable with that and then circle back?


Bruce.

> Erik
>
>
>
>
>
> bruce <br...@mc...>@lists.sourceforge.net on 03/27/2003
> 10:01:53 AM
>
> Sent by:    bab...@li...
>
>
> To:    "Babeldoc Developers List" <bab...@li...>
> cc:
> Subject:    Re: [Babeldoc-devel] A few more questions
>
> On Thursday 27 March 2003 09:55 am, ek...@ba... wrote:
> > Thanks again for your help.  I have quickly reviewed your comments
> > below.  I *may* need to make a modification to the CONFIG table to
>
> break
>
> > out the Pipeline Name from the Config Name field to pacify my DBA.
> > Hopefully it won't be a lot of additional coding on my part.  Thanks
> > again Bruce.
>
> No problem.   There is no real need for breaking this out - its not like
> the
> configuration table is going to be a high-volume operation - in fact its
> read
> only too.  Additionally this table is never re-read (well the same rows
> are
> never re-read) - the configuration information is cached.
>
> > Erik
> >
> > bruce <br...@mc...> on 03/27/2003 09:37:44 AM
> >
> > To:    ek...@ba..., bab...@li...
> > cc:
> > Subject:    Re: [Babeldoc-devel] A few more questions
> >
> >
> > OK,
> >
> > Erik here are the answers to your questions.  There is a command that
> > might
> > interest you:  sqlload:
> >
> > build\bin\babeldoc sqlload
> >
> > This loads configuration files into a database.
> >
> > Here goes....
> >
> > On Wednesday 26 March 2003 11:13 am, ek...@ba... wrote:
> > > ... though CERTAINLY not the end of my questions ... most of these
> > > questions are based off of reading all the properties files inside
>
> of
>
> > > babeldoc_core.jar, as this is my "starting point" ... so bear with
>
> me.
>
> > > -- What is the "<pipeline>.type" if I want to get my configuration
> > > information via JDBC (i.e. Not simple or xml, right?)
> >
> > Correct - The type here is how do you define the pipeline - in the
>
> case
>
> > where
> > you want to store the pipeline configuration in the database, you will
> > want
> > to choose "simple".  This means that the PipelineStageFactory will go
>
> to
>
> > the
> > configuration service to get the pipeline configuration.  Remember
>
> that
>
> > you
> > will be providing a SQL configuration service so all is well here.
> >
> > > -- What is the function of "compile=yes|no" in
> > > pipeline/compiler.properties?
> >
> > This is do caching of the pipelinestages and preloading.  It is
>
> possible
>
> > to
> > take this a lot futher and use something like BCEL and actually at
> > runtime
> > "glue" all of the pipelinestages together that form a pipeline using
> > ByteCodes.  This is not implemented.
> >
> > > -- If I want to use database journaling for Sybase, I realize that I
> > > will need to create a new class (most likely named
> > > com.babeldoc.sql.journal.SybaseJournal) and make an entry for it in
> >
> > the
> >
> > > journal/config.properties file, right?  Additionally, I will need to
> > > create the file journal/sybase/config.properties.  My question is
>
> what
>
> > > properties do I use in this file and what are the valid values?  Is
>
> it
>
> > > just "resourceName=babel-journal"?
> >
> > Correct and correct.  You will (most likely) need to write a class
> > SybaseJournal which extends GenericJournal (which does most of the
> > work).
> > Now, however you set that up, all the sql code in babeldoc does not
> > manage
> > the JDBC connections directly.  They use a resource metaphor - you
>
> will
>
> > need
> > to get a named resource (babel-journal) and then check-in and
>
> check-out
>
> > connections for your use.
> >
> > Now, you *DON'T* need to create a file
>
> journal/sybase/config.properties
>
> > unless
> > there are parameters that you need to store in that file that are
> > specifically necessary to configure your SybaseJournal (which I
> > seriously
> > doubt).  The configuration file journal/sql/config.properties informs
> > the
> > GenericSqlJournal the name of the resource to use to connect to the
> > journal
> > database - you dont even need to override this setting.  What you *DO*
> > need
> > to override is the resource setting for babel-journal.  This is done
>
> in
>
> > resource/babel-journal configuration.  Take a look at the one in the
>
> sql
>
> > module.
> >
> > > -- It appears that pipeline/config.properties contains entries for
> >
> > each
> >
> > > pipeline that is available.  If I am using JDBC to store my pipeline
> > > configuration information, do I still need this file?  Is there a
>
> way
>
> > to
> >
> > > represent this in the database?
> >
> > No, every property file in the config directory gets placed into the
> > database.
> >
> > > -- I've noticed that the Primary Key for the CONFIG table is
>
> cfg_name,
>
> > > which I believe represents a single "line" in a pipeline's
> > > configuration, right?  If that is so, how do we distinguish between
> > > configuration "lines" for different pipelines?  Should pipeline_id
>
> (or
>
> > > something like this) also be part of the primary key for the CONFIG
> > > table?
> >
> > No, the CONFIG table stores the file and line number information in a
> > single
> > column - take a look at the SqlConfigService code.  This simply pastes
> > the
> > config "file" and the property name together (separated by a period)
>
> and
>
> > places in the first column.  This makes life simple - no joins.
> >
> > > -- Do entries need to be made in service/query.properties for
>
> Journal
>
> > > and PipelineStageFactory in order to support JDBC?  It appears that
> > > there are already entries in there for "simple" and "xml".
> >
> > No, see above
> >
> > > -- From the "Source" and "Binary" installations that I did from
> > > Babeldoc, I do not see directories for "config" files except for
> > > multiple instances in the "src" subdirectories under each major
> > > component (such as "core", "sql", etc.).  In a production /
>
> deployment
>
> > > environment, what is the structure for the directory(ies) in which
>
> the
>
> > > config files go?
> >
> > Let me investigate this.
> >
> > > I'm sorry if some of these questions seem ignorant ... I'm trying
>
> very
>
> > > hard to get up-to-speed as quickly as possible as I have tight
> >
> > deadlines
> >
> > > to meet.
> > >
> > > Erik
> > > The information in this e-mail, and any attachment therein, is
> > > confidential and for use by the addressee only. If you are not the
> > > intended recipient, please return the e-mail to the sender and
>
> delete
>
> > it
> >
> > > from your computer. Although The Bank of New York attempts to sweep
> > > e-mail and attachments for viruses, it does not guarantee that
>
> either
>
> > > are virus-free and accepts no liability for any damage sustained as
>
> a
>
> > > result of viruses.
> > >
> > >
> > >
> > >
> > > -------------------------------------------------------
> > > This SF.net email is sponsored by:
> > > The Definitive IT and Networking Event. Be There!
> > > NetWorld+Interop Las Vegas 2003 -- Register today!
> > > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > > _______________________________________________
> > > Babeldoc-devel mailing list
> > > Bab...@li...
> > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
>
>
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[Dejan K. <dej...@nb...>]

I guess first problem could be easily solved by adding clearCache method.
After config table updating, this method should be called to empty cache.
Next time an component needs a config db should be queried and get all data
again.

Dejan

----- Original Message -----
From: <ek...@ba...>
To: "bruce" <br...@mc...>
Cc: "Babeldoc Developers List" <bab...@li...>
Sent: Thursday, March 27, 2003 4:14 PM
Subject: Re: [Babeldoc-devel] A few more questions


>
> Hmmmm ... interesting.  I was planning on building an administrator UI
> that would be used to update the CONFIG table.  My hope (and my
> manager's demand) was that new and modified pipelines could be added to
> the system by an administrator while the system was running.  This means
> that we will need to possibly modify a pipeline online while the system
> is running without a restart.  Additionally, we will need to add new
> pipelines without a system restart.
>
> It appears that there may be two problems with this.
> 1. The system caches the database information and does not go back to
> the DB each time it needs it (for efficiency I'm sure).  Any chance of
> there being a "switch"/"configuration parameter" to turn this feature
> off?
>
> 2. My DBA will demand that I not append two fields together into one
> (config_nm).  Additionally, it will be simpler for my UI to have this
> field (pipeline name/id) broken out.
>
> Am I proposing something here that is going to cause me a lot of grief
> to implement?  Am I "stirring things up" here that I am going to regret
> later?
>
> Erik
>
>
>
>
>
> bruce <br...@mc...>@lists.sourceforge.net on 03/27/2003
> 10:01:53 AM
>
> Sent by:    bab...@li...
>
>
> To:    "Babeldoc Developers List" <bab...@li...>
> cc:
> Subject:    Re: [Babeldoc-devel] A few more questions
>
>
> On Thursday 27 March 2003 09:55 am, ek...@ba... wrote:
> > Thanks again for your help.  I have quickly reviewed your comments
> > below.  I *may* need to make a modification to the CONFIG table to
> break
> > out the Pipeline Name from the Config Name field to pacify my DBA.
> > Hopefully it won't be a lot of additional coding on my part.  Thanks
> > again Bruce.
>
> No problem.   There is no real need for breaking this out - its not like
> the
> configuration table is going to be a high-volume operation - in fact its
> read
> only too.  Additionally this table is never re-read (well the same rows
> are
> never re-read) - the configuration information is cached.
>
> > Erik
>
> > bruce <br...@mc...> on 03/27/2003 09:37:44 AM
> >
> > To:    ek...@ba..., bab...@li...
> > cc:
> > Subject:    Re: [Babeldoc-devel] A few more questions
> >
> >
> > OK,
> >
> > Erik here are the answers to your questions.  There is a command that
> > might
> > interest you:  sqlload:
> >
> > build\bin\babeldoc sqlload
> >
> > This loads configuration files into a database.
> >
> > Here goes....
> >
> > On Wednesday 26 March 2003 11:13 am, ek...@ba... wrote:
> > > ... though CERTAINLY not the end of my questions ... most of these
> > > questions are based off of reading all the properties files inside
> of
> > > babeldoc_core.jar, as this is my "starting point" ... so bear with
> me.
> > >
> > > -- What is the "<pipeline>.type" if I want to get my configuration
> > > information via JDBC (i.e. Not simple or xml, right?)
> >
> > Correct - The type here is how do you define the pipeline - in the
> case
> > where
> > you want to store the pipeline configuration in the database, you will
> > want
> > to choose "simple".  This means that the PipelineStageFactory will go
> to
> > the
> > configuration service to get the pipeline configuration.  Remember
> that
> > you
> > will be providing a SQL configuration service so all is well here.
> >
> > > -- What is the function of "compile=yes|no" in
> > > pipeline/compiler.properties?
> >
> > This is do caching of the pipelinestages and preloading.  It is
> possible
> > to
> > take this a lot futher and use something like BCEL and actually at
> > runtime
> > "glue" all of the pipelinestages together that form a pipeline using
> > ByteCodes.  This is not implemented.
> >
> > > -- If I want to use database journaling for Sybase, I realize that I
> > > will need to create a new class (most likely named
> > > com.babeldoc.sql.journal.SybaseJournal) and make an entry for it in
> >
> > the
> >
> > > journal/config.properties file, right?  Additionally, I will need to
> > > create the file journal/sybase/config.properties.  My question is
> what
> > > properties do I use in this file and what are the valid values?  Is
> it
> > > just "resourceName=babel-journal"?
> >
> > Correct and correct.  You will (most likely) need to write a class
> > SybaseJournal which extends GenericJournal (which does most of the
> > work).
> > Now, however you set that up, all the sql code in babeldoc does not
> > manage
> > the JDBC connections directly.  They use a resource metaphor - you
> will
> > need
> > to get a named resource (babel-journal) and then check-in and
> check-out
> > connections for your use.
> >
> > Now, you *DON'T* need to create a file
> journal/sybase/config.properties
> > unless
> > there are parameters that you need to store in that file that are
> > specifically necessary to configure your SybaseJournal (which I
> > seriously
> > doubt).  The configuration file journal/sql/config.properties informs
> > the
> > GenericSqlJournal the name of the resource to use to connect to the
> > journal
> > database - you dont even need to override this setting.  What you *DO*
> > need
> > to override is the resource setting for babel-journal.  This is done
> in
> > resource/babel-journal configuration.  Take a look at the one in the
> sql
> > module.
> >
> > > -- It appears that pipeline/config.properties contains entries for
> >
> > each
> >
> > > pipeline that is available.  If I am using JDBC to store my pipeline
> > > configuration information, do I still need this file?  Is there a
> way
> >
> > to
> >
> > > represent this in the database?
> >
> > No, every property file in the config directory gets placed into the
> > database.
> >
> > > -- I've noticed that the Primary Key for the CONFIG table is
> cfg_name,
> > > which I believe represents a single "line" in a pipeline's
> > > configuration, right?  If that is so, how do we distinguish between
> > > configuration "lines" for different pipelines?  Should pipeline_id
> (or
> > > something like this) also be part of the primary key for the CONFIG
> > > table?
> >
> > No, the CONFIG table stores the file and line number information in a
> > single
> > column - take a look at the SqlConfigService code.  This simply pastes
> > the
> > config "file" and the property name together (separated by a period)
> and
> > places in the first column.  This makes life simple - no joins.
> >
> > > -- Do entries need to be made in service/query.properties for
> Journal
> > > and PipelineStageFactory in order to support JDBC?  It appears that
> > > there are already entries in there for "simple" and "xml".
> >
> > No, see above
> >
> > > -- From the "Source" and "Binary" installations that I did from
> > > Babeldoc, I do not see directories for "config" files except for
> > > multiple instances in the "src" subdirectories under each major
> > > component (such as "core", "sql", etc.).  In a production /
> deployment
> > > environment, what is the structure for the directory(ies) in which
> the
> > > config files go?
> >
> > Let me investigate this.
> >
> > > I'm sorry if some of these questions seem ignorant ... I'm trying
> very
> > > hard to get up-to-speed as quickly as possible as I have tight
> >
> > deadlines
> >
> > > to meet.
> > >
> > > Erik
> > > The information in this e-mail, and any attachment therein, is
> > > confidential and for use by the addressee only. If you are not the
> > > intended recipient, please return the e-mail to the sender and
> delete
> >
> > it
> >
> > > from your computer. Although The Bank of New York attempts to sweep
> > > e-mail and attachments for viruses, it does not guarantee that
> either
> > > are virus-free and accepts no liability for any damage sustained as
> a
> > > result of viruses.
> > >
> > >
> > >
> > >
> > > -------------------------------------------------------
> > > This SF.net email is sponsored by:
> > > The Definitive IT and Networking Event. Be There!
> > > NetWorld+Interop Las Vegas 2003 -- Register today!
> > > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > > _______________________________________________
> > > Babeldoc-devel mailing list
> > > Bab...@li...
> > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
>
>
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[<ek...@ba...>]

Hmmmm ... interesting.  I was planning on building an administrator UI
that would be used to update the CONFIG table.  My hope (and my
manager's demand) was that new and modified pipelines could be added to
the system by an administrator while the system was running.  This means
that we will need to possibly modify a pipeline online while the system
is running without a restart.  Additionally, we will need to add new
pipelines without a system restart.

It appears that there may be two problems with this.
1. The system caches the database information and does not go back to
the DB each time it needs it (for efficiency I'm sure).  Any chance of
there being a "switch"/"configuration parameter" to turn this feature
off?

2. My DBA will demand that I not append two fields together into one
(config_nm).  Additionally, it will be simpler for my UI to have this
field (pipeline name/id) broken out.

Am I proposing something here that is going to cause me a lot of grief
to implement?  Am I "stirring things up" here that I am going to regret
later?

Erik





bruce <br...@mc...>@lists.sourceforge.net on 03/27/2003
10:01:53 AM

Sent by:    bab...@li...


To:    "Babeldoc Developers List" <bab...@li...>
cc:
Subject:    Re: [Babeldoc-devel] A few more questions


On Thursday 27 March 2003 09:55 am, ek...@ba... wrote:
> Thanks again for your help.  I have quickly reviewed your comments
> below.  I *may* need to make a modification to the CONFIG table to
break
> out the Pipeline Name from the Config Name field to pacify my DBA.
> Hopefully it won't be a lot of additional coding on my part.  Thanks
> again Bruce.

No problem.   There is no real need for breaking this out - its not like
the
configuration table is going to be a high-volume operation - in fact its
read
only too.  Additionally this table is never re-read (well the same rows
are
never re-read) - the configuration information is cached.

> Erik

> bruce <br...@mc...> on 03/27/2003 09:37:44 AM
>
> To:    ek...@ba..., bab...@li...
> cc:
> Subject:    Re: [Babeldoc-devel] A few more questions
>
>
> OK,
>
> Erik here are the answers to your questions.  There is a command that
> might
> interest you:  sqlload:
>
> build\bin\babeldoc sqlload
>
> This loads configuration files into a database.
>
> Here goes....
>
> On Wednesday 26 March 2003 11:13 am, ek...@ba... wrote:
> > ... though CERTAINLY not the end of my questions ... most of these
> > questions are based off of reading all the properties files inside
of
> > babeldoc_core.jar, as this is my "starting point" ... so bear with
me.
> >
> > -- What is the "<pipeline>.type" if I want to get my configuration
> > information via JDBC (i.e. Not simple or xml, right?)
>
> Correct - The type here is how do you define the pipeline - in the
case
> where
> you want to store the pipeline configuration in the database, you will
> want
> to choose "simple".  This means that the PipelineStageFactory will go
to
> the
> configuration service to get the pipeline configuration.  Remember
that
> you
> will be providing a SQL configuration service so all is well here.
>
> > -- What is the function of "compile=yes|no" in
> > pipeline/compiler.properties?
>
> This is do caching of the pipelinestages and preloading.  It is
possible
> to
> take this a lot futher and use something like BCEL and actually at
> runtime
> "glue" all of the pipelinestages together that form a pipeline using
> ByteCodes.  This is not implemented.
>
> > -- If I want to use database journaling for Sybase, I realize that I
> > will need to create a new class (most likely named
> > com.babeldoc.sql.journal.SybaseJournal) and make an entry for it in
>
> the
>
> > journal/config.properties file, right?  Additionally, I will need to
> > create the file journal/sybase/config.properties.  My question is
what
> > properties do I use in this file and what are the valid values?  Is
it
> > just "resourceName=babel-journal"?
>
> Correct and correct.  You will (most likely) need to write a class
> SybaseJournal which extends GenericJournal (which does most of the
> work).
> Now, however you set that up, all the sql code in babeldoc does not
> manage
> the JDBC connections directly.  They use a resource metaphor - you
will
> need
> to get a named resource (babel-journal) and then check-in and
check-out
> connections for your use.
>
> Now, you *DON'T* need to create a file
journal/sybase/config.properties
> unless
> there are parameters that you need to store in that file that are
> specifically necessary to configure your SybaseJournal (which I
> seriously
> doubt).  The configuration file journal/sql/config.properties informs
> the
> GenericSqlJournal the name of the resource to use to connect to the
> journal
> database - you dont even need to override this setting.  What you *DO*
> need
> to override is the resource setting for babel-journal.  This is done
in
> resource/babel-journal configuration.  Take a look at the one in the
sql
> module.
>
> > -- It appears that pipeline/config.properties contains entries for
>
> each
>
> > pipeline that is available.  If I am using JDBC to store my pipeline
> > configuration information, do I still need this file?  Is there a
way
>
> to
>
> > represent this in the database?
>
> No, every property file in the config directory gets placed into the
> database.
>
> > -- I've noticed that the Primary Key for the CONFIG table is
cfg_name,
> > which I believe represents a single "line" in a pipeline's
> > configuration, right?  If that is so, how do we distinguish between
> > configuration "lines" for different pipelines?  Should pipeline_id
(or
> > something like this) also be part of the primary key for the CONFIG
> > table?
>
> No, the CONFIG table stores the file and line number information in a
> single
> column - take a look at the SqlConfigService code.  This simply pastes
> the
> config "file" and the property name together (separated by a period)
and
> places in the first column.  This makes life simple - no joins.
>
> > -- Do entries need to be made in service/query.properties for
Journal
> > and PipelineStageFactory in order to support JDBC?  It appears that
> > there are already entries in there for "simple" and "xml".
>
> No, see above
>
> > -- From the "Source" and "Binary" installations that I did from
> > Babeldoc, I do not see directories for "config" files except for
> > multiple instances in the "src" subdirectories under each major
> > component (such as "core", "sql", etc.).  In a production /
deployment
> > environment, what is the structure for the directory(ies) in which
the
> > config files go?
>
> Let me investigate this.
>
> > I'm sorry if some of these questions seem ignorant ... I'm trying
very
> > hard to get up-to-speed as quickly as possible as I have tight
>
> deadlines
>
> > to meet.
> >
> > Erik
> > The information in this e-mail, and any attachment therein, is
> > confidential and for use by the addressee only. If you are not the
> > intended recipient, please return the e-mail to the sender and
delete
>
> it
>
> > from your computer. Although The Bank of New York attempts to sweep
> > e-mail and attachments for viruses, it does not guarantee that
either
> > are virus-free and accepts no liability for any damage sustained as
a
> > result of viruses.
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel


-------------------------------------------------------
This SF.net email is sponsored by:
The Definitive IT and Networking Event. Be There!
NetWorld+Interop Las Vegas 2003 -- Register today!
http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
_______________________________________________
Babeldoc-devel mailing list
Bab...@li...
https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[bruce <br...@mc...>]

On Thursday 27 March 2003 09:55 am, ek...@ba... wrote:
> Thanks again for your help.  I have quickly reviewed your comments
> below.  I *may* need to make a modification to the CONFIG table to break
> out the Pipeline Name from the Config Name field to pacify my DBA.
> Hopefully it won't be a lot of additional coding on my part.  Thanks
> again Bruce.

No problem.   There is no real need for breaking this out - its not like the 
configuration table is going to be a high-volume operation - in fact its read 
only too.  Additionally this table is never re-read (well the same rows are 
never re-read) - the configuration information is cached.

> Erik

> bruce <br...@mc...> on 03/27/2003 09:37:44 AM
>
> To:    ek...@ba..., bab...@li...
> cc:
> Subject:    Re: [Babeldoc-devel] A few more questions
>
>
> OK,
>
> Erik here are the answers to your questions.  There is a command that
> might
> interest you:  sqlload:
>
> build\bin\babeldoc sqlload
>
> This loads configuration files into a database.
>
> Here goes....
>
> On Wednesday 26 March 2003 11:13 am, ek...@ba... wrote:
> > ... though CERTAINLY not the end of my questions ... most of these
> > questions are based off of reading all the properties files inside of
> > babeldoc_core.jar, as this is my "starting point" ... so bear with me.
> >
> > -- What is the "<pipeline>.type" if I want to get my configuration
> > information via JDBC (i.e. Not simple or xml, right?)
>
> Correct - The type here is how do you define the pipeline - in the case
> where
> you want to store the pipeline configuration in the database, you will
> want
> to choose "simple".  This means that the PipelineStageFactory will go to
> the
> configuration service to get the pipeline configuration.  Remember that
> you
> will be providing a SQL configuration service so all is well here.
>
> > -- What is the function of "compile=yes|no" in
> > pipeline/compiler.properties?
>
> This is do caching of the pipelinestages and preloading.  It is possible
> to
> take this a lot futher and use something like BCEL and actually at
> runtime
> "glue" all of the pipelinestages together that form a pipeline using
> ByteCodes.  This is not implemented.
>
> > -- If I want to use database journaling for Sybase, I realize that I
> > will need to create a new class (most likely named
> > com.babeldoc.sql.journal.SybaseJournal) and make an entry for it in
>
> the
>
> > journal/config.properties file, right?  Additionally, I will need to
> > create the file journal/sybase/config.properties.  My question is what
> > properties do I use in this file and what are the valid values?  Is it
> > just "resourceName=babel-journal"?
>
> Correct and correct.  You will (most likely) need to write a class
> SybaseJournal which extends GenericJournal (which does most of the
> work).
> Now, however you set that up, all the sql code in babeldoc does not
> manage
> the JDBC connections directly.  They use a resource metaphor - you will
> need
> to get a named resource (babel-journal) and then check-in and check-out
> connections for your use.
>
> Now, you *DON'T* need to create a file journal/sybase/config.properties
> unless
> there are parameters that you need to store in that file that are
> specifically necessary to configure your SybaseJournal (which I
> seriously
> doubt).  The configuration file journal/sql/config.properties informs
> the
> GenericSqlJournal the name of the resource to use to connect to the
> journal
> database - you dont even need to override this setting.  What you *DO*
> need
> to override is the resource setting for babel-journal.  This is done in
> resource/babel-journal configuration.  Take a look at the one in the sql
> module.
>
> > -- It appears that pipeline/config.properties contains entries for
>
> each
>
> > pipeline that is available.  If I am using JDBC to store my pipeline
> > configuration information, do I still need this file?  Is there a way
>
> to
>
> > represent this in the database?
>
> No, every property file in the config directory gets placed into the
> database.
>
> > -- I've noticed that the Primary Key for the CONFIG table is cfg_name,
> > which I believe represents a single "line" in a pipeline's
> > configuration, right?  If that is so, how do we distinguish between
> > configuration "lines" for different pipelines?  Should pipeline_id (or
> > something like this) also be part of the primary key for the CONFIG
> > table?
>
> No, the CONFIG table stores the file and line number information in a
> single
> column - take a look at the SqlConfigService code.  This simply pastes
> the
> config "file" and the property name together (separated by a period) and
> places in the first column.  This makes life simple - no joins.
>
> > -- Do entries need to be made in service/query.properties for Journal
> > and PipelineStageFactory in order to support JDBC?  It appears that
> > there are already entries in there for "simple" and "xml".
>
> No, see above
>
> > -- From the "Source" and "Binary" installations that I did from
> > Babeldoc, I do not see directories for "config" files except for
> > multiple instances in the "src" subdirectories under each major
> > component (such as "core", "sql", etc.).  In a production / deployment
> > environment, what is the structure for the directory(ies) in which the
> > config files go?
>
> Let me investigate this.
>
> > I'm sorry if some of these questions seem ignorant ... I'm trying very
> > hard to get up-to-speed as quickly as possible as I have tight
>
> deadlines
>
> > to meet.
> >
> > Erik
> > The information in this e-mail, and any attachment therein, is
> > confidential and for use by the addressee only. If you are not the
> > intended recipient, please return the e-mail to the sender and delete
>
> it
>
> > from your computer. Although The Bank of New York attempts to sweep
> > e-mail and attachments for viruses, it does not guarantee that either
> > are virus-free and accepts no liability for any damage sustained as a
> > result of viruses.
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] A few more questions

[bruce <br...@mc...>]

OK,  

Erik here are the answers to your questions.  There is a command that might 
interest you:  sqlload:

build\bin\babeldoc sqlload

This loads configuration files into a database.

Here goes....

On Wednesday 26 March 2003 11:13 am, ek...@ba... wrote:
> ... though CERTAINLY not the end of my questions ... most of these
> questions are based off of reading all the properties files inside of
> babeldoc_core.jar, as this is my "starting point" ... so bear with me.
>
> -- What is the "<pipeline>.type" if I want to get my configuration
> information via JDBC (i.e. Not simple or xml, right?)

Correct - The type here is how do you define the pipeline - in the case where 
you want to store the pipeline configuration in the database, you will want 
to choose "simple".  This means that the PipelineStageFactory will go to the 
configuration service to get the pipeline configuration.  Remember that you 
will be providing a SQL configuration service so all is well here.

> -- What is the function of "compile=yes|no" in
> pipeline/compiler.properties?

This is do caching of the pipelinestages and preloading.  It is possible to 
take this a lot futher and use something like BCEL and actually at runtime 
"glue" all of the pipelinestages together that form a pipeline using 
ByteCodes.  This is not implemented.

> -- If I want to use database journaling for Sybase, I realize that I
> will need to create a new class (most likely named
> com.babeldoc.sql.journal.SybaseJournal) and make an entry for it in the
> journal/config.properties file, right?  Additionally, I will need to
> create the file journal/sybase/config.properties.  My question is what
> properties do I use in this file and what are the valid values?  Is it
> just "resourceName=babel-journal"?

Correct and correct.  You will (most likely) need to write a class 
SybaseJournal which extends GenericJournal (which does most of the work).  
Now, however you set that up, all the sql code in babeldoc does not manage 
the JDBC connections directly.  They use a resource metaphor - you will need 
to get a named resource (babel-journal) and then check-in and check-out 
connections for your use.

Now, you *DON'T* need to create a file journal/sybase/config.properties unless 
there are parameters that you need to store in that file that are 
specifically necessary to configure your SybaseJournal (which I seriously 
doubt).  The configuration file journal/sql/config.properties informs the 
GenericSqlJournal the name of the resource to use to connect to the journal 
database - you dont even need to override this setting.  What you *DO* need 
to override is the resource setting for babel-journal.  This is done in 
resource/babel-journal configuration.  Take a look at the one in the sql 
module.

> -- It appears that pipeline/config.properties contains entries for each
> pipeline that is available.  If I am using JDBC to store my pipeline
> configuration information, do I still need this file?  Is there a way to
> represent this in the database?

No, every property file in the config directory gets placed into the database.  

> -- I've noticed that the Primary Key for the CONFIG table is cfg_name,
> which I believe represents a single "line" in a pipeline's
> configuration, right?  If that is so, how do we distinguish between
> configuration "lines" for different pipelines?  Should pipeline_id (or
> something like this) also be part of the primary key for the CONFIG
> table?

No, the CONFIG table stores the file and line number information in a single 
column - take a look at the SqlConfigService code.  This simply pastes the 
config "file" and the property name together (separated by a period) and 
places in the first column.  This makes life simple - no joins.

> -- Do entries need to be made in service/query.properties for Journal
> and PipelineStageFactory in order to support JDBC?  It appears that
> there are already entries in there for "simple" and "xml".

No, see above

> -- From the "Source" and "Binary" installations that I did from
> Babeldoc, I do not see directories for "config" files except for
> multiple instances in the "src" subdirectories under each major
> component (such as "core", "sql", etc.).  In a production / deployment
> environment, what is the structure for the directory(ies) in which the
> config files go?

Let me investigate this.

> I'm sorry if some of these questions seem ignorant ... I'm trying very
> hard to get up-to-speed as quickly as possible as I have tight deadlines
> to meet.
>
> Erik
> The information in this e-mail, and any attachment therein, is
> confidential and for use by the addressee only. If you are not the
> intended recipient, please return the e-mail to the sender and delete it
> from your computer. Although The Bank of New York attempts to sweep
> e-mail and attachments for viruses, it does not guarantee that either
> are virus-free and accepts no liability for any damage sustained as a
> result of viruses.
>
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

[Babeldoc-devel] Re: Something wrong with Mailing List on Sourceforge?

[bruce <br...@mc...>]

What do you mean?

On Wednesday 26 March 2003 12:41 pm, ek...@ba... wrote:
> Where did our mailing list go?

Re: [Babeldoc-devel] Database Tables

[bruce <br...@mc...>]

Dejan,

This sounds just like what we need.   Let me look into it...

regards,
Bruce.
On Wednesday 26 March 2003 11:34 am, Dejan Krsmanovic wrote:
> Bruce, in future Babeldoc versions we should really think about using
> Jakarta Commons VFS project. This component enables accessing data from
> various sources. Currently local files, ftp files, WebDav, zip files and
> some others are supported. They plan to include JDBC "file system" as well.
> When you have a time check that project out. I think it could be valuable
> in future...
>
> Dejan
>
> ----- Original Message -----
> From: "bruce" <br...@mc...>
> To: "Babeldoc Developers List" <bab...@li...>
> Sent: Wednesday, March 26, 2003 3:18 PM
> Subject: Re: [Babeldoc-devel] Database Tables
>
> > On Wednesday 26 March 2003 08:23 am, ek...@ba... wrote:
> > > Well, I need both.  I need to store configuration information in the
> > > database and I would like to store XSLT scripts (and everything else)
> > > in the database also.
> >
> > The storing of the actual data in the database is the problem.  The
> > XslTransform pipeline stage expects to be given a filename or URL of a
>
> data
>
> > source which will contain the XSL data.  Now, if that is not to your
>
> liking,
>
> > then it will probably be necessary to implement either a general solution
>
> to
>
> > this (probably using a URL scheme) or a specific re-implementation of the
> > pipeline stages to load from a database.
> >
> > > Good question though ... is the SQLConfig fully implemented / tested?
> >
> > It was working fine - about six months ago - you will have to do a little
> > prototyping.  I certainly can help you with problems you may find.
> >
> > regards,
> > Bruce.
> >
> > > -------------------------------------------------------
> > > This SF.net email is sponsored by:
> > > The Definitive IT and Networking Event. Be There!
> > > NetWorld+Interop Las Vegas 2003 -- Register today!
> > > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > > _______________________________________________
> > > Babeldoc-devel mailing list
> > > Bab...@li...
> > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] Database Tables

[Dejan K. <dej...@nb...>]

Bruce, in future Babeldoc versions we should really think about using
Jakarta Commons VFS project. This component enables accessing data from
various sources. Currently local files, ftp files, WebDav, zip files and
some others are supported. They plan to include JDBC "file system" as well.
When you have a time check that project out. I think it could be valuable in
future...

Dejan

----- Original Message -----
From: "bruce" <br...@mc...>
To: "Babeldoc Developers List" <bab...@li...>
Sent: Wednesday, March 26, 2003 3:18 PM
Subject: Re: [Babeldoc-devel] Database Tables


> On Wednesday 26 March 2003 08:23 am, ek...@ba... wrote:
> > Well, I need both.  I need to store configuration information in the
> > database and I would like to store XSLT scripts (and everything else) in
> > the database also.
>
> The storing of the actual data in the database is the problem.  The
> XslTransform pipeline stage expects to be given a filename or URL of a
data
> source which will contain the XSL data.  Now, if that is not to your
liking,
> then it will probably be necessary to implement either a general solution
to
> this (probably using a URL scheme) or a specific re-implementation of the
> pipeline stages to load from a database.
>
> > Good question though ... is the SQLConfig fully implemented / tested?
>
> It was working fine - about six months ago - you will have to do a little
> prototyping.  I certainly can help you with problems you may find.
>
> regards,
> Bruce.
>
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

[Babeldoc-devel] A few more questions

[<ek...@ba...>]

... though CERTAINLY not the end of my questions ... most of these
questions are based off of reading all the properties files inside of
babeldoc_core.jar, as this is my "starting point" ... so bear with me.

-- What is the "<pipeline>.type" if I want to get my configuration
information via JDBC (i.e. Not simple or xml, right?)

-- What is the function of "compile=yes|no" in
pipeline/compiler.properties?

-- If I want to use database journaling for Sybase, I realize that I
will need to create a new class (most likely named
com.babeldoc.sql.journal.SybaseJournal) and make an entry for it in the
journal/config.properties file, right?  Additionally, I will need to
create the file journal/sybase/config.properties.  My question is what
properties do I use in this file and what are the valid values?  Is it
just "resourceName=babel-journal"?

-- It appears that pipeline/config.properties contains entries for each
pipeline that is available.  If I am using JDBC to store my pipeline
configuration information, do I still need this file?  Is there a way to
represent this in the database?

-- I've noticed that the Primary Key for the CONFIG table is cfg_name,
which I believe represents a single "line" in a pipeline's
configuration, right?  If that is so, how do we distinguish between
configuration "lines" for different pipelines?  Should pipeline_id (or
something like this) also be part of the primary key for the CONFIG
table?

-- Do entries need to be made in service/query.properties for Journal
and PipelineStageFactory in order to support JDBC?  It appears that
there are already entries in there for "simple" and "xml".

-- From the "Source" and "Binary" installations that I did from
Babeldoc, I do not see directories for "config" files except for
multiple instances in the "src" subdirectories under each major
component (such as "core", "sql", etc.).  In a production / deployment
environment, what is the structure for the directory(ies) in which the
config files go?

I'm sorry if some of these questions seem ignorant ... I'm trying very
hard to get up-to-speed as quickly as possible as I have tight deadlines
to meet.

Erik
The information in this e-mail, and any attachment therein, is
confidential and for use by the addressee only. If you are not the
intended recipient, please return the e-mail to the sender and delete it
from your computer. Although The Bank of New York attempts to sweep
e-mail and attachments for viruses, it does not guarantee that either
are virus-free and accepts no liability for any damage sustained as a
result of viruses.

Re: [Babeldoc-devel] Database Tables

[bruce <br...@mc...>]

On Wednesday 26 March 2003 08:23 am, ek...@ba... wrote:
> Well, I need both.  I need to store configuration information in the
> database and I would like to store XSLT scripts (and everything else) in
> the database also.

The storing of the actual data in the database is the problem.  The 
XslTransform pipeline stage expects to be given a filename or URL of a data 
source which will contain the XSL data.  Now, if that is not to your liking, 
then it will probably be necessary to implement either a general solution to 
this (probably using a URL scheme) or a specific re-implementation of the 
pipeline stages to load from a database.

> Good question though ... is the SQLConfig fully implemented / tested?

It was working fine - about six months ago - you will have to do a little 
prototyping.  I certainly can help you with problems you may find.

regards,
Bruce.

>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] Database Tables

[<ek...@ba...>]

Well, I need both.  I need to store configuration information in the
database and I would like to store XSLT scripts (and everything else) in
the database also.

Good question though ... is the SQLConfig fully implemented / tested?

Re: [Babeldoc-devel] Database Tables

[Dejan K. <dej...@nb...>]

Hmmm I didn't get the impression that he needs to load XSLT from DB...
Anyway is it possible to store config data in database? Is SqlConfig full
implemented?

Dejan
----- Original Message -----
From: "bruce" <br...@mc...>
To: "Dejan Krsmanovic" <dej...@nb...>; "Babeldoc
Developers List" <bab...@li...>
Sent: Wednesday, March 26, 2003 8:52 AM
Subject: Re: [Babeldoc-devel] Database Tables


> Dejan,
>
> Yes,  But you see that he actually needs to load the XSLT file from the
> database.  Even with the SqlCOnfig stuff, it points him to a file, which
is
> then loaded...
>
> This is an interesting thing...
>
> Bruce.
>
>
> On Wednesday 26 March 2003 02:34 am, Dejan Krsmanovic wrote:
> > I think what eklein asking for is storing configuration data into
database
> > tables. If this is the case maybe SqlConfig is what he asks for. Sql
module
> > contains  classes that deals with configuration data stored into
database.
> > Look under com.babeldoc.sql.config package. I have never used these
classes
> > so I really don't know are they work or not. Anyway, Bruce wrote that
part
> > so you can aks him.
> > If this is not what you have been asking for then sorry for flaming!
> >
> > Dejan
> >
> >
> > ----- Original Message -----
> > From: "bruce" <br...@mc...>
> > To: <ek...@ba...>; <bab...@li...>
> > Sent: Tuesday, March 25, 2003 9:34 PM
> > Subject: Re: [Babeldoc-devel] Database Tables
> >
> > > Unfortunately not - I am sorry if I gave you this impression.   The
xslt
> >
> > file
> >
> > > must be either a file on disk or (and here is possibly your salvation)
in
> >
> > a
> >
> > > jar file.
> > >
> > > On Tuesday 25 March 2003 03:28 pm, ek...@ba... wrote:
> > > > Sorry to run-on so long here, but lastly, I was expecting to find
some
> > > > tables that contained PipeLine and PipeLine_Stage information.  It
was
> > > > my hope that PipeLine information (as well as other attributes that
I
> > > > see in .properties or .xml files in the documentation) could be
stored
> > > > in the database.
> > > >
> > > > For instance, the following comes from xslt-velocity.properties in
the
> > > > examples directory:
> > > >
> > > > entryStage = transform
> > > >
> > > > transform.stageType=XslTransform
> > > > transform.nextStage=writer
> > > > transform.transformationFile=data/transform-velocity.xsl
> > > >
> > > > writer.stageType=FileWriter
> > > > writer.nextStage=null
> > > > writer.outputFile=${system.getProperty("user.dir")}/velocity.xml
> > > >
> > > >
> > > > Am I incorrect in assuming that this information could be stored in
the
> > > > database instead, perhaps in a row that contains a description of
> > > > "xslt-velocity"??
> > > >
> > > >
> > > >
> > > >
> > > > -------------------------------------------------------
> > > > This SF.net email is sponsored by:
> > > > The Definitive IT and Networking Event. Be There!
> > > > NetWorld+Interop Las Vegas 2003 -- Register today!
> > > > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > > > _______________________________________________
> > > > Babeldoc-devel mailing list
> > > > Bab...@li...
> > > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> > >
> > > -------------------------------------------------------
> > > This SF.net email is sponsored by:
> > > The Definitive IT and Networking Event. Be There!
> > > NetWorld+Interop Las Vegas 2003 -- Register today!
> > > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > > _______________________________________________
> > > Babeldoc-devel mailing list
> > > Bab...@li...
> > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] Database Tables

[bruce <br...@mc...>]

Dejan,

Yes,  But you see that he actually needs to load the XSLT file from the 
database.  Even with the SqlCOnfig stuff, it points him to a file, which is 
then loaded...

This is an interesting thing...

Bruce.


On Wednesday 26 March 2003 02:34 am, Dejan Krsmanovic wrote:
> I think what eklein asking for is storing configuration data into database
> tables. If this is the case maybe SqlConfig is what he asks for. Sql module
> contains  classes that deals with configuration data stored into database.
> Look under com.babeldoc.sql.config package. I have never used these classes
> so I really don't know are they work or not. Anyway, Bruce wrote that part
> so you can aks him.
> If this is not what you have been asking for then sorry for flaming!
>
> Dejan
>
>
> ----- Original Message -----
> From: "bruce" <br...@mc...>
> To: <ek...@ba...>; <bab...@li...>
> Sent: Tuesday, March 25, 2003 9:34 PM
> Subject: Re: [Babeldoc-devel] Database Tables
>
> > Unfortunately not - I am sorry if I gave you this impression.   The xslt
>
> file
>
> > must be either a file on disk or (and here is possibly your salvation) in
>
> a
>
> > jar file.
> >
> > On Tuesday 25 March 2003 03:28 pm, ek...@ba... wrote:
> > > Sorry to run-on so long here, but lastly, I was expecting to find some
> > > tables that contained PipeLine and PipeLine_Stage information.  It was
> > > my hope that PipeLine information (as well as other attributes that I
> > > see in .properties or .xml files in the documentation) could be stored
> > > in the database.
> > >
> > > For instance, the following comes from xslt-velocity.properties in the
> > > examples directory:
> > >
> > > entryStage = transform
> > >
> > > transform.stageType=XslTransform
> > > transform.nextStage=writer
> > > transform.transformationFile=data/transform-velocity.xsl
> > >
> > > writer.stageType=FileWriter
> > > writer.nextStage=null
> > > writer.outputFile=${system.getProperty("user.dir")}/velocity.xml
> > >
> > >
> > > Am I incorrect in assuming that this information could be stored in the
> > > database instead, perhaps in a row that contains a description of
> > > "xslt-velocity"??
> > >
> > >
> > >
> > >
> > > -------------------------------------------------------
> > > This SF.net email is sponsored by:
> > > The Definitive IT and Networking Event. Be There!
> > > NetWorld+Interop Las Vegas 2003 -- Register today!
> > > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > > _______________________________________________
> > > Babeldoc-devel mailing list
> > > Bab...@li...
> > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] Database Tables

[Dejan K. <dej...@nb...>]

I think what eklein asking for is storing configuration data into database
tables. If this is the case maybe SqlConfig is what he asks for. Sql module
contains  classes that deals with configuration data stored into database.
Look under com.babeldoc.sql.config package. I have never used these classes
so I really don't know are they work or not. Anyway, Bruce wrote that part
so you can aks him.
If this is not what you have been asking for then sorry for flaming!

Dejan


----- Original Message -----
From: "bruce" <br...@mc...>
To: <ek...@ba...>; <bab...@li...>
Sent: Tuesday, March 25, 2003 9:34 PM
Subject: Re: [Babeldoc-devel] Database Tables


> Unfortunately not - I am sorry if I gave you this impression.   The xslt
file
> must be either a file on disk or (and here is possibly your salvation) in
a
> jar file.
>
> On Tuesday 25 March 2003 03:28 pm, ek...@ba... wrote:
> > Sorry to run-on so long here, but lastly, I was expecting to find some
> > tables that contained PipeLine and PipeLine_Stage information.  It was
> > my hope that PipeLine information (as well as other attributes that I
> > see in .properties or .xml files in the documentation) could be stored
> > in the database.
> >
> > For instance, the following comes from xslt-velocity.properties in the
> > examples directory:
> >
> > entryStage = transform
> >
> > transform.stageType=XslTransform
> > transform.nextStage=writer
> > transform.transformationFile=data/transform-velocity.xsl
> >
> > writer.stageType=FileWriter
> > writer.nextStage=null
> > writer.outputFile=${system.getProperty("user.dir")}/velocity.xml
> >
> >
> > Am I incorrect in assuming that this information could be stored in the
> > database instead, perhaps in a row that contains a description of
> > "xslt-velocity"??
> >
> >
> >
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by:
> > The Definitive IT and Networking Event. Be There!
> > NetWorld+Interop Las Vegas 2003 -- Register today!
> > http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] Database Tables

[bruce <br...@mc...>]

There is *NO* ui for you to fill the database configuration tables.  You will 
need to do this through some loader script.

On Tuesday 25 March 2003 04:07 pm, ek...@ba... wrote:
> What User Interfaces currently exist and what is their function?  I'm
> trying to gauge how robust of a UI I will need to create in order to get
> all the tables populated with data for each Pipeline that my users want
> to create. Think in terms of all attributes that need to be persisted.
>
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:
> The Definitive IT and Networking Event. Be There!
> NetWorld+Interop Las Vegas 2003 -- Register today!
> http://ads.sourceforge.net/cgi-bin/redirect.pl?keyn0001en
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

Re: [Babeldoc-devel] Database Tables

[<ek...@ba...>]

What User Interfaces currently exist and what is their function?  I'm
trying to gauge how robust of a UI I will need to create in order to get
all the tables populated with data for each Pipeline that my users want
to create. Think in terms of all attributes that need to be persisted.

Re: [Babeldoc-devel] Database Tables

[bruce <br...@mc...>]

On Tuesday 25 March 2003 03:42 pm, you wrote:
> > I've noticed the following tables in the mySQL file that do not appear
> > in the Oracle file:
> >
> > USER
> > ORGANIZATION
> > RESOURCE
> > ORG_RES_ACCESS
> > USR_RES_ACCESS
> > PREFERENCE
> > USER_PREFERENCE
> > ORG_PREFERENCE
> >
> > You can ignore these unless you want to use the user stuff.
>
> Can you give me the "abridged" description of what "user stuff"
> encompasses?  I'm so naive at this point despite reading the docs.  I'm
> not sure I would want to use it or not.  Sorry.

The user stuff is the metalayer that customizes babeldoc and its web 
interfaces to a particular users requirements.  This includes authentication 
mechanisms.  Not much of this is implemented and is intended for the next 
versions of babeldoc - ie, babeldoc in the large.