exist-open — Open discussion

[Exist-open] XSLT version in eXist 5.2.0

[Christian A. <chr...@ge...>]

Dear all,

sorry to disturb you with this question, but I couldn't find anything 
about this:

What XSLT version ist running with eXist-db 5.2.0?

We are currently running scripts of XSLT 2.0 which work fine but need to 
switch to scripts of XSLT 3.0. Will that be possible with eXist 5.2?

Kind regards
Christian Achter

Re: [Exist-open] New range index and matches()

[Alasdair D. <ala...@gm...>]

Hi Andreas,

As Wolfgang said, range:match will work.I use them in one of my functions,
and it works really well and it is quick.

Alasdair

On Wed, Feb 17, 2021 at 9:35 PM Wolfgang Meier <wol...@ex...>
wrote:

> Dear Andreas,
>
> > Now, reading up on the ("new") range index, the page
> https://exist-db.org/exist/apps/doc/newrangeindex says "fn:matches is
> currently not supported due to limitations in Lucene's regular expression
> handling. If you require fn:matches a lot, consider using the old range
> index." Is this still the case?
>
> Yes, but you could try the special function range:matches instead of
> fn:matches and see if it works for you. It supports only a subset, but in
> your case, this might be sufficient?
>
> Best,
>
> Wolfgang
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

Re: [Exist-open] New range index and matches()

[Wolfgang M. <wol...@ex...>]

Dear Andreas,

> Now, reading up on the ("new") range index, the page https://exist-db.org/exist/apps/doc/newrangeindex says "fn:matches is currently not supported due to limitations in Lucene's regular expression handling. If you require fn:matches a lot, consider using the old range index." Is this still the case?

Yes, but you could try the special function range:matches instead of fn:matches and see if it works for you. It supports only a subset, but in your case, this might be sufficient?

Best,

Wolfgang

[Exist-open] New range index and matches()

[Andreas W. <And...@em...>]

Dear all,

Is it still the case that the new range index is not recommended to be 
used with matches() queries?


I am currently in the process of speeding up various xquery modules in 
my database. I have found one function that, according to monex 
profiling, is not using any index:

```xquery
matches(@n, '^[A-Za-z0-9\[\]]+$'))
```

It is meant to check if the @n attribute contains alphanumeric 
characters only, eventually combined with square brackets.

Now, reading up on the ("new") range index, the page 
https://exist-db.org/exist/apps/doc/newrangeindex says "fn:matches is 
currently not supported due to limitations in Lucene's regular 
expression handling. If you require fn:matches a lot, consider using the 
old range index." Is this still the case?

If so, would defining an old range index on the @n attribute mess with 
more specific new range index definitions that I need in other places, 
like

```xml
<range>
   <create qname="tei:div">
     <field name="tei.div.n" match="@n" type="xs:string"/>
     <field name="tei.div.type" match="@type" type="xs:string"/>
   </create>
</range>
```

Also, if you suggest defining an old range index, am I right that it 
would look like this (without being wrapped inside a range element):

```xml
<create qname="@n" type="xs:string"/>
```

Thank you for any suggestions,

Andreas


-- 
Dr. Andreas Wagner                          twitter: @anwagnerdreas
Project "The School of Salamanca"           web: http://salamanca.adwmainz.de
Academy of Sciences and Literature, Mainz   fon: +49 (0)69/798-32774
and Institute of Philosophy                 fax: +49 (0)69/798-32794
Goethe University Frankfurt

IGF HP 25 / R 2.455
Norbert-Wollheim-Platz 1
60629 Frankfurt am Main

Re: [Exist-open] Error causing eXist to not start

[Loren C. <lor...@gm...>]

I am not using CQL.  I am trying to comment out it in conf.xml


> On Feb 16, 2021, at 6:11 PM, Joe Wicentowski <jo...@gm...> wrote:
> 
> Hi Loren,
> 
> Are you using the CQL module? If not, you can uncomment it from your conf.xml:
> 
>   https://github.com/eXist-db/exist/blob/5b4692692ab0bf3642c0b0eb0a07024ec9e5f4df/exist-distribution/src/main/config/conf.xml#L995 <https://github.com/eXist-db/exist/blob/5b4692692ab0bf3642c0b0eb0a07024ec9e5f4df/exist-distribution/src/main/config/conf.xml#L995>
> 
> If you're using it, I notice that there aren't any tests for it in the eXist codebase. Perhaps you would be willing to contribute some tests to prevent regressions?
> 
>   https://github.com/eXist-db/exist/search?q=cqlparser <https://github.com/eXist-db/exist/search?q=cqlparser>
> 
> Joe
> 
> 
> On Tue, Feb 16, 2021 at 3:17 PM Loren Cahlander <lor...@gm... <mailto:lor...@gm...>> wrote:
> My client is trying to run exist in a stage environment that is in a Kubernetes image.  I do not think that the problem is exist, because it was working before.  It is, however giving the following error.
> 
> Exist version 5.2
> 
> 16 Feb 2021 18:33:16,441 [main] ERROR (Configuration.java [lookupModuleClass]:504) - Module http://exist-db.org/xquery/cqlparser <http://exist-db.org/xquery/cqlparser> could not be initialized due to a missing dependancy (NoClassDefFoundError): org/z3950/zing/cql/CQLParseException
> java.lang.NoClassDefFoundError: org/z3950/zing/cql/CQLParseException
> at org.exist.xquery.modules.cqlparser.CQLParserModule.<clinit>(CQLParserModule.java:46) ~[exist.uber.jar:5.2.0]
> at java.lang.Class.forName0(Native Method) ~[?:?]
> at java.lang.Class.forName(Class.java:315) ~[?:?]
> at org.exist.util.Configuration.lookupModuleClass(Configuration.java:488) [exist.uber.jar:5.2.0]
> at org.exist.util.Configuration.loadModuleClasses(Configuration.java:454) [exist.uber.jar:5.2.0]
> at org.exist.util.Configuration.configureXQuery(Configuration.java:390) [exist.uber.jar:5.2.0]
> at org.exist.util.Configuration.<init>(Configuration.java:275) [exist.uber.jar:5.2.0]
> at org.exist.util.SingleInstanceConfiguration.<init>(SingleInstanceConfiguration.java:56) [exist.uber.jar:5.2.0]
> at org.exist.util.SingleInstanceConfiguration.<init>(SingleInstanceConfiguration.java:48) [exist.uber.jar:5.2.0]
> at org.exist.jetty.JettyStart.run(JettyStart.java:198) [exist.uber.jar:5.2.0]
> at org.exist.jetty.JettyStart.main(JettyStart.java:95) [exist.uber.jar:5.2.0]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.exist.start.Main.invokeMain(Main.java:118) [exist.uber.jar:5.2.0]
> at org.exist.start.Main.runEx(Main.java:248) [exist.uber.jar:5.2.0]
> at org.exist.start.Main.run(Main.java:123) [exist.uber.jar:5.2.0]
> at org.exist.start.Main.main(Main.java:60) [exist.uber.jar:5.2.0]
> Caused by: java.lang.ClassNotFoundException: org.z3950.zing.cql.CQLParseException
> at jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581) ~[?:?]
> at jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178) ~[?:?]
> at java.lang.ClassLoader.loadClass(ClassLoader.java:522) ~[?:?]
> ... 19 more
> 16 Feb 2021 18:33:16,512 [main] INFO  (Configuration.java [configureValidation]:1485) - Add catalog uri file:///exist/etc/webapp//WEB-INF/catalog.xml <>
> 16 Feb 2021 18:33:16,513 [main] INFO  (GrammarPool.java [<init>]:54) - Initializing GrammarPool.
> 16 Feb 2021 18:33:16,515 [main] INFO  (JettyStart.java [run]:2
> 
> 
> 
> _______________________________________________
> Exist-open mailing list
> Exi...@li... <mailto:Exi...@li...>
> https://lists.sourceforge.net/lists/listinfo/exist-open <https://lists.sourceforge.net/lists/listinfo/exist-open>

Re: [Exist-open] Error causing eXist to not start

[Joe W. <jo...@gm...>]

Hi Loren,

Are you using the CQL module? If not, you can uncomment it from your
conf.xml:


https://github.com/eXist-db/exist/blob/5b4692692ab0bf3642c0b0eb0a07024ec9e5f4df/exist-distribution/src/main/config/conf.xml#L995

If you're using it, I notice that there aren't any tests for it in the
eXist codebase. Perhaps you would be willing to contribute some tests to
prevent regressions?

  https://github.com/eXist-db/exist/search?q=cqlparser

Joe


On Tue, Feb 16, 2021 at 3:17 PM Loren Cahlander <lor...@gm...>
wrote:

> My client is trying to run exist in a stage environment that is in a
> Kubernetes image.  I do not think that the problem is exist, because it was
> working before.  It is, however giving the following error.
>
> Exist version 5.2
>
> 16 Feb 2021 18:33:16,441 [main] ERROR (Configuration.java
> [lookupModuleClass]:504) - Module http://exist-db.org/xquery/cqlparser could
> not be initialized due to a missing dependancy (NoClassDefFoundError):
> org/z3950/zing/cql/CQLParseException
> java.lang.NoClassDefFoundError: org/z3950/zing/cql/CQLParseException
> at
> org.exist.xquery.modules.cqlparser.CQLParserModule.<clinit>(CQLParserModule.java:46)
> ~[exist.uber.jar:5.2.0]
> at java.lang.Class.forName0(Native Method) ~[?:?]
> at java.lang.Class.forName(Class.java:315) ~[?:?]
> at org.exist.util.Configuration.lookupModuleClass(Configuration.java:488)
> [exist.uber.jar:5.2.0]
> at org.exist.util.Configuration.loadModuleClasses(Configuration.java:454)
> [exist.uber.jar:5.2.0]
> at org.exist.util.Configuration.configureXQuery(Configuration.java:390)
> [exist.uber.jar:5.2.0]
> at org.exist.util.Configuration.<init>(Configuration.java:275)
> [exist.uber.jar:5.2.0]
> at
> org.exist.util.SingleInstanceConfiguration.<init>(SingleInstanceConfiguration.java:56)
> [exist.uber.jar:5.2.0]
> at
> org.exist.util.SingleInstanceConfiguration.<init>(SingleInstanceConfiguration.java:48)
> [exist.uber.jar:5.2.0]
> at org.exist.jetty.JettyStart.run(JettyStart.java:198)
> [exist.uber.jar:5.2.0]
> at org.exist.jetty.JettyStart.main(JettyStart.java:95)
> [exist.uber.jar:5.2.0]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:?]
> at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:?]
> at
> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.exist.start.Main.invokeMain(Main.java:118) [exist.uber.jar:5.2.0]
> at org.exist.start.Main.runEx(Main.java:248) [exist.uber.jar:5.2.0]
> at org.exist.start.Main.run(Main.java:123) [exist.uber.jar:5.2.0]
> at org.exist.start.Main.main(Main.java:60) [exist.uber.jar:5.2.0]
> Caused by: java.lang.ClassNotFoundException:
> org.z3950.zing.cql.CQLParseException
> at
> jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
> ~[?:?]
> at
> jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
> ~[?:?]
> at java.lang.ClassLoader.loadClass(ClassLoader.java:522) ~[?:?]
> ... 19 more
> 16 Feb 2021 18:33:16,512 [main] INFO  (Configuration.java
> [configureValidation]:1485) - Add catalog uri
> file:///exist/etc/webapp//WEB-INF/catalog.xml
> 16 Feb 2021 18:33:16,513 [main] INFO  (GrammarPool.java [<init>]:54) -
> Initializing GrammarPool.
> 16 Feb 2021 18:33:16,515 [main] INFO  (JettyStart.java [run]:2
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

[Exist-open] Error causing eXist to not start

[Loren C. <lor...@gm...>]

My client is trying to run exist in a stage environment that is in a Kubernetes image.  I do not think that the problem is exist, because it was working before.  It is, however giving the following error.

Exist version 5.2

16 Feb 2021 18:33:16,441 [main] ERROR (Configuration.java [lookupModuleClass]:504) - Module http://exist-db.org/xquery/cqlparser <http://exist-db.org/xquery/cqlparser> could not be initialized due to a missing dependancy (NoClassDefFoundError): org/z3950/zing/cql/CQLParseException
java.lang.NoClassDefFoundError: org/z3950/zing/cql/CQLParseException
at org.exist.xquery.modules.cqlparser.CQLParserModule.<clinit>(CQLParserModule.java:46) ~[exist.uber.jar:5.2.0]
at java.lang.Class.forName0(Native Method) ~[?:?]
at java.lang.Class.forName(Class.java:315) ~[?:?]
at org.exist.util.Configuration.lookupModuleClass(Configuration.java:488) [exist.uber.jar:5.2.0]
at org.exist.util.Configuration.loadModuleClasses(Configuration.java:454) [exist.uber.jar:5.2.0]
at org.exist.util.Configuration.configureXQuery(Configuration.java:390) [exist.uber.jar:5.2.0]
at org.exist.util.Configuration.<init>(Configuration.java:275) [exist.uber.jar:5.2.0]
at org.exist.util.SingleInstanceConfiguration.<init>(SingleInstanceConfiguration.java:56) [exist.uber.jar:5.2.0]
at org.exist.util.SingleInstanceConfiguration.<init>(SingleInstanceConfiguration.java:48) [exist.uber.jar:5.2.0]
at org.exist.jetty.JettyStart.run(JettyStart.java:198) [exist.uber.jar:5.2.0]
at org.exist.jetty.JettyStart.main(JettyStart.java:95) [exist.uber.jar:5.2.0]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
at org.exist.start.Main.invokeMain(Main.java:118) [exist.uber.jar:5.2.0]
at org.exist.start.Main.runEx(Main.java:248) [exist.uber.jar:5.2.0]
at org.exist.start.Main.run(Main.java:123) [exist.uber.jar:5.2.0]
at org.exist.start.Main.main(Main.java:60) [exist.uber.jar:5.2.0]
Caused by: java.lang.ClassNotFoundException: org.z3950.zing.cql.CQLParseException
at jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581) ~[?:?]
at jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178) ~[?:?]
at java.lang.ClassLoader.loadClass(ClassLoader.java:522) ~[?:?]
... 19 more
16 Feb 2021 18:33:16,512 [main] INFO  (Configuration.java [configureValidation]:1485) - Add catalog uri file:///exist/etc/webapp//WEB-INF/catalog.xml <file:///exist/etc/webapp//WEB-INF/catalog.xml>
16 Feb 2021 18:33:16,513 [main] INFO  (GrammarPool.java [<init>]:54) - Initializing GrammarPool.
16 Feb 2021 18:33:16,515 [main] INFO  (JettyStart.java [run]:2

Re: [Exist-open] Issue with 4.7.1 eXist DB - file Id points to two different collection files

[Roy W. <gar...@ya...>]

 Hi,
How about creating an empty file, copying the contents of one of the problem files to it and then deleting the donor file.
Regards,Roy

    On Tuesday, 16 February 2021, 14:56:01 GMT, Kuukka-Härmä Riina <rii...@fi...> wrote:  
 
 
Hello,
 
  
 
Thank you for an answer. I tested the query setting
 
  
 
let $id := 11240
 
  
 
And it returned the path to same two XML files as using search with xs:string.
 
  
 
BR, Riina
 
  
 
From: Michael Westbay <wes...@ja...>
Sent: tiistai 16. helmikuuta 2021 14.52
To: Kuukka-Härmä Riina <Rii...@fi...>
Cc: Exi...@li...
Subject: Re: [Exist-open] Issue with 4.7.1 eXist DB - file Id points to two different collection files
 
  
 
Hi Riina,
 
  
 
You are setting you $id to an xs:string, not an xs:integer. Comparing strings of integers to integers often causes strange results.
 
  
 
Hope this helps.
 
  
 
Take care.
 
  
 
2021年2月16日(火) 19:35 Kuukka-Härmä Riina <Rii...@fi...>:
 

Hello,
 
 
 
 
 
Any ideas that what could be gone wrong are welcomed.
 
 
 
We have an issue in eXist  4.7.1 db-installation . Backup is failing for some files, and after investigating, we found that there is Document ID that is pointing two different files in separate collections.
 
 
 
Failed to access document data
 
Document ID: 11240
 
 
 
Investigating which file this is with query:
 
 
 
xquery version "3.1";
 
 
 
declare
 
function local:find($path, $document-id as xs:integer) as xs:string* {
 
    local:find-in-collection($path, (), $document-id)
 
};
 
declare
 
function local:resource ($collection as xs:string, $resource as xs:string, $document-id as xs:integer) as xs:string? {
 
    let $path := $collection || '/' || $resource
 
    let $id := util:document-id($path)
 
    return
 
        if ($id eq $document-id)
 
        then ($path)
 
        else ()       
 
};
 
declare
 
function local:find-in-collection ($collection as xs:string, $sub-collection as xs:string?, $document-id as xs:integer) as xs:string* {
 
    let $path := string-join(($collection, $sub-collection), '/')
 
    return
 
        if (xmldb:collection-available($path))
 
        then (
 
            for-each(
 
                xmldb:get-child-collections($path),
 
                local:find-in-collection($path, ?, $document-id)
 
            ),
 
            for-each(
 
                xmldb:get-child-resources($path),
 
                local:resource($path, ?, $document-id)
 
            )
 
        )
 
        else ($path || " not found or insufficient permissions to read")
 
};
 
let $id := '11240'
 
return local:find('/db/APP', $id)
 
 
 
This returns two files:
 
 
 
"/db/APP/ORGANIZATION.A/CODE/INTERNAL/PUBLISHED/1603458557855/TOSELEMENTS/customFields.xml"
 
"/db/APP/ORGANIZATION.B/CODE/INTERNAL/PUBLISHED/1611822097512/TOSELEMENTS/strongEsignatureText.xml"
 
 
 
Howcome there can be returned two files with same id? How this can be fixed, is there any options than reinstall the database and return the content from backup? Should that fix the fileId:s eventually? 
 
 
 
What I know, for some problematic files there is used eXist dashboard copy/paste functionality - but not all copy pasted files are having this issue.
 
 
 
Best Regards, Riina Kuukka-Härmä
 
 
 
 
 
_______________________________________________
Exist-open mailing list
Exi...@li...
https://lists.sourceforge.net/lists/listinfo/exist-open
 



 
  
 
-- 
 
Michael Westbay
Writer/System Administrator
http://www.japanesebaseball.com/
 _______________________________________________
Exist-open mailing list
Exi...@li...
https://lists.sourceforge.net/lists/listinfo/exist-open
  

Re: [Exist-open] Issue with 4.7.1 eXist DB - file Id points to two different collection files

[Kuukka-Härmä R. <Rii...@fi...>]

Hello,

Thank you for an answer. I tested the query setting

let $id := 11240

And it returned the path to same two XML files as using search with xs:string.

BR, Riina

From: Michael Westbay <wes...@ja...>
Sent: tiistai 16. helmikuuta 2021 14.52
To: Kuukka-Härmä Riina <Rii...@fi...>
Cc: Exi...@li...
Subject: Re: [Exist-open] Issue with 4.7.1 eXist DB - file Id points to two different collection files

Hi Riina,

You are setting you $id to an xs:string, not an xs:integer. Comparing strings of integers to integers often causes strange results.

Hope this helps.

Take care.

2021年2月16日(火) 19:35 Kuukka-Härmä Riina <Rii...@fi...<mailto:Rii...@fi...>>:
Hello,


Any ideas that what could be gone wrong are welcomed.

We have an issue in eXist  4.7.1 db-installation . Backup is failing for some files, and after investigating, we found that there is Document ID that is pointing two different files in separate collections.

Failed to access document data
Document ID: 11240

Investigating which file this is with query:

xquery version "3.1";

declare
function local:find($path, $document-id as xs:integer) as xs:string* {
    local:find-in-collection($path, (), $document-id)
};
declare
function local:resource ($collection as xs:string, $resource as xs:string, $document-id as xs:integer) as xs:string? {
    let $path := $collection || '/' || $resource
    let $id := util:document-id($path)
    return
        if ($id eq $document-id)
        then ($path)
        else ()
};
declare
function local:find-in-collection ($collection as xs:string, $sub-collection as xs:string?, $document-id as xs:integer) as xs:string* {
    let $path := string-join(($collection, $sub-collection), '/')
    return
        if (xmldb:collection-available($path))
        then (
            for-each(
                xmldb:get-child-collections($path),
                local:find-in-collection($path, ?, $document-id)
            ),
            for-each(
                xmldb:get-child-resources($path),
                local:resource($path, ?, $document-id)
            )
        )
        else ($path || " not found or insufficient permissions to read")
};
let $id := '11240'
return local:find('/db/APP', $id)

This returns two files:

"/db/APP/ORGANIZATION.A/CODE/INTERNAL/PUBLISHED/1603458557855/TOSELEMENTS/customFields.xml"
"/db/APP/ORGANIZATION.B/CODE/INTERNAL/PUBLISHED/1611822097512/TOSELEMENTS/strongEsignatureText.xml"

Howcome there can be returned two files with same id? How this can be fixed, is there any options than reinstall the database and return the content from backup? Should that fix the fileId:s eventually?

What I know, for some problematic files there is used eXist dashboard copy/paste functionality - but not all copy pasted files are having this issue.

Best Regards, Riina Kuukka-Härmä


_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open


--
Michael Westbay
Writer/System Administrator
http://www.japanesebaseball.com/

Re: [Exist-open] Issue with 4.7.1 eXist DB - file Id points to two different collection files

[Michael W. <wes...@ja...>]

Hi Riina,

You are setting you $id to an xs:string, not an xs:integer. Comparing
strings of integers to integers often causes strange results.

Hope this helps.

Take care.

2021年2月16日(火) 19:35 Kuukka-Härmä Riina <Rii...@fi...>:

> Hello,
>
>
>
>
>
> Any ideas that what could be gone wrong are welcomed.
>
>
>
> We have an issue in eXist  4.7.1 db-installation . Backup is failing for
> some files, and after investigating, we found that there is Document ID
> that is pointing two different files in separate collections.
>
>
>
> Failed to access document data
>
> Document ID: 11240
>
>
>
> Investigating which file this is with query:
>
>
>
> xquery version "3.1";
>
>
>
> declare
>
> function local:find($path, $document-id as xs:integer) as xs:string* {
>
>     local:find-in-collection($path, (), $document-id)
>
> };
>
> declare
>
> function local:resource ($collection as xs:string, $resource as xs:string,
> $document-id as xs:integer) as xs:string? {
>
>     let $path := $collection || '/' || $resource
>
>     let $id := util:document-id($path)
>
>     return
>
>         if ($id eq $document-id)
>
>         then ($path)
>
>         else ()
>
> };
>
> declare
>
> function local:find-in-collection ($collection as xs:string,
> $sub-collection as xs:string?, $document-id as xs:integer) as xs:string* {
>
>     let $path := string-join(($collection, $sub-collection), '/')
>
>     return
>
>         if (xmldb:collection-available($path))
>
>         then (
>
>             for-each(
>
>                 xmldb:get-child-collections($path),
>
>                 local:find-in-collection($path, ?, $document-id)
>
>             ),
>
>             for-each(
>
>                 xmldb:get-child-resources($path),
>
>                 local:resource($path, ?, $document-id)
>
>             )
>
>         )
>
>         else ($path || " not found or insufficient permissions to read")
>
> };
>
> let $id := '11240'
>
> return local:find('/db/APP', $id)
>
>
>
> This returns two files:
>
>
>
>
> "/db/APP/ORGANIZATION.A/CODE/INTERNAL/PUBLISHED/1603458557855/TOSELEMENTS/customFields.xml"
>
>
> "/db/APP/ORGANIZATION.B/CODE/INTERNAL/PUBLISHED/1611822097512/TOSELEMENTS/strongEsignatureText.xml"
>
>
>
> Howcome there can be returned two files with same id? How this can be
> fixed, is there any options than reinstall the database and return the
> content from backup? Should that fix the fileId:s eventually?
>
>
>
> What I know, for some problematic files there is used eXist dashboard
> copy/paste functionality - but not all copy pasted files are having this
> issue.
>
>
>
> Best Regards, Riina Kuukka-Härmä
>
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>


-- 
Michael Westbay
Writer/System Administrator
http://www.japanesebaseball.com/

[Exist-open] Issue with 4.7.1 eXist DB - file Id points to two different collection files

[Kuukka-Härmä R. <Rii...@fi...>]

Hello,


Any ideas that what could be gone wrong are welcomed.

We have an issue in eXist  4.7.1 db-installation . Backup is failing for some files, and after investigating, we found that there is Document ID that is pointing two different files in separate collections.

Failed to access document data
Document ID: 11240

Investigating which file this is with query:

xquery version "3.1";

declare
function local:find($path, $document-id as xs:integer) as xs:string* {
    local:find-in-collection($path, (), $document-id)
};
declare
function local:resource ($collection as xs:string, $resource as xs:string, $document-id as xs:integer) as xs:string? {
    let $path := $collection || '/' || $resource
    let $id := util:document-id($path)
    return
        if ($id eq $document-id)
        then ($path)
        else ()
};
declare
function local:find-in-collection ($collection as xs:string, $sub-collection as xs:string?, $document-id as xs:integer) as xs:string* {
    let $path := string-join(($collection, $sub-collection), '/')
    return
        if (xmldb:collection-available($path))
        then (
            for-each(
                xmldb:get-child-collections($path),
                local:find-in-collection($path, ?, $document-id)
            ),
            for-each(
                xmldb:get-child-resources($path),
                local:resource($path, ?, $document-id)
            )
        )
        else ($path || " not found or insufficient permissions to read")
};
let $id := '11240'
return local:find('/db/APP', $id)

This returns two files:

"/db/APP/ORGANIZATION.A/CODE/INTERNAL/PUBLISHED/1603458557855/TOSELEMENTS/customFields.xml"
"/db/APP/ORGANIZATION.B/CODE/INTERNAL/PUBLISHED/1611822097512/TOSELEMENTS/strongEsignatureText.xml"

Howcome there can be returned two files with same id? How this can be fixed, is there any options than reinstall the database and return the content from backup? Should that fix the fileId:s eventually?

What I know, for some problematic files there is used eXist dashboard copy/paste functionality - but not all copy pasted files are having this issue.

Best Regards, Riina Kuukka-Härmä

[Exist-open] Package references to old versions persist after package update

[Jo C. <Jo....@ha...>]

 Hi all,

I don't know if others have encountered this problem.  I have a minor patch
to a package to take it from, say, version 1.7 to version 1.8, stored in
XAR files such as package_1.8.xar.

If I do, for example,

import module namespace repo="http://exist-db.org/xquery/repo"
<http://exist-db.org/xquery/repo>;

repo:install-and-deploy-from-db("/db/install/package_1.8.xar")

the files stored at data/expathrepo/package_1.7 are not removed. I  tried
undeploying both packages, removing the hierarchies under
data/expathrepo/package_1.* and redeploying package_1.8.  eXist then fails
to restart with an error that the relevant packages cannot be found under
data/expathrepo/package_1.7 (i.e. the old version).  I located references
to the old version in data/expathrepo/.expath-pkg/packages.{txt,xml}.  If I
delete the reference to the older package from those two files, I can get a
clean start of eXist.  Is that a safe workaround?

System details


eXist Version: 5.0.0
eXist Build: 20190902160649
Operating System: Linux 3.10.0-1062.12.1.el7.x86_64 amd64 (Red Hat)
Java Version: 1.8.0_242
Default Encoding: UTF8


Best regards, -- Jo

Re: [Exist-open] Login Failed unexpected token in JSON

[Ihe O. <ihe...@gm...>]

Caused by running virus software so can't pin this one on JSON.

On Sat, Feb 13, 2021 at 8:35 AM Ihe Onwuka <ihe...@gm...> wrote:

> [image: image.png]
>

[Exist-open] Login Failed unexpected token in JSON

[Ihe O. <ihe...@gm...>]

[image: image.png]

Re: [Exist-open] Is xmldb:get-current-user() deprecated [Solved]

[Dale P. <ldp...@gm...>]

Thank you very much, Joe.  I was sure I had missed that somewhere.  And 
thanks for the reference to Craig Berry's Perl script.

Thanks again.

Dale

On 2/9/21 9:30 PM, Joe Wicentowski wrote:
> Hi Dale,
>
> The release notes for 5.0.0 list a number of functions that were 
> removed and replaced, including:
>
>   * |xmldb:get-current-user|, use
>     |sm:id()//sm:real/sm:username/string()|instead.
>
> And:
>
> Craig Berry has kindly provided a Perl script 
> <https://github.com/craigberry/audit_exist_5x_removals> which you can 
> run against your XQuery code to audit for most of these changes.
>
> See
> https://exist-db.org/exist/apps/wiki/blogs/eXist/eXistdb500.
>
> Joe
>
>
> On Tue, Feb 9, 2021 at 8:52 PM Dale Patterson <ldp...@gm... 
> <mailto:ldp...@gm...>> wrote:
>
>     Within the past two weeks to perhaps a month xmldb:get-current-user()
>     has stopped working.
>
>     I'm using eXist-db 5.2.0
>     OS: Ubuntu 18.04
>     2 TB drive.
>
>     I use the output to appear in  a <footer> on the page a staff
>     person is
>     working on and in some cases it is used to give a name to a temporary
>     file.    Now, whenever I try to access a page which displays the
>     current
>     user's id I get the following error. I am doing this all through
>     the web
>     interface.
>
>     +++++++++++++++++++
>
>     <exception>
>     <path>/db/apps/archives3/A-File-Name.xql</path>
>     <message>
>     err:XPST0017 error found while loading module conf: Error while
>     loading
>     module view/catalog-config.xqm: Function xmldb:get-current-user()
>     is not
>     defined in module namespace: http://exist-db.org/xquery/xmldb [at
>     line
>     178, column 96]
>     </message>
>     </exception>
>
>     +++++++++++++++++++++++++
>
>     I just installed 5.2.0 and backuped my app from the old 2.2, moved
>     the
>     data to a new folder and then reloaded the data into the 5.2.0.  That
>     was about the end of January.  I have looked the the list of
>     functions
>     for xmldb and for sm, but could not find the function. I'm sure I'm
>     missing the obvious; but I've been using this function for the
>     past ten
>     years.  Would like to continue using it.
>
>     Thanks.
>
>     Dale Patterson
>
>
>
>
>
>     _______________________________________________
>     Exist-open mailing list
>     Exi...@li...
>     <mailto:Exi...@li...>
>     https://lists.sourceforge.net/lists/listinfo/exist-open
>
> -- 
> Sent from my iPhone

Re: [Exist-open] Is xmldb:get-current-user() deprecated [Solved]

[Dale P. <ldp...@gm...>]

Thank you very much, Joe.  I was sure I had missed that somewhere.  And 
thanks for the reference to Craig Berry's Perl script.

Thanks again.

Dale

On 2/9/21 9:30 PM, Joe Wicentowski wrote:
> Hi Dale,
>
> The release notes for 5.0.0 list a number of functions that were 
> removed and replaced, including:
>
>   * |xmldb:get-current-user|, use
>     |sm:id()//sm:real/sm:username/string()|instead.
>
> And:
>
> Craig Berry has kindly provided a Perl script 
> <https://github.com/craigberry/audit_exist_5x_removals> which you can 
> run against your XQuery code to audit for most of these changes.
>
> See
> https://exist-db.org/exist/apps/wiki/blogs/eXist/eXistdb500.
>
> Joe
>
>
> On Tue, Feb 9, 2021 at 8:52 PM Dale Patterson <ldp...@gm... 
> <mailto:ldp...@gm...>> wrote:
>
>     Within the past two weeks to perhaps a month xmldb:get-current-user()
>     has stopped working.
>
>     I'm using eXist-db 5.2.0
>     OS: Ubuntu 18.04
>     2 TB drive.
>
>     I use the output to appear in  a <footer> on the page a staff
>     person is
>     working on and in some cases it is used to give a name to a temporary
>     file.    Now, whenever I try to access a page which displays the
>     current
>     user's id I get the following error. I am doing this all through
>     the web
>     interface.
>
>     +++++++++++++++++++
>
>     <exception>
>     <path>/db/apps/archives3/A-File-Name.xql</path>
>     <message>
>     err:XPST0017 error found while loading module conf: Error while
>     loading
>     module view/catalog-config.xqm: Function xmldb:get-current-user()
>     is not
>     defined in module namespace: http://exist-db.org/xquery/xmldb [at
>     line
>     178, column 96]
>     </message>
>     </exception>
>
>     +++++++++++++++++++++++++
>
>     I just installed 5.2.0 and backuped my app from the old 2.2, moved
>     the
>     data to a new folder and then reloaded the data into the 5.2.0.  That
>     was about the end of January.  I have looked the the list of
>     functions
>     for xmldb and for sm, but could not find the function. I'm sure I'm
>     missing the obvious; but I've been using this function for the
>     past ten
>     years.  Would like to continue using it.
>
>     Thanks.
>
>     Dale Patterson
>
>
>
>
>
>     _______________________________________________
>     Exist-open mailing list
>     Exi...@li...
>     <mailto:Exi...@li...>
>     https://lists.sourceforge.net/lists/listinfo/exist-open
>
> -- 
> Sent from my iPhone

Re: [Exist-open] Is xmldb:get-current-user() deprecated???

[Joe W. <jo...@gm...>]

Hi Dale,

The release notes for 5.0.0 list a number of functions that were removed
and replaced, including:


   - xmldb:get-current-user, use sm:id()//sm:real/sm:username/string()
   instead.

And:

Craig Berry has kindly provided a Perl script
<https://github.com/craigberry/audit_exist_5x_removals> which you can run
against your XQuery code to audit for most of these changes.

See
https://exist-db.org/exist/apps/wiki/blogs/eXist/eXistdb500.

Joe


On Tue, Feb 9, 2021 at 8:52 PM Dale Patterson <ldp...@gm...>
wrote:

> Within the past two weeks to perhaps a month xmldb:get-current-user()
> has stopped working.
>
> I'm using eXist-db 5.2.0
> OS: Ubuntu 18.04
> 2 TB drive.
>
> I use the output to appear in  a <footer> on the page a staff person is
> working on and in some cases it is used to give a name to a temporary
> file.    Now, whenever I try to access a page which displays the current
> user's id I get the following error. I am doing this all through the web
> interface.
>
> +++++++++++++++++++
>
> <exception>
> <path>/db/apps/archives3/A-File-Name.xql</path>
> <message>
> err:XPST0017 error found while loading module conf: Error while loading
> module view/catalog-config.xqm: Function xmldb:get-current-user() is not
> defined in module namespace: http://exist-db.org/xquery/xmldb [at line
> 178, column 96]
> </message>
> </exception>
>
> +++++++++++++++++++++++++
>
> I just installed 5.2.0 and backuped my app from the old 2.2, moved the
> data to a new folder and then reloaded the data into the 5.2.0.  That
> was about the end of January.  I have looked the the list of functions
> for xmldb and for sm, but could not find the function. I'm sure I'm
> missing the obvious; but I've been using this function for the past ten
> years.  Would like to continue using it.
>
> Thanks.
>
> Dale Patterson
>
>
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
-- 
Sent from my iPhone

[Exist-open] Is xmldb:get-current-user() deprecated???

[Dale P. <ldp...@gm...>]

Within the past two weeks to perhaps a month xmldb:get-current-user() 
has stopped working.

I'm using eXist-db 5.2.0
OS: Ubuntu 18.04
2 TB drive.

I use the output to appear in  a <footer> on the page a staff person is 
working on and in some cases it is used to give a name to a temporary 
file.    Now, whenever I try to access a page which displays the current 
user's id I get the following error. I am doing this all through the web 
interface.

+++++++++++++++++++

<exception>
<path>/db/apps/archives3/A-File-Name.xql</path>
<message>
err:XPST0017 error found while loading module conf: Error while loading 
module view/catalog-config.xqm: Function xmldb:get-current-user() is not 
defined in module namespace: http://exist-db.org/xquery/xmldb [at line 
178, column 96]
</message>
</exception>

+++++++++++++++++++++++++

I just installed 5.2.0 and backuped my app from the old 2.2, moved the 
data to a new folder and then reloaded the data into the 5.2.0.  That 
was about the end of January.  I have looked the the list of functions 
for xmldb and for sm, but could not find the function. I'm sure I'm 
missing the obvious; but I've been using this function for the past ten 
years.  Would like to continue using it.

Thanks.

Dale Patterson

[Exist-open] Backup, restore, reindex

[Dai, T. <td...@lo...>]

Hi Everybody,


    I had asked this question


https://sourceforge.net/p/exist/mailman/message/37177206/


and then the holidays happened.


I went and looked at my question and didn't fully explain what I'm trying to do. We are are having a searching diacritics issue that I would like wrapped up in automated backup and restore solution.


What we are doing currently:

On our dev server, we are using the StandardAnalyzer and a homegrown analyzer to index the fields so that we can search with and with out the diacritics for various fields. The content is dumped and restored onto our staging server BUT we lose the ability to search with diacritics.


What we would like to happen:

We would be able to restore in an automated fashion to the staging server so that the searching can be done with and with the diacritics.


What I have thought of:

- Can we dump the dev index as part of the backup and restore onto stage?

- Can we modify the collections.xconf files so that the content is indexed with both the StandardAnalyzer and the homegrown analyzer during the restore. Doing a google search says no, but maybe you guys have a way around that.

- Jean-Paul had recommended just a reindex using xmldb:reindex() but I don't have access to the dashboard due to security reasons, so unless there is an api somewhere in 4.1.0 that is a no-go.

- Dannes had eluded to checking the WEB-INF/data for the indexes but I never followed up.


What do you think is my best course of action here.


Thanks,

Tino

Re: [Exist-open] transform: Resource ... is a collection

[Eduard D. <ed...@fr...>]

Well, actually I don't pass a collection, I pass the full xmldb path to a collection as a string.

Then I expect the xslt processor to be able to resolve this path when I call collection($path).

Could it be that the problem lies with the URIResolver used?

Multiple calls to transform looping over the documents in xquery will be too slow.

By the way, this is not a big issue for me, but it would be very nice if this works. Perhaps I'll have a look at the transformer code in exist to see why this doesn't work.

Thanks for thinking along,

Eduard

-----Original Message-----
From: Jean-Paul Rehr <re...@gm...<mailto:Jean-Paul%20Rehr%20%3cr...@gm...%3e>>
To: Joe Wicentowski <jo...@gm...<mailto:Joe%20Wicentowski%20%3cj...@gm...%3e>>
Cc: Eduard Drenth <ed...@fr...<mailto:Eduard%20Drenth%20%3ce...@fr...%3e>>, exi...@li... <exi...@li...<mailto:%22e...@li...%22%20%3ce...@li...%3e>>
Subject: Re: [Exist-open] transform: Resource ... is a collection
Date: Fri, 05 Feb 2021 23:10:45 +0100

Dear Eduard,

I use XSL in eXist all the time, but I don't think I've ever tried passing a collection via the transform:transform parameter - only a single document URL.

I've since decided against passing them through a URL in the 3rd argument and instead write the XSL inside Xquery and inject the nodes directly into the XSL through a constructor - ie not a parameter argument in transform:transform.

To state my process more clearly (I hope!), I use for-loop which calls transform:transform, and passing in the individual document from the collection each iteration of the loop into the XSL.

I find it to be much faster than passing an eXist document URL to the parameter and then having Saxon go back into eXist to access the documents.

Best,
JPR

On Fri, Feb 5, 2021 at 8:40 PM Joe Wicentowski <jo...@gm...<mailto:jo...@gm...>> wrote:
Hi Eduard,

I haven't used XSLT in eXist in ages, but I recall seeing questions about that here on the mailing list and stackoverflow before. See Jean-Paul's answer to a question, along with the link therein to the eXist documentation:

  https://stackoverflow.com/questions/62023540/document-uri-not-working-in-xslt-when-transform-is-called-from-exist-db

I hope this helps.

Joe

On Fri, Feb 5, 2021 at 2:20 PM Eduard Drenth <ed...@fr...<mailto:ed...@fr...>> wrote:
Hi Joe,

java -Xmx4096m -cp ~/saxonica10/saxon-he-10.2.jar net.sf.saxon.Transform -xsl:online-dictionaries/jsonDictionary/teiToParallel.xslt -s:test.xml dir=/home/eduard/fhwb/data/ > fhwbparallel.txt 2> fhwbparallel.log

I am using exist 5.2 with no chenges at all

To me it looks like the collection url xmldb:exist:// cannot be handled....

Bye, Eduard

-----Original Message-----
From: Joe Wicentowski <jo...@gm...<mailto:Joe%20Wicentowski%20%3cj...@gm...%3e>>
To: Eduard Drenth <ed...@fr...<mailto:Eduard%20Drenth%20%3ce...@fr...%3e>>
Cc: exi...@li...<mailto:exi...@li...> <exi...@li...<mailto:%22e...@li...%22%20%3ce...@li...%3e>>
Subject: Re: [Exist-open] transform: Resource ... is a collection
Date: Thu, 04 Feb 2021 14:49:50 -0500

Hi Eduard,

When you say the XSLT "works via the command line", which command is it that you use?

For the XQuery call to transform:transform, which version of eXist are you using? And I assume you're using the stock version of Saxon included with eXist and haven't replaced it with your own - but if I'm wrong, please specify.

Joe

On Mon, Feb 1, 2021 at 5:38 AM Eduard Drenth <ed...@fr...<mailto:ed...@fr...>> wrote:
Dear all,

I have I xslt that works fine from the command line, it processes files in a directory:


<

xsl:for-each

select

="collection($dir)/*"

>



Now I want to call it from xquery like this:


transform

:

stream-transform

((),$

teidictjson

:

parallelxslt

,


    <

parameters

>


        <

param

name=

"dir"

value=

"xmldb:exist://

{$

config

:

data-root

}

"

/>





    </

parameters

>)



This however produces an error:


Exception while transforming node: I/O error reported by XML parser processing null: Resource /db/apps/teidictjson/data is a collection


Tried a lot of things, no luck yet.


Any idea's?


Greetings, Eduard


--

Eduard Drenth, Software Architekt

ed...@fr...<mailto:ed...@fr...>

Doelestrjitte 8
8911 DX  Ljouwert
+31 58 234 30 47
+31 62 094 34 28 (privé)

skype: eduarddrenth
https://github.com/eduarddrenth
frisian.eu<http://frisian.eu>
gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth


Op freed bin ik thús/wurkje ik minder



_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open

--

Eduard Drenth, Software Architekt

ed...@fr...<mailto:ed...@fr...>

Doelestrjitte 8
8911 DX  Ljouwert
+31 58 234 30 47
+31 62 094 34 28 (privé)

skype: eduarddrenth
https://github.com/eduarddrenth
frisian.eu<http://frisian.eu>
gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth


Op freed bin ik thús/wurkje ik minder



_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open

--

Eduard Drenth, Software Architekt

ed...@fr...<mailto:ed...@fr...>

Doelestrjitte 8
8911 DX  Ljouwert
+31 58 234 30 47
+31 62 094 34 28 (privé)

skype: eduarddrenth
https://github.com/eduarddrenth
frisian.eu
gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth


Op freed bin ik thús/wurkje ik minder

Re: [Exist-open] transform: Resource ... is a collection

[Jean-Paul R. <re...@gm...>]

Dear Eduard,

I use XSL in eXist all the time, but I don't think I've ever tried passing
a collection via the transform:transform parameter - only a single document
URL.

I've since decided against passing them through a URL in the 3rd argument
and instead write the XSL inside Xquery and inject the nodes directly into
the XSL through a constructor - ie not a parameter argument in
transform:transform.

To state my process more clearly (I hope!), I use for-loop which calls
transform:transform, and passing in the individual document from the
collection each iteration of the loop into the XSL.

I find it to be much faster than passing an eXist document URL to the
parameter and then having Saxon go back into eXist to access the documents.

Best,
JPR

On Fri, Feb 5, 2021 at 8:40 PM Joe Wicentowski <jo...@gm...> wrote:

> Hi Eduard,
>
> I haven't used XSLT in eXist in ages, but I recall seeing questions about
> that here on the mailing list and stackoverflow before. See Jean-Paul's
> answer to a question, along with the link therein to the eXist
> documentation:
>
>
> https://stackoverflow.com/questions/62023540/document-uri-not-working-in-xslt-when-transform-is-called-from-exist-db
>
> I hope this helps.
>
> Joe
>
> On Fri, Feb 5, 2021 at 2:20 PM Eduard Drenth <ed...@fr...>
> wrote:
>
>> Hi Joe,
>>
>> java -Xmx4096m -cp ~/saxonica10/saxon-he-10.2.jar
>> net.sf.saxon.Transform -xsl:online-dictionaries/jsonDictionary/teiToParallel.xslt
>> -s:test.xml dir=/home/eduard/fhwb/data/ > fhwbparallel.txt 2>
>> fhwbparallel.log
>>
>> I am using exist 5.2 with no chenges at all
>>
>> To me it looks like the collection url xmldb:exist:// cannot be
>> handled....
>>
>> Bye, Eduard
>>
>> -----Original Message-----
>> *From*: Joe Wicentowski <jo...@gm...
>> <Joe%20Wicentowski%20%3cj...@gm...%3e>>
>> *To*: Eduard Drenth <ed...@fr...
>> <Eduard%20Drenth%20%3ce...@fr...%3e>>
>> *Cc*: exi...@li... <exi...@li...
>> <%22e...@li...%22%20%3ce...@li...%3e>
>> >
>> *Subject*: Re: [Exist-open] transform: Resource ... is a collection
>> *Date*: Thu, 04 Feb 2021 14:49:50 -0500
>>
>> Hi Eduard,
>>
>> When you say the XSLT "works via the command line", which command is it
>> that you use?
>>
>> For the XQuery call to transform:transform, which version of eXist are
>> you using? And I assume you're using the stock version of Saxon included
>> with eXist and haven't replaced it with your own - but if I'm wrong, please
>> specify.
>>
>> Joe
>>
>> On Mon, Feb 1, 2021 at 5:38 AM Eduard Drenth <ed...@fr...>
>> wrote:
>>
>> Dear all,
>>
>> I have I xslt that works fine from the command line, it processes files
>> in a directory:
>>
>> <
>>
>> xsl:for-each
>>
>> select
>>
>> ="collection($dir)/*"
>>
>> >
>>
>>
>>
>> Now I want to call it from xquery like this:
>>
>>
>> transform
>>
>> :
>>
>> stream-transform
>>
>> ((),$
>>
>> teidictjson
>>
>> :
>>
>> parallelxslt
>>
>> ,
>>
>>
>>     <
>>
>> parameters
>>
>> >
>>
>>
>>         <
>>
>> param
>>
>> name=
>>
>> "dir"
>>
>> value=
>>
>> "xmldb:exist://
>>
>> {$
>>
>> config
>>
>> :
>>
>> data-root
>>
>> }
>>
>> "
>>
>> />
>>
>>
>>
>>     </
>>
>> parameters
>>
>> >)
>>
>>
>>
>> This however produces an error:
>>
>>
>> Exception while transforming node: I/O error reported by XML parser processing null: Resource /db/apps/teidictjson/data is a collection
>>
>>
>> Tried a lot of things, no luck yet.
>>
>>
>> Any idea's?
>>
>>
>> Greetings, Eduard
>>
>>
>> --
>>
>>
>> Eduard Drenth, Software Architekt
>>
>> ed...@fr...
>>
>> Doelestrjitte 8
>> 8911 DX  Ljouwert
>> +31 58 234 30 47
>> +31 62 094 34 28 (privé)
>>
>> skype: eduarddrenth
>> https://github.com/eduarddrenth
>> frisian.eu
>> gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth
>>
>>
>> Op freed bin ik thús/wurkje ik minder
>>
>>
>>
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li...
>> https://lists.sourceforge.net/lists/listinfo/exist-open
>>
>> --
>>
>> Eduard Drenth, Software Architekt
>>
>> ed...@fr...
>>
>> Doelestrjitte 8
>> 8911 DX  Ljouwert
>> +31 58 234 30 47
>> +31 62 094 34 28 (privé)
>>
>> skype: eduarddrenth
>> https://github.com/eduarddrenth
>> frisian.eu
>> gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth
>>
>>
>> Op freed bin ik thús/wurkje ik minder
>>
>>
>>
>> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

Re: [Exist-open] transform: Resource ... is a collection

[Joe W. <jo...@gm...>]

Hi Eduard,

I haven't used XSLT in eXist in ages, but I recall seeing questions about
that here on the mailing list and stackoverflow before. See Jean-Paul's
answer to a question, along with the link therein to the eXist
documentation:


https://stackoverflow.com/questions/62023540/document-uri-not-working-in-xslt-when-transform-is-called-from-exist-db

I hope this helps.

Joe

On Fri, Feb 5, 2021 at 2:20 PM Eduard Drenth <ed...@fr...>
wrote:

> Hi Joe,
>
> java -Xmx4096m -cp ~/saxonica10/saxon-he-10.2.jar
> net.sf.saxon.Transform -xsl:online-dictionaries/jsonDictionary/teiToParallel.xslt
> -s:test.xml dir=/home/eduard/fhwb/data/ > fhwbparallel.txt 2>
> fhwbparallel.log
>
> I am using exist 5.2 with no chenges at all
>
> To me it looks like the collection url xmldb:exist:// cannot be handled....
>
> Bye, Eduard
>
> -----Original Message-----
> *From*: Joe Wicentowski <jo...@gm...
> <Joe%20Wicentowski%20%3cj...@gm...%3e>>
> *To*: Eduard Drenth <ed...@fr...
> <Eduard%20Drenth%20%3ce...@fr...%3e>>
> *Cc*: exi...@li... <exi...@li...
> <%22e...@li...%22%20%3ce...@li...%3e>
> >
> *Subject*: Re: [Exist-open] transform: Resource ... is a collection
> *Date*: Thu, 04 Feb 2021 14:49:50 -0500
>
> Hi Eduard,
>
> When you say the XSLT "works via the command line", which command is it
> that you use?
>
> For the XQuery call to transform:transform, which version of eXist are you
> using? And I assume you're using the stock version of Saxon included with
> eXist and haven't replaced it with your own - but if I'm wrong, please
> specify.
>
> Joe
>
> On Mon, Feb 1, 2021 at 5:38 AM Eduard Drenth <ed...@fr...>
> wrote:
>
> Dear all,
>
> I have I xslt that works fine from the command line, it processes files in
> a directory:
>
> <
>
> xsl:for-each
>
> select
>
> ="collection($dir)/*"
>
> >
>
>
>
> Now I want to call it from xquery like this:
>
>
> transform
>
> :
>
> stream-transform
>
> ((),$
>
> teidictjson
>
> :
>
> parallelxslt
>
> ,
>
>
>     <
>
> parameters
>
> >
>
>
>         <
>
> param
>
> name=
>
> "dir"
>
> value=
>
> "xmldb:exist://
>
> {$
>
> config
>
> :
>
> data-root
>
> }
>
> "
>
> />
>
>
>
>     </
>
> parameters
>
> >)
>
>
>
> This however produces an error:
>
>
> Exception while transforming node: I/O error reported by XML parser processing null: Resource /db/apps/teidictjson/data is a collection
>
>
> Tried a lot of things, no luck yet.
>
>
> Any idea's?
>
>
> Greetings, Eduard
>
>
> --
>
>
> Eduard Drenth, Software Architekt
>
> ed...@fr...
>
> Doelestrjitte 8
> 8911 DX  Ljouwert
> +31 58 234 30 47
> +31 62 094 34 28 (privé)
>
> skype: eduarddrenth
> https://github.com/eduarddrenth
> frisian.eu
> gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth
>
>
> Op freed bin ik thús/wurkje ik minder
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
> --
>
> Eduard Drenth, Software Architekt
>
> ed...@fr...
>
> Doelestrjitte 8
> 8911 DX  Ljouwert
> +31 58 234 30 47
> +31 62 094 34 28 (privé)
>
> skype: eduarddrenth
> https://github.com/eduarddrenth
> frisian.eu
> gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth
>
>
> Op freed bin ik thús/wurkje ik minder
>
>
>
>

Re: [Exist-open] transform: Resource ... is a collection

[Eduard D. <ed...@fr...>]

Hi Joe,

java -Xmx4096m -cp ~/saxonica10/saxon-he-10.2.jar net.sf.saxon.Transform -xsl:online-dictionaries/jsonDictionary/teiToParallel.xslt -s:test.xml dir=/home/eduard/fhwb/data/ > fhwbparallel.txt 2> fhwbparallel.log

I am using exist 5.2 with no chenges at all

To me it looks like the collection url xmldb:exist:// cannot be handled....

Bye, Eduard

-----Original Message-----
From: Joe Wicentowski <jo...@gm...<mailto:Joe%20Wicentowski%20%3cj...@gm...%3e>>
To: Eduard Drenth <ed...@fr...<mailto:Eduard%20Drenth%20%3ce...@fr...%3e>>
Cc: exi...@li... <exi...@li...<mailto:%22e...@li...%22%20%3ce...@li...%3e>>
Subject: Re: [Exist-open] transform: Resource ... is a collection
Date: Thu, 04 Feb 2021 14:49:50 -0500

Hi Eduard,

When you say the XSLT "works via the command line", which command is it that you use?

For the XQuery call to transform:transform, which version of eXist are you using? And I assume you're using the stock version of Saxon included with eXist and haven't replaced it with your own - but if I'm wrong, please specify.

Joe

On Mon, Feb 1, 2021 at 5:38 AM Eduard Drenth <ed...@fr...<mailto:ed...@fr...>> wrote:
Dear all,

I have I xslt that works fine from the command line, it processes files in a directory:


<

xsl:for-each

select

="collection($dir)/*"

>



Now I want to call it from xquery like this:


transform

:

stream-transform

((),$

teidictjson

:

parallelxslt

,


    <

parameters

>


        <

param

name=

"dir"

value=

"xmldb:exist://

{$

config

:

data-root

}

"

/>





    </

parameters

>)



This however produces an error:


Exception while transforming node: I/O error reported by XML parser processing null: Resource /db/apps/teidictjson/data is a collection


Tried a lot of things, no luck yet.


Any idea's?


Greetings, Eduard


--

Eduard Drenth, Software Architekt

ed...@fr...<mailto:ed...@fr...>

Doelestrjitte 8
8911 DX  Ljouwert
+31 58 234 30 47
+31 62 094 34 28 (privé)

skype: eduarddrenth
https://github.com/eduarddrenth
frisian.eu<http://frisian.eu>
gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth


Op freed bin ik thús/wurkje ik minder



_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open

--

Eduard Drenth, Software Architekt

ed...@fr...<mailto:ed...@fr...>

Doelestrjitte 8
8911 DX  Ljouwert
+31 58 234 30 47
+31 62 094 34 28 (privé)

skype: eduarddrenth
https://github.com/eduarddrenth
frisian.eu
gpg: https://pgp.surfnet.nl/pks/lookup?search=eduarddrenth


Op freed bin ik thús/wurkje ik minder

Re: [Exist-open] handling same path but multiple namespaces depending on data provider

[Guillaume M. <gui...@un...>]

Thank you for your responses!

   In the mean time I restart my jmeter testplan using wildcard. I saw 
no impact on performance. The code is less expressive but do not require 
multiple branches or modules to do its job.

I should do have a look on facets (and fields!) especially if it works 
on in memory documents.

Best regards,

--

Guillaume

Re: [Exist-open] handling same path but multiple namespaces depending on data provider

[Loren C. <lor...@gm...>]

I use the call:

let $is-foo := (functx:namespaces-in-use($xml-doc/node()) = "http://www.foo.com/bar")
I have a conditional and use a different function module based on one of the namespaces of the document.

> On Feb 4, 2021, at 12:08 PM, Joe Wicentowski <jo...@gm...> wrote:
> 
> Hi Guillaume,
> 
> Short of normalizing the data, namespace wildcards are the most general purpose solution for path expressions.
> 
> You can also use the local-name() function, e.g.,
> 
>   /*[local-name() eq "table"]/*[local-name() eq "tr"]/*[local-name() eq "td"]
> 
> To really be sure you're not inadvertently including other namespaces, you could declare all of the namespaces and explicitly select these in your node tests with the union operator:
> 
>   /(v12:table|v13:table|v14:table)/(v12:tr|v13:tr|v14:tr)/(v12:td/v13:td/v14:td)
> 
> It's hard to comment on performance concerns without knowing what kinds of queries you need to run, but you might consider eXist 5's fields and facets as part of your arsenal: you could construct a field with an expression that selects the content you need, and then you could query the field without worrying about which namespace the source came from. (I think.)
> 
> Joe
> 
> On Thu, Feb 4, 2021 at 11:26 AM Guillaume Mella <gui...@un... <mailto:gui...@un...>> wrote:
> Hello,
> 
>   I have a module which consumes VOTable (table/tr/td with meta data for Astronomy) using a standardised TableAccesProtocol. But depending on the data provider the returned document may get multiple namespaces depending on the version they implement, eg.:
> 
> declare namespace votable="http://www.ivoa.net/xml/VOTable/v1.2" <http://www.ivoa.net/xml/VOTable/v1.2>; (: could be v1.3 v1.4 :)
> 
> Most data part are the same in the various versions and I would like to support it dynamically without branching/duplication/copy.
> 
> I tried with the wildcard namespace using *:tag but didn't investigate to know more about performance issues.
> 
> Is there any best practices, hints or documentation pointers for such use case ?
> 
> 
> 
> Cheers,
> 
> --
> Guillaume Mella - Ingénieur CNRS
> OSUG UMS832 :  http://www.osug.fr <http://www.osug.fr/>  -  JMMC : http://www.jmmc.fr/~mellag <http://www.jmmc.fr/~mellag>
> OSUG-D, 122 rue de la piscine, 38 400 Saint Martin d’Hères, France
> ☎ +33 (0)4 76 63 58 22
> _______________________________________________
> Exist-open mailing list
> Exi...@li... <mailto:Exi...@li...>
> https://lists.sourceforge.net/lists/listinfo/exist-open <https://lists.sourceforge.net/lists/listinfo/exist-open>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open