exist-open — Open discussion

Re: [Exist-open] a very primitive question

[Craig B. <cra...@ma...>]

> On Feb 3, 2023, at 8:29 AM, Martin Mueller <mar...@no...> wrote:
> 
> Where on a Linux box is exist usually store, and how do you look for it?  This is a very primitive question by somebody who hasn’t yet mastered the complexities of the “find” command.

It's wherever you tell the installer to put it, with different default locations on different platforms.  If you know where the eXist application lives, you can look for it in your configuration:

$ grep 'files=' etc/conf.xml
                  files="/data/existdata">

or in your log file:

$ grep DATA_DIR logs/exist.log
2023-02-03 13:25:31,211 [main] INFO  (SyncTask.java [configure]:77) - Using DATA_DIR: /data/existdata. Minimal disk space required for database to continue operations: 1024mb

Note that "/data/existdata" is what I use but is not the default, which I believe is "data/" underneath the eXist home directory, which looks like it has "/opt/exist" as a default, but that too can be overridden at installation time.

On macOS, the default data directory is "~/Library/Application Support/org.exist".

________________________________________
Craig A. Berry

"... getting out of a sonnet is much more
 difficult than getting in."
                 Brad Leithauser

[Exist-open] implicit validation

[Eduard D. <ed...@fr...>]

Dear all,

Since exist-db supports xsd 1.1 this could be used for implicit validation.

Does anyone know of an existing solution to convert relaxng and/or schematron into xsd 1.1?

This will allow me to generate xsd 1.1 from odd in my build pipeline and use it for implicit validation.

If this isn't there yet I'll probably write it.

Regards,


Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:7be3a8f0-b5ce-4c03-9b1e-608e73d59e0c]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

Re: [Exist-open] a very primitive question

[Pieter L. <pie...@be...>]

Hi Martin,

We have our exist instances installed under 
*/usr/local/exist-distributions* with a symlink at */usr/local/exist-db* 
pointing to the active distribution. Our data is at 
*/usr/local**/exist-distributions/exist-data*, but I could image it 
being in */usr/local/exist-data* equally well. Whether this is standard 
practice I don't know and I don't know how to "find" it.

Best
Pieter

On 03/02/2023 15:29, Martin Mueller wrote:
>
> Where on a Linux box is exist usually store, and how do you look for 
> it?  This is a very primitive question by somebody who hasn’t yet 
> mastered the complexities of the “find” command.
>
> I couldn’t find it in the eXist documentation, but I probably didn’t 
>  look closely enough
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

-- 
Pieter Lamers
John Benjamins Publishing Company
Postal Address: P.O. Box 36224, 1020 ME AMSTERDAM, The Netherlands
Visiting Address: Klaprozenweg 75G, 1033 NN AMSTERDAM, The Netherlands
Warehouse: Kelvinstraat 11-13, 1446 TK PURMEREND, The Netherlands
tel: +31 20 630 4747
web:www.benjamins.com

[Exist-open] a very primitive question

[Martin M. <mar...@no...>]

Where on a Linux box is exist usually store, and how do you look for it?  This is a very primitive question by somebody who hasn’t yet mastered the complexities of the “find” command.

I couldn’t find it in the eXist documentation, but I probably didn’t  look closely enough

[Exist-open] CertAlias in 6.1.0's jetty-ssl-context.xml

[Craig B. <cra...@ma...>]

I had trouble getting the eXist admin interface working on port 8443 after upgrading to 6.1.0.  Usually all I have to do is convert my LetsEncrypt PEM certificate to PKCS12 format, copy that to /etc/jetty/keystore.p12, and update the password in etc/jetty/jetty-ssl-context.xml to the actual password I've added during the conversion.  That wasn't enough with 6.1.0, where connections failed and the browser said it was unable to create a secure connection.

With 6.1.0, the etc/jetty/jetty-ssl-context.xml file now contains this new section:

   <Set name="CertAlias">
      <Property name="jetty.keystore.alias" default="existdb"/>
   </Set>

This will only work if your certificate has an alias in it named "existdb" but mine didn't and I can't think of why anyone would since the certificate applies to the server, not a single application on that server.  No doubt certificate gurus will know how to generate a named alias during conversion from PEM to PCKS12, but my solution was simply to delete those three lines from jetty-ssl-context.xml -- that got things working as before.

Hope that helps someone who stumbles over the same thing.  There were no hints in the logs about what was happening -- I only found this by doing a diff comparing an old version of jetty-ssl-context.xml and eliminating anything new from the new version one section at a time until I happened on the one item that broke secure connections.

________________________________________
Craig A. Berry

"... getting out of a sonnet is much more
 difficult than getting in."
                 Brad Leithauser

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Joe W. <jo...@gm...>]

Hi Bernie,

Great, thanks for confirming that and testing with the exist namespace
prefix. I do not know if this serialization parameter is available in the
RESTXQ context.

Looking at the history of the RESTXQ serializer code, it appears that it's
had to be updated whenever new serialization properties have been added to
eXist. This suggests that if your code is not working, that RESTXQ has to
be updated to support this serialization property.

You might look into constructing your JSON with XQuery, instead of relying
on eXist's own XML-to-JSON serialization handling. (For reference, these
are the rules exist applies:
https://exist-db.org/exist/apps/wiki/blogs/eXist/JSONSerializer.)

Or as a real kludge, you could re-parse the serialized JSON:

```
xquery version "3.1";

declare namespace hdp="http://www.spase-group.org/data/schema";

let $node := <hdp:result xmlns="http://www.spase-group.org/data/schema">
            <hdp:collection>
                <hdp:resource>
                <Spase xmlns="http://www.spase-group.org/data/schema"
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://www.spase-group.org/data/schema
https://www.spase-group.org/data/schema/spase-2_4_0.xsd">
   <Version>2.4.0</Version>
   <NumericalData>
        <ResourceID>spase://NASA/NumericalData/ACE/CRIS/L2/PT1H</ResourceID>
        <ResourceHeader>
            <ResourceName>ACE Cosmic Ray Isotope Spectrometer (CRIS) 1-Hour
Level 2 Data</ResourceName>
            <DOI>https://doi.org/10.48322/g72t-0814</DOI>
            <ReleaseDate>2022-05-17T12:34:56.789</ReleaseDate>
        </ResourceHeader>
    </NumericalData>
</Spase></hdp:resource></hdp:collection></hdp:result>

let $serialized := serialize($node, map { "method": "json",
"exist:json-ignore-whitespace-text-nodes": true() })
return
    parse-json($serialized)
```

This returns:

```
map {
    "collection": map {
        "resource": map {
            "Spase": map {
                "xsi:schemaLocation": "
http://www.spase-group.org/data/schema
https://www.spase-group.org/data/schema/spase-2_4_0.xsd",
                "NumericalData": map {
                    "ResourceID":
"spase://NASA/NumericalData/ACE/CRIS/L2/PT1H",
                    "ResourceHeader": map {
                        "DOI": "https://doi.org/10.48322/g72t-0814",
                        "ResourceName": "ACE Cosmic Ray Isotope
Spectrometer (CRIS) 1-Hour Level 2 Data",
                        "ReleaseDate": "2022-05-17T12:34:56.789"
                    }
                },
                "Version": "2.4.0"
            }
        }
    }
}
```

Returning this in your RESTXQ function should work (though I haven't tested
it).

Joe

On Thu, Jan 26, 2023 at 1:57 PM Harris, Bernard T. (GSFC-5870) <
ber...@na...> wrote:

> And I still have the problem with
>
>                 <exist:json-ignore-whitespace-text-nodes value="yes" />
>
>
>
> Bernie
>
>
>
> *From: *"Harris, Bernard T. (GSFC-5870)" <ber...@na...>
> *Date: *Thursday, January 26, 2023 at 1:52 PM
> *To: *Joe Wicentowski <jo...@gm...>
> *Cc: *Exist-open <exi...@li...>
> *Subject: *Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>
>
>
> I saw it but did not think it was applicable since I was not explicitly
> calling serialize.  But just now, I added an extra line to my example
>
>
>
>         <rest:response>
>
>             <output:serialization-parameters>
>
>                 <output:method value="json" />
>
>                 <output:json-ignore-whitespace-text-nodes value="yes" />
>
>             </output:serialization-parameters>
>
>             <http:response>
>
>                 <http:header name="Content-Type" value="application/json"
> />
>
>             </http:response>
>
>         </rest:response>,
>
>
>
> And reran the test.  It does not change the output.  I still get a bunch
> of “#text” stuff.
>
>
>
> Bernie
>
>
>
> *From: *Joe Wicentowski <jo...@gm...>
> *Date: *Thursday, January 26, 2023 at 1:42 PM
> *To: *"Harris, Bernard T. (GSFC-5870)" <ber...@na...>
> *Cc: *Exist-open <exi...@li...>
> *Subject: *Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>
>
>
> Hi Bernie,
>
>
> Did you by chance see my earlier response with links to code demonstrating
> how to use the json-ignore-whitespace-text-nodes property?
>
>
>
> Joe
>
>
>
> On Thu, Jan 26, 2023 at 1:32 PM Harris, Bernard T. (GSFC-5870) <
> ber...@na...> wrote:
>
> https://cdaweb.gsfc.nasa.gov/registry/hdp/restxqJson-0.1.xar
>
> contains an example app that demonstrates my problem.  Once the
> application is install,
>
>
>
> $ curl http://localhost:8100/exist/restxq/test
>
> { "collection" : { "resource" : { "Spase" : { "xsi:schemaLocation" : http://www.spase-group.org/data/schema
> https://www.spase-group.org/data/schema/spase-2_4_0.xsd
> <https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.spase-group.org%2Fdata%2Fschema%2520https%3A%2Fwww.spase-group.org%2Fdata%2Fschema%2Fspase-2_4_0.xsd&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=JDLepR8iMWsG2SJ8bXCDAatYqmV9Y8CReHu99XeqE7U%3D&reserved=0>,
> "#text" : ["\n   ", "\n   ", "\n" ], "Version" : "2.4.0", "NumericalData" :
> { "#text" : ["\n        ", "\n        ", "\n    " ], "ResourceID" :
> "spase://NASA/NumericalData/ACE/CRIS/L2/PT1H", "ResourceHeader" : { "#text"
> : ["\n            ", "\n            ", "\n            ", "\n        " ],
> "ResourceName" : "ACE Cosmic Ray Isotope Spectrometer (CRIS) 1-Hour Level 2
> Data", "DOI" : https://doi.org/10.48322/g72t-0814
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdoi.org%2F10.48322%2Fg72t-0814&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=lGrJL%2BI77%2FMd%2F56pG93TJtx%2BxHHUNuFX7sfZMjUQAoA%3D&reserved=0>,
> "ReleaseDate" : "2022-05-17T12:34:56.789" } } } } }
>
>
>
> Demonstrates the problem.  If you change the code to
>
> let $example := 2
>
> so that the xml does not come from the db, the json will not contain all
> the “#text” stuff.  Let me know if you need anything else.  Thanks for
> looking at this.
>
>
>
> Bernie Harris
>
>
>
> *From: *"Harris, Bernard T. (GSFC-5870)" <ber...@na...>
> *Date: *Thursday, January 26, 2023 at 5:26 AM
> *To: *Joe Wicentowski <jo...@gm...>
> *Cc: *Exist-open <exi...@li...>
> *Subject: *Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>
>
>
> I’m still attempting to reproduce in a minimal amount of code but it is
> taking a lot of time.  But maybe just seeing the output will be enough for
> you to know what is wrong.  This is a RESTXQ application and I first
> noticed the problem on exist 6.0.1 but have also now reproduced it on 4.4.
> Here is a little bit of the output
>
>
>
> $ curl -s -H "Accept: application/json"
> http://localhost:8100/exist/restxq/Spase/NumericalData?ResourceID=spase://NASA/NumericalData/ACE/MAG/L2/PT16S
> |jq |head -15
>
> {
>
>   "collection": {
>
>     "resource": {
>
>       "Spase": {
>
>         "xsi:schemaLocation": http://www.spase-group.org/data/schema
> https://www.spase-group.org/data/schema/spase-2_3_2.xsd
> <https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.spase-group.org%2Fdata%2Fschema%2520%2520https%3A%2Fwww.spase-group.org%2Fdata%2Fschema%2Fspase-2_3_2.xsd&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=fIKPZfwfeBYomcQtNKigX4mnl95WBz1z9WhoIKBsU6E%3D&reserved=0>
> ,
>
>         "#text": [
>
>           "\n  ",
>
>           "\n  ",
>
>           "\n"
>
>         ],
>
>         "Version": "2.3.2",
>
>         "NumericalData": {
>
>           "#text": [
>
>             "\n    ",
>
>             "\n    ",
>
>
>
> The problem is all the extra #text values.  They don’t appear in the xml
> output.  Years ago when I developed something similar without RESTXQ, this
>
>
>
> declare option exist:serialize "json-ignore-whitespace-text-nodes=yes";
>
>
>
> eliminated the extra #text stuff.  But that does not work in my RESTXQ
> app. and it will take me more time to create a minimal RESTXQ example.  I
> would apricate any help you can give but understand if you need example
> code.
>
>
>
> Bernie
>
>
>
> *From: *Joe Wicentowski <jo...@gm...>
> *Date: *Wednesday, January 25, 2023 at 6:07 AM
> *To: *"Harris, Bernard T. (GSFC-5870)" <ber...@na...>
> *Cc: *Exist-open <exi...@li...>
> *Subject: *Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>
>
>
> Could you provide more info? How to reproduce? Expected vs. actual
> results? What version of eXist?
>
>
>
> On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via
> Exist-open <exi...@li...> wrote:
>
> I noticed the same thing.  But I was working with RESTXQ (and exist-db
> 6.0.1) for the first time and thought I might need to do things differently
> than the way it had worked in the past.  I would like to know if this is a
> bug or if there is a different way to accomplish the same thing.
>
>
>
> Bernie Harris
>
>
>
> *From: *Eduard Drenth <ed...@fr...>
> *Date: *Sunday, January 22, 2023 at 11:22 AM
> *To: *Exist-open <exi...@li...>
> *Subject: *[EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes
>
>
>
> json-ignore-whitespace-text-nodes not supported anymore?
>
>
>
>
>
>
>
> Eduard Drenth, Software Architekt
>
>
>
> ed...@fr...
>
>
>
> Doelestrjitte 8
>
> 8911 DX  Ljouwert
>
> (058) 213 14 14
>
> +31 62 094 34 28
>
> https://www.fryske-akademy.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=iKPW3w5hT7zCv%2F3FORRs7AbwmaNL%2F8Ll5EaNkkQIwns%3D&reserved=0>
>
> https://frysker.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=9eMUDr0ES2uRkRPhhe%2FVP33hpglV1%2B8Q10JBfpWss6M%3D&reserved=0>
>
> https://frisian.eu/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=%2B0l%2FnBilBZdzESuGGLthhiE2DERf%2BKAvBwJm3V%2FBZ3U%3D&reserved=0>
>
> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
> <https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpgp.key-server.io%2Fpks%2Flookup%3Fsearch%3Deduarddrenth&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=ilxi51ZR4iMEUnOL4MxFWG0jyflw5fmnaGXqq5KYqqA%3D&reserved=0>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fexist-open&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=T4finZMlulTU9YjweRgqGS84auNJj9ehC3SoKcoJtZ4%3D&reserved=0>
>
> --
>
> Sent from my iPhone
>
>

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Harris, B. T. (GSFC-5870) <ber...@na...>]

I saw it but did not think it was applicable since I was not explicitly calling serialize.  But just now, I added an extra line to my example

        <rest:response>
            <output:serialization-parameters>
                <output:method value="json" />
                <output:json-ignore-whitespace-text-nodes value="yes" />
            </output:serialization-parameters>
            <http:response>
                <http:header name="Content-Type" value="application/json" />
            </http:response>
        </rest:response>,

And reran the test.  It does not change the output.  I still get a bunch of “#text” stuff.

Bernie

From: Joe Wicentowski <jo...@gm...>
Date: Thursday, January 26, 2023 at 1:42 PM
To: "Harris, Bernard T. (GSFC-5870)" <ber...@na...>
Cc: Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Hi Bernie,

Did you by chance see my earlier response with links to code demonstrating how to use the json-ignore-whitespace-text-nodes property?

Joe

On Thu, Jan 26, 2023 at 1:32 PM Harris, Bernard T. (GSFC-5870) <ber...@na...<mailto:ber...@na...>> wrote:
https://cdaweb.gsfc.nasa.gov/registry/hdp/restxqJson-0.1.xar
contains an example app that demonstrates my problem.  Once the application is install,

$ curl http://localhost:8100/exist/restxq/test
{ "collection" : { "resource" : { "Spase" : { "xsi:schemaLocation" : http://www.spase-group.org/data/schema https://www.spase-group.org/data/schema/spase-2_4_0.xsd<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.spase-group.org%2Fdata%2Fschema%2520https%3A%2Fwww.spase-group.org%2Fdata%2Fschema%2Fspase-2_4_0.xsd&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=JDLepR8iMWsG2SJ8bXCDAatYqmV9Y8CReHu99XeqE7U%3D&reserved=0>, "#text" : ["\n   ", "\n   ", "\n" ], "Version" : "2.4.0", "NumericalData" : { "#text" : ["\n        ", "\n        ", "\n    " ], "ResourceID" : "spase://NASA/NumericalData/ACE/CRIS/L2/PT1H", "ResourceHeader" : { "#text" : ["\n            ", "\n            ", "\n            ", "\n        " ], "ResourceName" : "ACE Cosmic Ray Isotope Spectrometer (CRIS) 1-Hour Level 2 Data", "DOI" : https://doi.org/10.48322/g72t-0814<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdoi.org%2F10.48322%2Fg72t-0814&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=lGrJL%2BI77%2FMd%2F56pG93TJtx%2BxHHUNuFX7sfZMjUQAoA%3D&reserved=0>, "ReleaseDate" : "2022-05-17T12:34:56.789" } } } } }

Demonstrates the problem.  If you change the code to
let $example := 2
so that the xml does not come from the db, the json will not contain all the “#text” stuff.  Let me know if you need anything else.  Thanks for looking at this.

Bernie Harris

From: "Harris, Bernard T. (GSFC-5870)" <ber...@na...<mailto:ber...@na...>>
Date: Thursday, January 26, 2023 at 5:26 AM
To: Joe Wicentowski <jo...@gm...<mailto:jo...@gm...>>
Cc: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

I’m still attempting to reproduce in a minimal amount of code but it is taking a lot of time.  But maybe just seeing the output will be enough for you to know what is wrong.  This is a RESTXQ application and I first noticed the problem on exist 6.0.1 but have also now reproduced it on 4.4.  Here is a little bit of the output

$ curl -s -H "Accept: application/json" http://localhost:8100/exist/restxq/Spase/NumericalData?ResourceID=spase://NASA/NumericalData/ACE/MAG/L2/PT16S |jq |head -15
{
  "collection": {
    "resource": {
      "Spase": {
        "xsi:schemaLocation": http://www.spase-group.org/data/schema  https://www.spase-group.org/data/schema/spase-2_3_2.xsd<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.spase-group.org%2Fdata%2Fschema%2520%2520https%3A%2Fwww.spase-group.org%2Fdata%2Fschema%2Fspase-2_3_2.xsd&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=fIKPZfwfeBYomcQtNKigX4mnl95WBz1z9WhoIKBsU6E%3D&reserved=0>,
        "#text": [
          "\n  ",
          "\n  ",
          "\n"
        ],
        "Version": "2.3.2",
        "NumericalData": {
          "#text": [
            "\n    ",
            "\n    ",

The problem is all the extra #text values.  They don’t appear in the xml output.  Years ago when I developed something similar without RESTXQ, this

declare option exist:serialize "json-ignore-whitespace-text-nodes=yes";

eliminated the extra #text stuff.  But that does not work in my RESTXQ app. and it will take me more time to create a minimal RESTXQ example.  I would apricate any help you can give but understand if you need example code.

Bernie

From: Joe Wicentowski <jo...@gm...<mailto:jo...@gm...>>
Date: Wednesday, January 25, 2023 at 6:07 AM
To: "Harris, Bernard T. (GSFC-5870)" <ber...@na...<mailto:ber...@na...>>
Cc: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Could you provide more info? How to reproduce? Expected vs. actual results? What version of eXist?

On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via Exist-open <exi...@li...<mailto:exi...@li...>> wrote:
I noticed the same thing.  But I was working with RESTXQ (and exist-db 6.0.1) for the first time and thought I might need to do things differently than the way it had worked in the past.  I would like to know if this is a bug or if there is a different way to accomplish the same thing.

Bernie Harris

From: Eduard Drenth <ed...@fr...<mailto:ed...@fr...>>
Date: Sunday, January 22, 2023 at 11:22 AM
To: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: [EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes

json-ignore-whitespace-text-nodes not supported anymore?




Eduard Drenth, Software Architekt



ed...@fr...<mailto:ed...@fr...>



Doelestrjitte 8

8911 DX  Ljouwert
(058) 213 14 14

+31 62 094 34 28
https://www.fryske-akademy.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=iKPW3w5hT7zCv%2F3FORRs7AbwmaNL%2F8Ll5EaNkkQIwns%3D&reserved=0>
https://frysker.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=9eMUDr0ES2uRkRPhhe%2FVP33hpglV1%2B8Q10JBfpWss6M%3D&reserved=0>
https://frisian.eu/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=%2B0l%2FnBilBZdzESuGGLthhiE2DERf%2BKAvBwJm3V%2FBZ3U%3D&reserved=0>
[cid:image001.png@01D9318D.5D986B00]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpgp.key-server.io%2Fpks%2Flookup%3Fsearch%3Deduarddrenth&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=ilxi51ZR4iMEUnOL4MxFWG0jyflw5fmnaGXqq5KYqqA%3D&reserved=0>
_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fexist-open&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=T4finZMlulTU9YjweRgqGS84auNJj9ehC3SoKcoJtZ4%3D&reserved=0>
--
Sent from my iPhone

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Harris, B. T. (GSFC-5870) <ber...@na...>]

And I still have the problem with
                <exist:json-ignore-whitespace-text-nodes value="yes" />

Bernie

From: "Harris, Bernard T. (GSFC-5870)" <ber...@na...>
Date: Thursday, January 26, 2023 at 1:52 PM
To: Joe Wicentowski <jo...@gm...>
Cc: Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

I saw it but did not think it was applicable since I was not explicitly calling serialize.  But just now, I added an extra line to my example

        <rest:response>
            <output:serialization-parameters>
                <output:method value="json" />
                <output:json-ignore-whitespace-text-nodes value="yes" />
            </output:serialization-parameters>
            <http:response>
                <http:header name="Content-Type" value="application/json" />
            </http:response>
        </rest:response>,

And reran the test.  It does not change the output.  I still get a bunch of “#text” stuff.

Bernie

From: Joe Wicentowski <jo...@gm...>
Date: Thursday, January 26, 2023 at 1:42 PM
To: "Harris, Bernard T. (GSFC-5870)" <ber...@na...>
Cc: Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Hi Bernie,

Did you by chance see my earlier response with links to code demonstrating how to use the json-ignore-whitespace-text-nodes property?

Joe

On Thu, Jan 26, 2023 at 1:32 PM Harris, Bernard T. (GSFC-5870) <ber...@na...<mailto:ber...@na...>> wrote:
https://cdaweb.gsfc.nasa.gov/registry/hdp/restxqJson-0.1.xar
contains an example app that demonstrates my problem.  Once the application is install,

$ curl http://localhost:8100/exist/restxq/test
{ "collection" : { "resource" : { "Spase" : { "xsi:schemaLocation" : http://www.spase-group.org/data/schema https://www.spase-group.org/data/schema/spase-2_4_0.xsd<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.spase-group.org%2Fdata%2Fschema%2520https%3A%2Fwww.spase-group.org%2Fdata%2Fschema%2Fspase-2_4_0.xsd&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=JDLepR8iMWsG2SJ8bXCDAatYqmV9Y8CReHu99XeqE7U%3D&reserved=0>, "#text" : ["\n   ", "\n   ", "\n" ], "Version" : "2.4.0", "NumericalData" : { "#text" : ["\n        ", "\n        ", "\n    " ], "ResourceID" : "spase://NASA/NumericalData/ACE/CRIS/L2/PT1H", "ResourceHeader" : { "#text" : ["\n            ", "\n            ", "\n            ", "\n        " ], "ResourceName" : "ACE Cosmic Ray Isotope Spectrometer (CRIS) 1-Hour Level 2 Data", "DOI" : https://doi.org/10.48322/g72t-0814<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdoi.org%2F10.48322%2Fg72t-0814&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=lGrJL%2BI77%2FMd%2F56pG93TJtx%2BxHHUNuFX7sfZMjUQAoA%3D&reserved=0>, "ReleaseDate" : "2022-05-17T12:34:56.789" } } } } }

Demonstrates the problem.  If you change the code to
let $example := 2
so that the xml does not come from the db, the json will not contain all the “#text” stuff.  Let me know if you need anything else.  Thanks for looking at this.

Bernie Harris

From: "Harris, Bernard T. (GSFC-5870)" <ber...@na...<mailto:ber...@na...>>
Date: Thursday, January 26, 2023 at 5:26 AM
To: Joe Wicentowski <jo...@gm...<mailto:jo...@gm...>>
Cc: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

I’m still attempting to reproduce in a minimal amount of code but it is taking a lot of time.  But maybe just seeing the output will be enough for you to know what is wrong.  This is a RESTXQ application and I first noticed the problem on exist 6.0.1 but have also now reproduced it on 4.4.  Here is a little bit of the output

$ curl -s -H "Accept: application/json" http://localhost:8100/exist/restxq/Spase/NumericalData?ResourceID=spase://NASA/NumericalData/ACE/MAG/L2/PT16S |jq |head -15
{
  "collection": {
    "resource": {
      "Spase": {
        "xsi:schemaLocation": http://www.spase-group.org/data/schema  https://www.spase-group.org/data/schema/spase-2_3_2.xsd<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.spase-group.org%2Fdata%2Fschema%2520%2520https%3A%2Fwww.spase-group.org%2Fdata%2Fschema%2Fspase-2_3_2.xsd&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=fIKPZfwfeBYomcQtNKigX4mnl95WBz1z9WhoIKBsU6E%3D&reserved=0>,
        "#text": [
          "\n  ",
          "\n  ",
          "\n"
        ],
        "Version": "2.3.2",
        "NumericalData": {
          "#text": [
            "\n    ",
            "\n    ",

The problem is all the extra #text values.  They don’t appear in the xml output.  Years ago when I developed something similar without RESTXQ, this

declare option exist:serialize "json-ignore-whitespace-text-nodes=yes";

eliminated the extra #text stuff.  But that does not work in my RESTXQ app. and it will take me more time to create a minimal RESTXQ example.  I would apricate any help you can give but understand if you need example code.

Bernie

From: Joe Wicentowski <jo...@gm...<mailto:jo...@gm...>>
Date: Wednesday, January 25, 2023 at 6:07 AM
To: "Harris, Bernard T. (GSFC-5870)" <ber...@na...<mailto:ber...@na...>>
Cc: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Could you provide more info? How to reproduce? Expected vs. actual results? What version of eXist?

On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via Exist-open <exi...@li...<mailto:exi...@li...>> wrote:
I noticed the same thing.  But I was working with RESTXQ (and exist-db 6.0.1) for the first time and thought I might need to do things differently than the way it had worked in the past.  I would like to know if this is a bug or if there is a different way to accomplish the same thing.

Bernie Harris

From: Eduard Drenth <ed...@fr...<mailto:ed...@fr...>>
Date: Sunday, January 22, 2023 at 11:22 AM
To: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: [EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes

json-ignore-whitespace-text-nodes not supported anymore?




Eduard Drenth, Software Architekt



ed...@fr...<mailto:ed...@fr...>



Doelestrjitte 8

8911 DX  Ljouwert
(058) 213 14 14

+31 62 094 34 28
https://www.fryske-akademy.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=iKPW3w5hT7zCv%2F3FORRs7AbwmaNL%2F8Ll5EaNkkQIwns%3D&reserved=0>
https://frysker.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=9eMUDr0ES2uRkRPhhe%2FVP33hpglV1%2B8Q10JBfpWss6M%3D&reserved=0>
https://frisian.eu/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=%2B0l%2FnBilBZdzESuGGLthhiE2DERf%2BKAvBwJm3V%2FBZ3U%3D&reserved=0>
[cid:image001.png@01D9318E.2445EDE0]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpgp.key-server.io%2Fpks%2Flookup%3Fsearch%3Deduarddrenth&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=ilxi51ZR4iMEUnOL4MxFWG0jyflw5fmnaGXqq5KYqqA%3D&reserved=0>
_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fexist-open&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C8eef6bc44fc249de20b008daffccc15d%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638103553796310665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=T4finZMlulTU9YjweRgqGS84auNJj9ehC3SoKcoJtZ4%3D&reserved=0>
--
Sent from my iPhone

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Harris, B. T. (GSFC-5870) <ber...@na...>]

https://cdaweb.gsfc.nasa.gov/registry/hdp/restxqJson-0.1.xar
contains an example app that demonstrates my problem.  Once the application is install,

$ curl http://localhost:8100/exist/restxq/test
{ "collection" : { "resource" : { "Spase" : { "xsi:schemaLocation" : http://www.spase-group.org/data/schema https://www.spase-group.org/data/schema/spase-2_4_0.xsd<http://www.spase-group.org/data/schema%20https:/www.spase-group.org/data/schema/spase-2_4_0.xsd>, "#text" : ["\n   ", "\n   ", "\n" ], "Version" : "2.4.0", "NumericalData" : { "#text" : ["\n        ", "\n        ", "\n    " ], "ResourceID" : "spase://NASA/NumericalData/ACE/CRIS/L2/PT1H", "ResourceHeader" : { "#text" : ["\n            ", "\n            ", "\n            ", "\n        " ], "ResourceName" : "ACE Cosmic Ray Isotope Spectrometer (CRIS) 1-Hour Level 2 Data", "DOI" : https://doi.org/10.48322/g72t-0814, "ReleaseDate" : "2022-05-17T12:34:56.789" } } } } }

Demonstrates the problem.  If you change the code to
let $example := 2
so that the xml does not come from the db, the json will not contain all the “#text” stuff.  Let me know if you need anything else.  Thanks for looking at this.

Bernie Harris

From: "Harris, Bernard T. (GSFC-5870)" <ber...@na...>
Date: Thursday, January 26, 2023 at 5:26 AM
To: Joe Wicentowski <jo...@gm...>
Cc: Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

I’m still attempting to reproduce in a minimal amount of code but it is taking a lot of time.  But maybe just seeing the output will be enough for you to know what is wrong.  This is a RESTXQ application and I first noticed the problem on exist 6.0.1 but have also now reproduced it on 4.4.  Here is a little bit of the output

$ curl -s -H "Accept: application/json" http://localhost:8100/exist/restxq/Spase/NumericalData?ResourceID=spase://NASA/NumericalData/ACE/MAG/L2/PT16S |jq |head -15
{
  "collection": {
    "resource": {
      "Spase": {
        "xsi:schemaLocation": http://www.spase-group.org/data/schema  https://www.spase-group.org/data/schema/spase-2_3_2.xsd<http://www.spase-group.org/data/schema%20%20https:/www.spase-group.org/data/schema/spase-2_3_2.xsd>,
        "#text": [
          "\n  ",
          "\n  ",
          "\n"
        ],
        "Version": "2.3.2",
        "NumericalData": {
          "#text": [
            "\n    ",
            "\n    ",

The problem is all the extra #text values.  They don’t appear in the xml output.  Years ago when I developed something similar without RESTXQ, this

declare option exist:serialize "json-ignore-whitespace-text-nodes=yes";

eliminated the extra #text stuff.  But that does not work in my RESTXQ app. and it will take me more time to create a minimal RESTXQ example.  I would apricate any help you can give but understand if you need example code.

Bernie

From: Joe Wicentowski <jo...@gm...>
Date: Wednesday, January 25, 2023 at 6:07 AM
To: "Harris, Bernard T. (GSFC-5870)" <ber...@na...>
Cc: Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Could you provide more info? How to reproduce? Expected vs. actual results? What version of eXist?

On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via Exist-open <exi...@li...<mailto:exi...@li...>> wrote:
I noticed the same thing.  But I was working with RESTXQ (and exist-db 6.0.1) for the first time and thought I might need to do things differently than the way it had worked in the past.  I would like to know if this is a bug or if there is a different way to accomplish the same thing.

Bernie Harris

From: Eduard Drenth <ed...@fr...<mailto:ed...@fr...>>
Date: Sunday, January 22, 2023 at 11:22 AM
To: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: [EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes

json-ignore-whitespace-text-nodes not supported anymore?




Eduard Drenth, Software Architekt



ed...@fr...<mailto:ed...@fr...>



Doelestrjitte 8

8911 DX  Ljouwert
(058) 213 14 14

+31 62 094 34 28
https://www.fryske-akademy.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=0O1QGHF%2FoYAWVIsHuJpNXaBG5Pwmyt41aNnjYAtEt7I%3D&reserved=0>
https://frysker.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=y%2F5CFfYDWLmNlEf8MfDuI2zr6SWF%2FQY8R8bnttYLGzo%3D&reserved=0>
https://frisian.eu/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=suopw7zfA7r3EW4%2FFt1aLlEMe2iQl%2BjX7JREqXeT7uw%3D&reserved=0>
[cid:image001.png@01D9318A.A0B62600]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpgp.key-server.io%2Fpks%2Flookup%3Fsearch%3Deduarddrenth&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=XcyiU9dnfYQGMDlFxq%2FUZKND0Xmo4xkbFq3lv5nqwa8%3D&reserved=0>
_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fexist-open&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bvDGOROh5LtgzYwxDnv8NHx7lgfsZFPUVTfD6BRYL5k%3D&reserved=0>
--
Sent from my iPhone

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Joe W. <jo...@gm...>]

Hi Bernie,

Did you by chance see my earlier response with links to code demonstrating
how to use the json-ignore-whitespace-text-nodes property?

Joe

On Thu, Jan 26, 2023 at 1:32 PM Harris, Bernard T. (GSFC-5870) <
ber...@na...> wrote:

> https://cdaweb.gsfc.nasa.gov/registry/hdp/restxqJson-0.1.xar
>
> contains an example app that demonstrates my problem.  Once the
> application is install,
>
>
>
> $ curl http://localhost:8100/exist/restxq/test
>
> { "collection" : { "resource" : { "Spase" : { "xsi:schemaLocation" : http://www.spase-group.org/data/schema
> https://www.spase-group.org/data/schema/spase-2_4_0.xsd
> <http://www.spase-group.org/data/schema%20https:/www.spase-group.org/data/schema/spase-2_4_0.xsd>,
> "#text" : ["\n   ", "\n   ", "\n" ], "Version" : "2.4.0", "NumericalData" :
> { "#text" : ["\n        ", "\n        ", "\n    " ], "ResourceID" :
> "spase://NASA/NumericalData/ACE/CRIS/L2/PT1H", "ResourceHeader" : { "#text"
> : ["\n            ", "\n            ", "\n            ", "\n        " ],
> "ResourceName" : "ACE Cosmic Ray Isotope Spectrometer (CRIS) 1-Hour Level 2
> Data", "DOI" : https://doi.org/10.48322/g72t-0814, "ReleaseDate" :
> "2022-05-17T12:34:56.789" } } } } }
>
>
>
> Demonstrates the problem.  If you change the code to
>
> let $example := 2
>
> so that the xml does not come from the db, the json will not contain all
> the “#text” stuff.  Let me know if you need anything else.  Thanks for
> looking at this.
>
>
>
> Bernie Harris
>
>
>
> *From: *"Harris, Bernard T. (GSFC-5870)" <ber...@na...>
> *Date: *Thursday, January 26, 2023 at 5:26 AM
> *To: *Joe Wicentowski <jo...@gm...>
> *Cc: *Exist-open <exi...@li...>
> *Subject: *Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>
>
>
> I’m still attempting to reproduce in a minimal amount of code but it is
> taking a lot of time.  But maybe just seeing the output will be enough for
> you to know what is wrong.  This is a RESTXQ application and I first
> noticed the problem on exist 6.0.1 but have also now reproduced it on 4.4.
> Here is a little bit of the output
>
>
>
> $ curl -s -H "Accept: application/json"
> http://localhost:8100/exist/restxq/Spase/NumericalData?ResourceID=spase://NASA/NumericalData/ACE/MAG/L2/PT16S
> |jq |head -15
>
> {
>
>   "collection": {
>
>     "resource": {
>
>       "Spase": {
>
>         "xsi:schemaLocation": http://www.spase-group.org/data/schema
> https://www.spase-group.org/data/schema/spase-2_3_2.xsd
> <http://www.spase-group.org/data/schema%20%20https:/www.spase-group.org/data/schema/spase-2_3_2.xsd>
> ,
>
>         "#text": [
>
>           "\n  ",
>
>           "\n  ",
>
>           "\n"
>
>         ],
>
>         "Version": "2.3.2",
>
>         "NumericalData": {
>
>           "#text": [
>
>             "\n    ",
>
>             "\n    ",
>
>
>
> The problem is all the extra #text values.  They don’t appear in the xml
> output.  Years ago when I developed something similar without RESTXQ, this
>
>
>
> declare option exist:serialize "json-ignore-whitespace-text-nodes=yes";
>
>
>
> eliminated the extra #text stuff.  But that does not work in my RESTXQ
> app. and it will take me more time to create a minimal RESTXQ example.  I
> would apricate any help you can give but understand if you need example
> code.
>
>
>
> Bernie
>
>
>
> *From: *Joe Wicentowski <jo...@gm...>
> *Date: *Wednesday, January 25, 2023 at 6:07 AM
> *To: *"Harris, Bernard T. (GSFC-5870)" <ber...@na...>
> *Cc: *Exist-open <exi...@li...>
> *Subject: *Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>
>
>
> Could you provide more info? How to reproduce? Expected vs. actual
> results? What version of eXist?
>
>
>
> On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via
> Exist-open <exi...@li...> wrote:
>
> I noticed the same thing.  But I was working with RESTXQ (and exist-db
> 6.0.1) for the first time and thought I might need to do things differently
> than the way it had worked in the past.  I would like to know if this is a
> bug or if there is a different way to accomplish the same thing.
>
>
>
> Bernie Harris
>
>
>
> *From: *Eduard Drenth <ed...@fr...>
> *Date: *Sunday, January 22, 2023 at 11:22 AM
> *To: *Exist-open <exi...@li...>
> *Subject: *[EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes
>
>
>
> json-ignore-whitespace-text-nodes not supported anymore?
>
>
>
>
>
>
>
> Eduard Drenth, Software Architekt
>
>
>
> ed...@fr...
>
>
>
> Doelestrjitte 8
>
> 8911 DX  Ljouwert
>
> (058) 213 14 14
>
> +31 62 094 34 28
>
> https://www.fryske-akademy.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=0O1QGHF%2FoYAWVIsHuJpNXaBG5Pwmyt41aNnjYAtEt7I%3D&reserved=0>
>
> https://frysker.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=y%2F5CFfYDWLmNlEf8MfDuI2zr6SWF%2FQY8R8bnttYLGzo%3D&reserved=0>
>
> https://frisian.eu/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=suopw7zfA7r3EW4%2FFt1aLlEMe2iQl%2BjX7JREqXeT7uw%3D&reserved=0>
>
> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
> <https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpgp.key-server.io%2Fpks%2Flookup%3Fsearch%3Deduarddrenth&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=XcyiU9dnfYQGMDlFxq%2FUZKND0Xmo4xkbFq3lv5nqwa8%3D&reserved=0>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fexist-open&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bvDGOROh5LtgzYwxDnv8NHx7lgfsZFPUVTfD6BRYL5k%3D&reserved=0>
>
> --
>
> Sent from my iPhone
>

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Harris, B. T. (GSFC-5870) <ber...@na...>]

I’m still attempting to reproduce in a minimal amount of code but it is taking a lot of time.  But maybe just seeing the output will be enough for you to know what is wrong.  This is a RESTXQ application and I first noticed the problem on exist 6.0.1 but have also now reproduced it on 4.4.  Here is a little bit of the output

$ curl -s -H "Accept: application/json" http://localhost:8100/exist/restxq/Spase/NumericalData?ResourceID=spase://NASA/NumericalData/ACE/MAG/L2/PT16S |jq |head -15
{
  "collection": {
    "resource": {
      "Spase": {
        "xsi:schemaLocation": http://www.spase-group.org/data/schema  https://www.spase-group.org/data/schema/spase-2_3_2.xsd<http://www.spase-group.org/data/schema%20%20https:/www.spase-group.org/data/schema/spase-2_3_2.xsd>,
        "#text": [
          "\n  ",
          "\n  ",
          "\n"
        ],
        "Version": "2.3.2",
        "NumericalData": {
          "#text": [
            "\n    ",
            "\n    ",

The problem is all the extra #text values.  They don’t appear in the xml output.  Years ago when I developed something similar without RESTXQ, this

declare option exist:serialize "json-ignore-whitespace-text-nodes=yes";

eliminated the extra #text stuff.  But that does not work in my RESTXQ app. and it will take me more time to create a minimal RESTXQ example.  I would apricate any help you can give but understand if you need example code.

Bernie

From: Joe Wicentowski <jo...@gm...>
Date: Wednesday, January 25, 2023 at 6:07 AM
To: "Harris, Bernard T. (GSFC-5870)" <ber...@na...>
Cc: Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Could you provide more info? How to reproduce? Expected vs. actual results? What version of eXist?

On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via Exist-open <exi...@li...<mailto:exi...@li...>> wrote:
I noticed the same thing.  But I was working with RESTXQ (and exist-db 6.0.1) for the first time and thought I might need to do things differently than the way it had worked in the past.  I would like to know if this is a bug or if there is a different way to accomplish the same thing.

Bernie Harris

From: Eduard Drenth <ed...@fr...<mailto:ed...@fr...>>
Date: Sunday, January 22, 2023 at 11:22 AM
To: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: [EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes

json-ignore-whitespace-text-nodes not supported anymore?




Eduard Drenth, Software Architekt



ed...@fr...<mailto:ed...@fr...>



Doelestrjitte 8

8911 DX  Ljouwert
(058) 213 14 14

+31 62 094 34 28
https://www.fryske-akademy.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=0O1QGHF%2FoYAWVIsHuJpNXaBG5Pwmyt41aNnjYAtEt7I%3D&reserved=0>
https://frysker.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=y%2F5CFfYDWLmNlEf8MfDuI2zr6SWF%2FQY8R8bnttYLGzo%3D&reserved=0>
https://frisian.eu/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=suopw7zfA7r3EW4%2FFt1aLlEMe2iQl%2BjX7JREqXeT7uw%3D&reserved=0>
[cid:image001.png@01D93146.B2DEADF0]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpgp.key-server.io%2Fpks%2Flookup%3Fsearch%3Deduarddrenth&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=XcyiU9dnfYQGMDlFxq%2FUZKND0Xmo4xkbFq3lv5nqwa8%3D&reserved=0>
_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fexist-open&data=05%7C01%7Cbernard.t.harris%40nasa.gov%7C7e5a6f8b6e754f7436e608dafec43f34%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638102416673638149%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bvDGOROh5LtgzYwxDnv8NHx7lgfsZFPUVTfD6BRYL5k%3D&reserved=0>
--
Sent from my iPhone

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Eduard D. <ed...@fr...>]

Thanks for your response, it pointed me to what the problem was:


output:json-ignore-whitespace-text-nodes => exist:json-ignore-whitespace-text-nodes

Regards,


Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:f4170f80-6d2d-410c-b4fc-1d1f1430a12a]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

________________________________
From: Joe Wicentowski <jo...@gm...>
Sent: Wednesday, January 25, 2023 7:46 PM
To: Eduard Drenth <ed...@fr...>
Cc: Harris, Bernard T. (GSFC-5870) <ber...@na...>; Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Hi Eduard,

By examining the tests included in the eXist source, I found an example that exercises the serialization method that you're using. Here's code that demonstrates how to use it.

  https://gist.github.com/joewiz/4f06d44794a268d2b262034b31eac5c4

The relevant PR that enabled the use of these eXist-specific serialization methods in fn:serialize() is:

  https://github.com/eXist-db/exist/issues/2394

Joe


On Wed, Jan 25, 2023 at 12:46 PM Joe Wicentowski <jo...@gm...<mailto:jo...@gm...>> wrote:
Besides your script not failing, what is the actual expected result?

On Wed, Jan 25, 2023 at 10:03 AM Eduard Drenth <ed...@fr...<mailto:ed...@fr...>> wrote:

declare variable $teidictjson:jsonparams := <output:serialization-parameters xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization">

  <output:method value="json"/>
  <output:json-ignore-whitespace-text-nodes value="yes"/>
</output:serialization-parameters>;

fn:serialize(<noresults>no results</noresults>,$teidictjson:jsonparams)

In 6.1.0 the above fails




Eduard Drenth, Software Architekt


ed...@fr...<mailto:ed...@fr...>


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:185ea095e6fbabbb33e2]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth<http://pgp.key-server.io/pks/lookup?search=eduarddrenth>

________________________________
From: Joe Wicentowski <jo...@gm...<mailto:jo...@gm...>>
Sent: Wednesday, January 25, 2023 12:06 PM
To: Harris, Bernard T. (GSFC-5870) <ber...@na...<mailto:ber...@na...>>
Cc: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Could you provide more info? How to reproduce? Expected vs. actual results? What version of eXist?

On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via Exist-open <exi...@li...<mailto:exi...@li...>> wrote:

I noticed the same thing.  But I was working with RESTXQ (and exist-db 6.0.1) for the first time and thought I might need to do things differently than the way it had worked in the past.  I would like to know if this is a bug or if there is a different way to accomplish the same thing.



Bernie Harris



From: Eduard Drenth <ed...@fr...<mailto:ed...@fr...>>
Date: Sunday, January 22, 2023 at 11:22 AM
To: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: [EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes



json-ignore-whitespace-text-nodes not supported anymore?







Eduard Drenth, Software Architekt



ed...@fr...<mailto:ed...@fr...>



Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=GHeHpN59VC5xjXYZv%2FTqgld4HFzVtNe4O0eZnJRM4og%3D&reserved=0>

https://frysker.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=VLqoS94QI7sj5wR0WQ%2FLz20atSzleWdn7HMydkykkF0%3D&reserved=0>

https://frisian.eu/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=NZHee7QsEXzXI0OmaS7aEhIX%2BTCUlil3o9icruakOGY%3D&reserved=0>

[cid:185ea095e6f4cff311]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth<http://pgp.key-server.io/pks/lookup?search=eduarddrenth>

_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open
--
Sent from my iPhone

Re: [Exist-open] performance 6.1.0

[Adam R. <ad...@ex...>]

Regards XSLT it should not be... However I was investigating an issue
whereby twice as much work for XSLT compilation is done -
https://github.com/eXist-db/exist/issues/4691

On Mon, 23 Jan 2023, 13:27 Eduard Drenth, <ed...@fr...> wrote:

> Dear all,
>
> Can it be that 6.1.0 exist-db is significantly slower (twice as slow at
> least) compared to 6.0.1?
>
> I am running:
>
>
>
>
> Eduard Drenth, Software Architekt
>
>
> ed...@fr...
>
>
> Doelestrjitte 8
>
> 8911 DX  Ljouwert
> (058) 213 14 14
>
> +31 62 094 34 28
> https://www.fryske-akademy.nl/
> https://frysker.nl/
> https://frisian.eu/
>
> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

Re: [Exist-open] performance 6.1.0

[Eduard D. <ed...@fr...>]

More specific performance question as follow-up on the previous.

For one of my apps I use xslt to output html, it is being called many times with different nodes as input.

The xslt is rather simple, no expensive stuff.

In my module I "cache" the stylesheet like this:


declare variable $teidictapp:teiToHtmlxslt := doc($config:app-root||"/teiToHtml.xslt");

The many calls to this stylesheet make up a big portion of total processing time.

Are there ways to speed up xslt processing in exist-db?

Are stylesheets cached and templates reused under the hood in Java?


Regards,


Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:ba445708-3750-4b0a-a408-338f86bead3a]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

________________________________
From: Eduard Drenth <ed...@fr...>
Sent: Monday, January 23, 2023 1:51 PM
To: Exist-open <exi...@li...>
Subject: [Exist-open] performance 6.1.0

Dear all,

Can it be that 6.1.0 exist-db is significantly slower (twice as slow at least) compared to 6.0.1?

I am running:

[cid:4551aa26-680a-4f73-a0cd-9d07c07efee9]



Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:3ae03765-821d-44e7-b05c-bf70259d6d51]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Joe W. <jo...@gm...>]

Hi Eduard,

By examining the tests included in the eXist source, I found an example
that exercises the serialization method that you're using. Here's code that
demonstrates how to use it.

  https://gist.github.com/joewiz/4f06d44794a268d2b262034b31eac5c4

The relevant PR that enabled the use of these eXist-specific serialization
methods in fn:serialize() is:

  https://github.com/eXist-db/exist/issues/2394

Joe


On Wed, Jan 25, 2023 at 12:46 PM Joe Wicentowski <jo...@gm...> wrote:

> Besides your script not failing, what is the actual expected result?
>
> On Wed, Jan 25, 2023 at 10:03 AM Eduard Drenth <ed...@fr...>
> wrote:
>
>> declare variable $teidictjson:jsonparams := <output:serialization-parameters xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization">
>>
>>   <output:method value="json"/>
>>   <output:json-ignore-whitespace-text-nodes value="yes"/>
>> </output:serialization-parameters>;
>>
>> fn:serialize(<noresults>no results</noresults>,$teidictjson:jsonparams)
>>
>> In 6.1.0 the above fails
>>
>>
>>
>> Eduard Drenth, Software Architekt
>>
>>
>> ed...@fr...
>>
>>
>> Doelestrjitte 8
>>
>> 8911 DX  Ljouwert
>> (058) 213 14 14
>>
>> +31 62 094 34 28
>> https://www.fryske-akademy.nl/
>> https://frysker.nl/
>> https://frisian.eu/
>>
>> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
>> ------------------------------
>> *From:* Joe Wicentowski <jo...@gm...>
>> *Sent:* Wednesday, January 25, 2023 12:06 PM
>> *To:* Harris, Bernard T. (GSFC-5870) <ber...@na...>
>> *Cc:* Exist-open <exi...@li...>
>> *Subject:* Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>>
>> Could you provide more info? How to reproduce? Expected vs. actual
>> results? What version of eXist?
>>
>> On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via
>> Exist-open <exi...@li...> wrote:
>>
>> I noticed the same thing.  But I was working with RESTXQ (and exist-db
>> 6.0.1) for the first time and thought I might need to do things differently
>> than the way it had worked in the past.  I would like to know if this is a
>> bug or if there is a different way to accomplish the same thing.
>>
>>
>>
>> Bernie Harris
>>
>>
>>
>> *From: *Eduard Drenth <ed...@fr...>
>> *Date: *Sunday, January 22, 2023 at 11:22 AM
>> *To: *Exist-open <exi...@li...>
>> *Subject: *[EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes
>>
>>
>>
>> json-ignore-whitespace-text-nodes not supported anymore?
>>
>>
>>
>>
>>
>>
>>
>> Eduard Drenth, Software Architekt
>>
>>
>>
>> ed...@fr...
>>
>>
>>
>> Doelestrjitte 8
>>
>> 8911 DX  Ljouwert
>>
>> (058) 213 14 14
>>
>> +31 62 094 34 28
>>
>> https://www.fryske-akademy.nl/
>> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=GHeHpN59VC5xjXYZv%2FTqgld4HFzVtNe4O0eZnJRM4og%3D&reserved=0>
>>
>> https://frysker.nl/
>> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=VLqoS94QI7sj5wR0WQ%2FLz20atSzleWdn7HMydkykkF0%3D&reserved=0>
>>
>> https://frisian.eu/
>> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=NZHee7QsEXzXI0OmaS7aEhIX%2BTCUlil3o9icruakOGY%3D&reserved=0>
>>
>> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li...
>> https://lists.sourceforge.net/lists/listinfo/exist-open
>>
>> --
>> Sent from my iPhone
>>
>

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Joe W. <jo...@gm...>]

Besides your script not failing, what is the actual expected result?

On Wed, Jan 25, 2023 at 10:03 AM Eduard Drenth <ed...@fr...>
wrote:

> declare variable $teidictjson:jsonparams := <output:serialization-parameters xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization">
>
>   <output:method value="json"/>
>   <output:json-ignore-whitespace-text-nodes value="yes"/>
> </output:serialization-parameters>;
>
> fn:serialize(<noresults>no results</noresults>,$teidictjson:jsonparams)
>
> In 6.1.0 the above fails
>
>
>
> Eduard Drenth, Software Architekt
>
>
> ed...@fr...
>
>
> Doelestrjitte 8
>
> 8911 DX  Ljouwert
> (058) 213 14 14
>
> +31 62 094 34 28
> https://www.fryske-akademy.nl/
> https://frysker.nl/
> https://frisian.eu/
>
> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
> ------------------------------
> *From:* Joe Wicentowski <jo...@gm...>
> *Sent:* Wednesday, January 25, 2023 12:06 PM
> *To:* Harris, Bernard T. (GSFC-5870) <ber...@na...>
> *Cc:* Exist-open <exi...@li...>
> *Subject:* Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes
>
> Could you provide more info? How to reproduce? Expected vs. actual
> results? What version of eXist?
>
> On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via
> Exist-open <exi...@li...> wrote:
>
> I noticed the same thing.  But I was working with RESTXQ (and exist-db
> 6.0.1) for the first time and thought I might need to do things differently
> than the way it had worked in the past.  I would like to know if this is a
> bug or if there is a different way to accomplish the same thing.
>
>
>
> Bernie Harris
>
>
>
> *From: *Eduard Drenth <ed...@fr...>
> *Date: *Sunday, January 22, 2023 at 11:22 AM
> *To: *Exist-open <exi...@li...>
> *Subject: *[EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes
>
>
>
> json-ignore-whitespace-text-nodes not supported anymore?
>
>
>
>
>
>
>
> Eduard Drenth, Software Architekt
>
>
>
> ed...@fr...
>
>
>
> Doelestrjitte 8
>
> 8911 DX  Ljouwert
>
> (058) 213 14 14
>
> +31 62 094 34 28
>
> https://www.fryske-akademy.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=GHeHpN59VC5xjXYZv%2FTqgld4HFzVtNe4O0eZnJRM4og%3D&reserved=0>
>
> https://frysker.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=VLqoS94QI7sj5wR0WQ%2FLz20atSzleWdn7HMydkykkF0%3D&reserved=0>
>
> https://frisian.eu/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=NZHee7QsEXzXI0OmaS7aEhIX%2BTCUlil3o9icruakOGY%3D&reserved=0>
>
> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
> --
> Sent from my iPhone
>

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Eduard D. <ed...@fr...>]

declare variable $teidictjson:jsonparams := <output:serialization-parameters xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization">

  <output:method value="json"/>
  <output:json-ignore-whitespace-text-nodes value="yes"/>
</output:serialization-parameters>;

fn:serialize(<noresults>no results</noresults>,$teidictjson:jsonparams)

In 6.1.0 the above fails




Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:24465444-763d-4dfe-91c2-ba81bee19fe6]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

________________________________
From: Joe Wicentowski <jo...@gm...>
Sent: Wednesday, January 25, 2023 12:06 PM
To: Harris, Bernard T. (GSFC-5870) <ber...@na...>
Cc: Exist-open <exi...@li...>
Subject: Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

Could you provide more info? How to reproduce? Expected vs. actual results? What version of eXist?

On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via Exist-open <exi...@li...<mailto:exi...@li...>> wrote:

I noticed the same thing.  But I was working with RESTXQ (and exist-db 6.0.1) for the first time and thought I might need to do things differently than the way it had worked in the past.  I would like to know if this is a bug or if there is a different way to accomplish the same thing.



Bernie Harris



From: Eduard Drenth <ed...@fr...<mailto:ed...@fr...>>
Date: Sunday, January 22, 2023 at 11:22 AM
To: Exist-open <exi...@li...<mailto:exi...@li...>>
Subject: [EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes



json-ignore-whitespace-text-nodes not supported anymore?







Eduard Drenth, Software Architekt



ed...@fr...<mailto:ed...@fr...>



Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=GHeHpN59VC5xjXYZv%2FTqgld4HFzVtNe4O0eZnJRM4og%3D&reserved=0>

https://frysker.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=VLqoS94QI7sj5wR0WQ%2FLz20atSzleWdn7HMydkykkF0%3D&reserved=0>

https://frisian.eu/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=NZHee7QsEXzXI0OmaS7aEhIX%2BTCUlil3o9icruakOGY%3D&reserved=0>

[cid:185e89a12d2ad7999131]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth<http://pgp.key-server.io/pks/lookup?search=eduarddrenth>

_______________________________________________
Exist-open mailing list
Exi...@li...<mailto:Exi...@li...>
https://lists.sourceforge.net/lists/listinfo/exist-open
--
Sent from my iPhone

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Joe W. <jo...@gm...>]

Could you provide more info? How to reproduce? Expected vs. actual results?
What version of eXist?

On Wed, Jan 25, 2023 at 5:39 AM Harris, Bernard T. (GSFC-5870) via
Exist-open <exi...@li...> wrote:

> I noticed the same thing.  But I was working with RESTXQ (and exist-db
> 6.0.1) for the first time and thought I might need to do things differently
> than the way it had worked in the past.  I would like to know if this is a
> bug or if there is a different way to accomplish the same thing.
>
>
>
> Bernie Harris
>
>
>
> *From: *Eduard Drenth <ed...@fr...>
> *Date: *Sunday, January 22, 2023 at 11:22 AM
> *To: *Exist-open <exi...@li...>
> *Subject: *[EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes
>
>
>
> json-ignore-whitespace-text-nodes not supported anymore?
>
>
>
>
>
>
>
> Eduard Drenth, Software Architekt
>
>
>
> ed...@fr...
>
>
>
> Doelestrjitte 8
>
> 8911 DX  Ljouwert
>
> (058) 213 14 14
>
> +31 62 094 34 28
>
> https://www.fryske-akademy.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=GHeHpN59VC5xjXYZv%2FTqgld4HFzVtNe4O0eZnJRM4og%3D&reserved=0>
>
> https://frysker.nl/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=VLqoS94QI7sj5wR0WQ%2FLz20atSzleWdn7HMydkykkF0%3D&reserved=0>
>
> https://frisian.eu/
> <https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=NZHee7QsEXzXI0OmaS7aEhIX%2BTCUlil3o9icruakOGY%3D&reserved=0>
>
> gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
-- 
Sent from my iPhone

Re: [Exist-open] [EXTERNAL] json-ignore-whitespace-text-nodes

[Harris, B. T. (GSFC-5870) <ber...@na...>]

I noticed the same thing.  But I was working with RESTXQ (and exist-db 6.0.1) for the first time and thought I might need to do things differently than the way it had worked in the past.  I would like to know if this is a bug or if there is a different way to accomplish the same thing.

Bernie Harris

From: Eduard Drenth <ed...@fr...>
Date: Sunday, January 22, 2023 at 11:22 AM
To: Exist-open <exi...@li...>
Subject: [EXTERNAL] [Exist-open] json-ignore-whitespace-text-nodes

json-ignore-whitespace-text-nodes not supported anymore?




Eduard Drenth, Software Architekt



ed...@fr...



Doelestrjitte 8

8911 DX  Ljouwert
(058) 213 14 14

+31 62 094 34 28
https://www.fryske-akademy.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fryske-akademy.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=GHeHpN59VC5xjXYZv%2FTqgld4HFzVtNe4O0eZnJRM4og%3D&reserved=0>
https://frysker.nl/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrysker.nl%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=VLqoS94QI7sj5wR0WQ%2FLz20atSzleWdn7HMydkykkF0%3D&reserved=0>
https://frisian.eu/<https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffrisian.eu%2F&data=05%7C01%7CBernard.T.Harris%40nasa.gov%7C0bf6fca97ad74a78833108dafc94d22f%7C7005d45845be48ae8140d43da96dd17b%7C0%7C0%7C638100013365653479%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000%7C%7C%7C&sdata=NZHee7QsEXzXI0OmaS7aEhIX%2BTCUlil3o9icruakOGY%3D&reserved=0>
[cid:image001.png@01D9307C.DFE44FA0]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

[Exist-open] performance 6.1.0

[Eduard D. <ed...@fr...>]

Dear all,

Can it be that 6.1.0 exist-db is significantly slower (twice as slow at least) compared to 6.0.1?

I am running:

[cid:4551aa26-680a-4f73-a0cd-9d07c07efee9]



Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:3ae03765-821d-44e7-b05c-bf70259d6d51]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

[Exist-open] json-ignore-whitespace-text-nodes

[Eduard D. <ed...@fr...>]

json-ignore-whitespace-text-nodes not supported anymore?




Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:81af706a-ce67-47b7-a9de-80010cc6f16f]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

Re: [Exist-open] problem with nodes

[Eduard D. <ed...@fr...>]

Since 6.1.0 is out, CONGRATS!, I'll try if below issue still exists...

Regards,


Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:a2247bbe-3aff-4c9d-b685-3a463ae59c47]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

________________________________
From: Eduard Drenth <ed...@fr...>
Sent: Thursday, January 12, 2023 1:45 PM
To: Exist-open <exi...@li...>
Subject: [Exist-open] problem with nodes

Dear all,

We have dictionary applications running in exist-db, latest version. Users only read from the applications.

The only writing is done by syncing data from filesystem to exist-db using https://bitbucket.org/fryske-akademy/exist-db-addons/src/master/src/main/java/org/fryske_akademy/exist/jobs/DataSyncTask.java.

Regularly the log shows problems like this:

WARN  (EmbeddedXMLStreamReader.java [verifyOriginNodeId]:241) - Expected node id 1.3.2.6.4.3.4, got 1.5.2.2.2.20.5.1; resyncing address
WARN  (EmbeddedXMLStreamReader.java [verifyOriginNodeId]:241) - Expected node id 1.3.2.6.4, got 1.5.2.2.2.18.12; resyncing address
ERROR (VirtualNodeSet.java [addChildren]:529) - javax.xml.stream.XMLStreamException: java.io.IOException: Node not found.

When, under what circumstances, might these problems likely occur?

Regards,


Eduard Drenth, Software Architekt


ed...@fr...


Doelestrjitte 8

8911 DX  Ljouwert

(058) 213 14 14

+31 62 094 34 28

https://www.fryske-akademy.nl/
https://frysker.nl/
https://frisian.eu/
[cid:08d11238-1c07-4b95-9f15-6dd966f35bd0]

gpg: pgp.key-server.io/pks/lookup?search=eduarddrenth

[Exist-open] [ANN] Preparing for eXist-db 7.0.0

[Adam R. <ad...@ex...>]

I would like to make the community aware that the mainline of
development for eXist-db will soon move from the 6.x.x series to the
7.x.x. series.

As such the develop branch of the eXist-db GitHub repository (i.e.
https://github.com/exist-db/exist/tree/develop) will be updated by
Thursday 19th January to bump the current version number from
6.2.0-SNAPSHOT to 7.0.0-SNAPSHOT. After that we will also start
merging into the develop branch outstanding Pull Requests that target
eXist-db 7.0.0.

As always the eXist-db project follows the SemVer 2.0.0 standard of
versioning (https://semver.org/), and so a major version change, i.e.
6.x.x to 7.x.x indicates a version of eXist-db that has
non-backwards-compatible changes.

This is only of note to you, if for some reason you are dependent on
building from the develop branch. If that is the case, we would
consider setting up a develop-6.x.x branch... please just contact Adam
Retter <ad...@ev...> to discuss it.

Kind regards. Adam.

-- 
Adam Retter

eXist Core Developer
{ United Kingdom }
ad...@ex...

Re: [Exist-open] [ANN] eXist-db 4.11.1, 5.5.1, and 6.1.0 released

[Nick S. <nsi...@nu...>]

Congratulations and a big thank you to all the contributors who made 
this release a reality. I am eager to give this new version a try!

Best regards,

Nick

On 1/15/23 9:00 AM, Adam Retter wrote:
> Dear eXist-db users,
>
> After almost a year since our last releases, I am delighted to
> announce the release of eXist-db versions 6.1.0, 5.5.1, and 4.11.1.
>
> eXist-db 6.x.x is our main active line of development, and we have
> recommended this version series for all users for some time now.
> eXist-db 6.1.0 includes numerous improvements, optimisations, and bug
> fixes. In particular it adds a number of additional functions from
> XQuery 3.1 that were previously missing, including: fn:transform,
> fn:default-language, fn:format-integer, fn:round, fn:path,
> fn:collation-key, fn:n:element-with-id, fn:nilled, fn:uri-collection,
> andmap:find. With these additions, eXist-db 6.1.0 now supports all
> XQuery 3.1 functions.
>
> For those users already on the 6.x.x series, eXist-db 6.1.0 is
> backwards binary compatible with previous 6.x.x versions, which should
> make upgrading simple with no changes required to XQuery or XSLT
> application code. For those users migrating from 4.x.x or 5.x.x
> versions to 6.x.x a full backup and restore of the database will be
> required and possibly some small changes to XQuery and XSLT
> application code.
>
> The 4.x.x and 5.x.x series of eXist-db should be considered
> deprecated, our new releases of 4.x.x and 5.x.x include a number of
> crucial bug fixes for those users who cannot yet upgrade to 6.x.x. The
> 5.x.x series also includes a small handful of selected features and
> improvements that have been backported from the 6.x.x series.
>
> Finally, for those users considering a major upgrade from 4.x.x or
> 5.x.x to 6.x.x, you may wish to wait for the upcoming release of
> eXist-db 7.0.0. This release will update eXist-db from Java 8 to Java
> 17, and greatly improve its XQuery compliance with the W3C
> specifications. The improvements in compliance mean that some small
> changes to your XQuery application code may be required, but we
> believe that this is most worthwhile. We expect to release eXist-db
> 7.0.0 with Q1 of 2023.
>
> The full release notes and downloads can be found here:
>
> 1. eXist-db 6.1.0 -https://github.com/eXist-db/exist/releases/tag/eXist-6.1.0
>
> 2. eXist-db 5.5.1 -https://github.com/eXist-db/exist/releases/tag/eXist-5.5.1
>
> 3. eXist-db 4.11.1 -https://github.com/eXist-db/exist/releases/tag/eXist-4.11.1
>
> As well as thanking all contributors, I would also like to especially
> thank the Office of the Historian, U.S. Department of State,
> https://history.state.gov, which commissioned several of the
> improvements in eXist 6.1.0 through Evolved Binary
> https://www.evolvedbinary.com  and eXist Solutions
> https://www.existsolutions.com, and worked with Evolved Binary to make
> this release a reality.
>
> Best wishes. Adam.
>

-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...  
http://www.nuemeta.com
Skype: nsincaglia

Re: [Exist-open] [ANN] eXist-db 4.11.1, 5.5.1, and 6.1.0 released

[Ari N. <ari...@gm...>]

Congrats and thanks for your hard work, to everyone involved!

Best,

/Ari

On 2023-01-15 16:00, Adam Retter wrote:
> Dear eXist-db users,
>
> After almost a year since our last releases, I am delighted to
> announce the release of eXist-db versions 6.1.0, 5.5.1, and 4.11.1.
>
> eXist-db 6.x.x is our main active line of development, and we have
> recommended this version series for all users for some time now.
> eXist-db 6.1.0 includes numerous improvements, optimisations, and bug
> fixes. In particular it adds a number of additional functions from
> XQuery 3.1 that were previously missing, including: fn:transform,
> fn:default-language, fn:format-integer, fn:round, fn:path,
> fn:collation-key, fn:n:element-with-id, fn:nilled, fn:uri-collection,
> and map:find. With these additions, eXist-db 6.1.0 now supports all
> XQuery 3.1 functions.
>
> For those users already on the 6.x.x series, eXist-db 6.1.0 is
> backwards binary compatible with previous 6.x.x versions, which should
> make upgrading simple with no changes required to XQuery or XSLT
> application code. For those users migrating from 4.x.x or 5.x.x
> versions to 6.x.x a full backup and restore of the database will be
> required and possibly some small changes to XQuery and XSLT
> application code.
>
> The 4.x.x and 5.x.x series of eXist-db should be considered
> deprecated, our new releases of 4.x.x and 5.x.x include a number of
> crucial bug fixes for those users who cannot yet upgrade to 6.x.x. The
> 5.x.x series also includes a small handful of selected features and
> improvements that have been backported from the 6.x.x series.
>
> Finally, for those users considering a major upgrade from 4.x.x or
> 5.x.x to 6.x.x, you may wish to wait for the upcoming release of
> eXist-db 7.0.0. This release will update eXist-db from Java 8 to Java
> 17, and greatly improve its XQuery compliance with the W3C
> specifications. The improvements in compliance mean that some small
> changes to your XQuery application code may be required, but we
> believe that this is most worthwhile. We expect to release eXist-db
> 7.0.0 with Q1 of 2023.
>
> The full release notes and downloads can be found here:
>
> 1. eXist-db 6.1.0 - https://github.com/eXist-db/exist/releases/tag/eXist-6.1.0
>
> 2. eXist-db 5.5.1 - https://github.com/eXist-db/exist/releases/tag/eXist-5.5.1
>
> 3. eXist-db 4.11.1 - https://github.com/eXist-db/exist/releases/tag/eXist-4.11.1
>
> As well as thanking all contributors, I would also like to especially
> thank the Office of the Historian, U.S. Department of State,
> https://history.state.gov, which commissioned several of the
> improvements in eXist 6.1.0 through Evolved Binary
> https://www.evolvedbinary.com and eXist Solutions
> https://www.existsolutions.com, and worked with Evolved Binary to make
> this release a reality.
>
> Best wishes. Adam.
>