exist-open — Open discussion

Re: [Exist-open] Cannot open existdb

[Radu C. <rad...@sy...>]

Hi,

To avoid this from happening the Exist dmg package should be notarized:

https://developer.apple.com/documentation/security/notarizing_macos_software_before_distribution

Until this happens, as another workaround which recently worked for me 
you can remove the quarantine flag from the Exist installation folder, 
we have a topic in the Oxygen user's manual about removing the 
quarantine flag for Oxygen, but it's similar:

https://www.oxygenxml.com/doc/versions/23.1/ug-editor/topics/archive-fails-to-run-mac.html#archive-fails-to-run-mac__solution

Regards,

Radu

Radu Coravu
Oxygen XML Editor

On 10/28/21 05:29, Elisa Beshero-Bondar wrote:
> Hi John,
> Apple tries to prevent people from running software released outside 
> their proprietary orbit. But you will still be able to open and run 
> it, and other non-Apple-vended software too. These instructions may be 
> helpful:
>
> https://support.apple.com/guide/mac-help/apple-cant-check-app-for-malicious-software-mchleab3a043/mac
>
> Last spring, I drafted some instructions to assist my students to 
> install eXist locally on Macs and PCs, building on the official 
> documentation (trying to anticipate things that might go wrong). In 
> case helpful here they are. I should probably add this Apple security 
> issue to my document!
>
> https://github.com/newtfire/textAnalysis-Hub/blob/main/Install-eXist-dB.md
>
> Cheers,
> Elisa
>
> Elisa Beshero-Bondar, PhD (she/they)
> Program Chair of Digital Media, Arts, and Technology | Professor of 
> Digital Humanities | Director of the Digital Humanities Lab at Penn 
> State Erie, The Behrend College
>
> Typeset by hand on my iPhone
>
>> On Oct 27, 2021, at 10:12 PM, John Preimonas <jpr...@ho...> 
>> wrote:
>>
>>  Hi eXist-db folk,
>> I have loaded eXist-db v5.3.0 and now Apple is *_blocking_* me from 
>> running eXist-db! I get the following message:
>>
>>     “eXist-db” can’t be opened because Apple cannot check if for
>>     malicious software.
>>     This software needs to be updated. Contact the developer for more
>>     information.
>>     Safari downloaded this file today at 11:34 from
>>     github.releases.githubusercontent.com
>>     <http://github.releases.githubusercontent.com>.
>>
>>
>> Please help, as I cannot progress with using v5.3.0 or do I need to 
>> restore to my v5.2.0?
>>
>>
>> John Preimonas
>> M: 0478936636
>> jpr...@ho...
>> /
>> Flying might not be all plain sailing, but the fun of it is worth the 
>> price.— Amelia Earhart/
>>
>>
>>
>>
>>
>>
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li...
>> https://lists.sourceforge.net/lists/listinfo/exist-open
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

Re: [Exist-open] Cannot open existdb

[Elisa Beshero-B. <ebb...@gm...>]

Hi John,
Apple tries to prevent people from running software released outside their proprietary orbit. But you will still be able to open and run it, and other non-Apple-vended software too. These instructions may be helpful:

https://support.apple.com/guide/mac-help/apple-cant-check-app-for-malicious-software-mchleab3a043/mac

Last spring, I drafted some instructions to assist my students to install eXist locally on Macs and PCs, building on the official documentation (trying to anticipate things that might go wrong). In case helpful here they are. I should probably add this Apple security issue to my document! 

https://github.com/newtfire/textAnalysis-Hub/blob/main/Install-eXist-dB.md

Cheers,
Elisa

Elisa Beshero-Bondar, PhD (she/they)
Program Chair of Digital Media, Arts, and Technology | Professor of Digital Humanities |  Director of the Digital Humanities Lab at Penn State Erie, The Behrend College 

Typeset by hand on my iPhone

> On Oct 27, 2021, at 10:12 PM, John Preimonas <jpr...@ho...> wrote:
> 
>  Hi eXist-db folk,
> I have loaded eXist-db v5.3.0 and now Apple is blocking me from running eXist-db! I get the following message: 
> “eXist-db” can’t be opened because Apple cannot check if for malicious software. 
> This software needs to be updated. Contact the developer for more information. 
> Safari downloaded this file today at 11:34 from github.releases.githubusercontent.com.
> 
> Please help, as I cannot progress with using v5.3.0 or do I need to restore to my v5.2.0?
> 
> 
> John Preimonas
> M: 0478936636
> jpr...@ho...
> 
> Flying might not be all plain sailing, but the fun of it is worth the price.— Amelia Earhart
> 
> 
> 
> 
> 
> 
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

[Exist-open] Cannot open existdb

[John P. <jpr...@ho...>]

Hi eXist-db folk,
I have loaded eXist-db v5.3.0 and now Apple is blocking me from running eXist-db! I get the following message: 
“eXist-db” can’t be opened because Apple cannot check if for malicious software. 
This software needs to be updated. Contact the developer for more information. 
Safari downloaded this file today at 11:34 from github.releases.githubusercontent.com.

Please help, as I cannot progress with using v5.3.0 or do I need to restore to my v5.2.0?


John Preimonas
M: 0478936636
jpr...@ho...

Flying might not be all plain sailing, but the fun of it is worth the price.— Amelia Earhart

Re: [Exist-open] mysql jdbc

[Слава С. <wet...@gm...>]

Hi,

I tried few days ago to connect eXist to MariaDB - sadly it not work at
least in my case. Exist can work as "New Exchange server" so i guess any
"connectors" should work "out of the box" or should be easily attached in
same way as "xar"-packages for example.

With best wishes,
Sla

ср, 20 окт. 2021 г., 18:55 Loren Cahlander <lor...@gm...>:

> It should install from the package manager.  I think that the SQL module
> will need to implement
>
> Class.forName(jdbcDriver.getStringValue()).newInstance();
>
> To be able to load the driver.  I have that in my own package that does
> JDBC calls for other reasons and it loads the JDBC driver.
>
> On Oct 7, 2021, at 2:11 PM, Roy Walter <gar...@ya...>
> wrote:
>
> Hi Loren,
>
> Should this install from the package manager (eXist 5.2)? The only way I
> can make it work is a manual install per your post here:
>
> https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector
> <https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connectorhttps://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector>
>
> Thanks and regards,
> Roy
>
> On Tuesday, 5 October 2021, 19:42:36 BST, Loren Cahlander <
> lor...@gm...> wrote:
>
>
> Hello Roy,
>
> Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver
>
> Loren
>
> On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <
> exi...@li...> wrote:
>
> Hi,
>
> Could someone point me to a reference for implementing this in 5.x please.
>
> Also, do I need to download the .jar file or is it installed with eXist
> (as some online sources suggest)?
>
> Thanks in advance,
> Roy
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

Re: [Exist-open] Function conflict?

[Nick S. <nsi...@nu...>]

All:
     I was able to resolve this issue by downgrading my version of Java 
to Java 8 from Java 11. That seemed to resolve the issue.

Nick

On 10/24/21 11:34 PM, Nick Sincaglia wrote:
> I just installed the latest eXist-db v5.3.0 on a server. I started to 
> copy over my XQuery code to the server using WebDAV. Everything was 
> copying over fine until I tried to copy a module I wrote called 
> utilities.xqm. When I tried copying utilities.xqm over to the server, 
> I got the following error:
>
> Could not initialize class org.exist.xquery.modules.mail.MailModule
>
> I found this very puzzling. So, I tried to create this file from 
> scratch in eXide. I created an empty utilities.xqm file and I then 
> copied one function at a time from my original utilities.xqm file and 
> I would save the new file. I did this for each function from my 
> original file. I discovered that when I copied and pasted a function 
> called utilities:date-time-directory(), this is when eXist-db would 
> display a pop-up window in eXide with the above mentioned error.
>
> Is this a function name conflict with something in 
> org.exist.xquery.modules.mail.MailModule?
>
> If I change my function name to utilities:date-time-directories() 
> instead, the file saves just fine. But if I change the function back 
> to utilities:date-time-directory(), I get the "Could not initialize 
> class org.exist.xquery.modules.mail.MailModule" error message.
>
> I tried looking through my code to see if there was any references to 
> utilities:date-time-directory() anywhere in my code and if any 
> references were in an XQuery module that imported the 
> org.exist.xquery.modules.mail.MailModule. However, when I tried to 
> pull of Edit -> Find in files in the eXide menu, that tool did not 
> respond. Normally a pop-up window would appear and allow me to search 
> my code for a particular string. No pop-up window would appear.
>
> I am a little confused. Does anyone have any insights to this issue?
>
> Nick
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...  
http://www.nuemeta.com
Skype: nsincaglia

[Exist-open] Function conflict?

[Nick S. <nsi...@nu...>]

I just installed the latest eXist-db v5.3.0 on a server. I started to 
copy over my XQuery code to the server using WebDAV. Everything was 
copying over fine until I tried to copy a module I wrote called 
utilities.xqm. When I tried copying utilities.xqm over to the server, I 
got the following error:

Could not initialize class org.exist.xquery.modules.mail.MailModule

I found this very puzzling. So, I tried to create this file from scratch 
in eXide. I created an empty utilities.xqm file and I then copied one 
function at a time from my original utilities.xqm file and I would save 
the new file. I did this for each function from my original file. I 
discovered that when I copied and pasted a function called 
utilities:date-time-directory(), this is when eXist-db would display a 
pop-up window in eXide with the above mentioned error.

Is this a function name conflict with something in 
org.exist.xquery.modules.mail.MailModule?

If I change my function name to utilities:date-time-directories() 
instead, the file saves just fine. But if I change the function back to 
utilities:date-time-directory(), I get the "Could not initialize class 
org.exist.xquery.modules.mail.MailModule" error message.

I tried looking through my code to see if there was any references to 
utilities:date-time-directory() anywhere in my code and if any 
references were in an XQuery module that imported the 
org.exist.xquery.modules.mail.MailModule. However, when I tried to pull 
of Edit -> Find in files in the eXide menu, that tool did not respond. 
Normally a pop-up window would appear and allow me to search my code for 
a particular string. No pop-up window would appear.

I am a little confused. Does anyone have any insights to this issue?

Nick

[Exist-open] Serialization

[Roy W. <gar...@ya...>]

Hi,
Pre 5.x this used to work for converting special characters, e.g., &lt; to <, when outputting HTM:

let $cleanedAnswer := util:serialize($wrans//Answer/Value/text(),"method=text")
This, however, doesn't work:
let $cleanedAnswer := serialize($wrans//Answer/Value/text(), map{"method" : "text"})
What am I  missing?
Thanks as ever,Roy

Re: [Exist-open] Looking to create a docker image

[Loren C. <lor...@gm...>]

Hello Mathias,

I will try that. Thank you for the information.  

Best,
Loren



> On Oct 18, 2021, at 6:33 AM, Mathias Göbel <go...@su...> wrote:
> 
> Hi Loren,
> 
> i would recommend creating a docker-compose setup with three containers: nginx, react app, eXist-db. So you can seamless update your applications and it will increase the security by increased isolation.
> 
> Basically you can take the exist-db docker and simply COPY your XAR packages to the autodeploy directory:
> 
> FROM existdb/existdb:5.3.0
> 
> # copy EXPath packages
> COPY [PATHTO]/*.xar /exist/autodeploy/
> COPY [PATHTO-dependencies]/*.xar /exist/autodeploy/
> 
> 
> For using with apache httpd you can find a more complete setup at https://gitlab.gwdg.de/subugoe/ahiqar/backend/-/tree/develop/docker <https://gitlab.gwdg.de/subugoe/ahiqar/backend/-/tree/develop/docker>
> best,
> Mathias
> 
> On 15.10.21 21:44, Loren Cahlander wrote:
>> Hello folks,
>> 
>> I have several Git repositories.
>> 
>> A ReactJS web application
>> A data XAR application
>> An RestXQ API XAR application
>> 
>> What I would like is to create a docker image with the ReactJS web app deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone created such an image?
>> 
>> Thank you,
>> Loren
>> 
>> 
>> 
>> 
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li... <mailto:Exi...@li...>
>> https://lists.sourceforge.net/lists/listinfo/exist-open <https://lists.sourceforge.net/lists/listinfo/exist-open>
> -- 
> Mathias Göbel
> University of Göttingen
> Göttingen State and University Library
> D-37070 Göttingen
> 
> Research and Development
> Papendiek 14 (hist. Building, Room 2.408 <https://lageplan.uni-goettingen.de/?ident=7209_4_2.OG_2.408>)
> +49 551 39-25823 (Tel., Wednesday to Friday)
> +49 551 39-33856 (Fax.)
> 
> Digital Library
> Software and Service Development
> Platz der Göttinger Sieben 1 (Central Library, Room 2.129 <https://lageplan.uni-goettingen.de/?ident=5383_1_2.OG_2.129>)
> +49 551 39-10230 (Tel., Monday/Tuesday)
> 
> go...@su... <mailto:go...@su...=          -goettingen.de>
> http://www.sub.uni-goettingen.de <https://www.sub.uni-goettingen.de/en/news/>_______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

Re: [Exist-open] Looking to create a docker image

[Loren C. <lor...@gm...>]

Thank you for your feedback.  I will try that.

> On Oct 18, 2021, at 1:51 AM, Peter Stadler <st...@ed...> wrote:
> 
> Hi Loren,
> 
> I would usually do this with three containers. One frontend nginx container with the React app and another backend existdb container with the data and API. The reverse proxying can be done with jwilder/nginx-proxy or some other HAProxy that fits your infrastructure.
> This setup would allow you to use generic Docker images into which you only need to mount your data.
> 
> Sorry, that does not answer your request but maybe it helps (someone) anyway?
> 
> Best
> Peter
> 
> 
>> Am 15.10.2021 um 21:44 schrieb Loren Cahlander <lor...@gm...>:
>> 
>> Signierter PGP-Teil
>> Hello folks,
>> 
>> I have several Git repositories.
>> 
>> 	• A ReactJS web application
>> 	• A data XAR application
>> 	• An RestXQ API XAR application
>> 
>> What I would like is to create a docker image with the ReactJS web app deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone created such an image?
>> 
>> Thank you,
>> Loren
>> 
>> 
>> 
> 

Re: [Exist-open] mysql jdbc

[Loren C. <lor...@gm...>]

It should install from the package manager.  I think that the SQL module will need to implement

Class.forName(jdbcDriver.getStringValue()).newInstance();
To be able to load the driver.  I have that in my own package that does JDBC calls for other reasons and it loads the JDBC driver.

> On Oct 7, 2021, at 2:11 PM, Roy Walter <gar...@ya...> wrote:
> 
> Hi Loren,
> 
> Should this install from the package manager (eXist 5.2)? The only way I can make it work is a manual install per your post here:
> https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector <https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connectorhttps://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector>
> 
> Thanks and regards,
> Roy
> 
> On Tuesday, 5 October 2021, 19:42:36 BST, Loren Cahlander <lor...@gm...> wrote:
> 
> 
> Hello Roy,
> 
> Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver <https://github.com/eXist-db/exist-mysql-jdbc-driver>
> 
> Loren
> 
>> On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <exi...@li... <mailto:exi...@li...>> wrote:
>> 
>> Hi,
>> 
>> Could someone point me to a reference for implementing this in 5.x please.
>> 
>> Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
>> 
>> Thanks in advance,
>> Roy
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li... <mailto:Exi...@li...>
>> https://lists.sourceforge.net/lists/listinfo/exist-open
> 

[Exist-open] Damaged and Orphaned Documents

[Nick S. <nsi...@nu...>]

One of my eXist-db systems became unresponsive today. I was forced to 
shut it down. When I restarted it, it ran through the typical checks and 
it found 2 damaged and orphaned documents (see below). My question is, 
"Is my system OK? It started up after discovering these problems. Is 
there something more I should do? Will these damaged and orphaned 
documents haunt me in the future?"

Nick

2021-10-19 02:28:54,744 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3643) - Rebuilding index dom.dbx
2021-10-19 02:29:15,690 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3645) - Index dom.dbx was rebuilt.
2021-10-19 02:29:15,690 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3643) - Rebuilding index collections.dbx
2021-10-19 02:29:16,174 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3645) - Index collections.dbx was rebuilt.
2021-10-19 02:29:16,574 [main] INFO  (BlobStoreImplService.java 
[startSystem]:72) - Opened de-duplicating Blob Store v1. 
metadata=blob.dbx, store=blob/
2021-10-19 02:29:16,710 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,723 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,731 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,745 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,861 [main] INFO  (NativeBroker.java [repair]:3607) - 
Removing index files ...
2021-10-19 02:29:16,903 [main] INFO  (NativeBroker.java [repair]:3615) - 
Recreating index files ...
2021-10-19 02:29:16,967 [main] INFO  (NativeBroker.java [repair]:3629) - 
Reindexing database files ...
2021-10-19 02:32:25,048 [main] INFO  (ConsistencyCheckTask.java 
[execute]:151) - Starting consistency check...
2021-10-19 02:32:32,420 [main] ERROR (ConsistencyCheckTask.java 
[execute]:164) - Errors found: 2
2021-10-19 02:32:32,420 [main] ERROR (ConsistencyCheckTask.java 
[execute]:169) - Fatal errors were found: pausing the consistency check 
task.
2021-10-19 02:32:32,421 [main] INFO  (ConsistencyCheckTask.java 
[execute]:174) - Finished consistency check
2021-10-19 02:32:32,421 [main] INFO  (ConsistencyCheckTask.java 
[execute]:178) - Starting backup...
2021-10-19 02:33:00,314 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0097849003590-20210622192014751.xml
2021-10-19 02:34:08,481 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0035159832783-20210505040911732.xml
2021-10-19 02:34:43,977 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0035159832783-20210505040911732.xml
2021-10-19 02:34:44,008 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0097849003590-20210622192014751.xml
2021-10-19 02:35:28,485 [main] INFO  (ConsistencyCheckTask.java 
[execute]:185) - Created backup to file: 
/mnt/data/exist-5.3.0-snapshot/etc/../data/sanity/full20211019-0232.zip
2021-10-19 02:35:28,486 [main] INFO  (ConsistencyCheckTask.java 
[execute]:188) - Finished backup

-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...
http://www.nuemeta.com
Skype: nsincaglia

Re: [Exist-open] Looking to create a docker image

[Mathias G. <go...@su...>]

Hi Loren,

i would recommend creating a docker-compose setup with three containers: 
nginx, react app, eXist-db. So you can seamless update your applications 
and it will increase the security by increased isolation.

Basically you can take the exist-db docker and simply COPY your XAR 
packages to the autodeploy directory:

    FROM existdb/existdb:5.3.0

    # copy EXPath packages
    COPY [PATHTO]/*.xar /exist/autodeploy/
    COPY [PATHTO-dependencies]/*.xar /exist/autodeploy/

For using with apache httpd you can find a more complete setup at 
https://gitlab.gwdg.de/subugoe/ahiqar/backend/-/tree/develop/docker

best,
Mathias

On 15.10.21 21:44, Loren Cahlander wrote:
> Hello folks,
>
> I have several Git repositories.
>
>   * A ReactJS web application
>   * A data XAR application
>   * An RestXQ API XAR application
>
>
> What I would like is to create a docker image with the ReactJS web app 
> deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two 
> XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone 
> created such an image?
>
> Thank you,
> Loren
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
-- 
Mathias Göbel
University of Göttingen
Göttingen State and University Library
D-37070 Göttingen

Research and Development
Papendiek 14 (hist. Building, Room 2.408 
<https://lageplan.uni-goettingen.de/?ident=7209_4_2.OG_2.408>)
+49 551 39-25823 (Tel., Wednesday to Friday)
+49 551 39-33856 (Fax.)

Digital Library
Software and Service Development
Platz der Göttinger Sieben 1 (Central Library, Room 2.129 
<https://lageplan.uni-goettingen.de/?ident=5383_1_2.OG_2.129>)
+49 551 39-10230 (Tel., Monday/Tuesday)

go...@su... <mailto:go...@su...= -goettingen.de>
http://www.sub.uni-goettingen.de 
<https://www.sub.uni-goettingen.de/en/news/>

Re: [Exist-open] eXide display issues

[Joe W. <jo...@gm...>]

Hi Roy,

Several issues, including your #2, were fixed in the just-released eXide
3.1.1 (available via Dashboard > Package Manager). See the release notes
here:

  https://github.com/eXist-db/eXide/releases

For the other problems you mentioned, I'd encourage you to file issues in
the eXide repository.

Cheers,
Joe

On Thu, Oct 7, 2021 at 2:49 PM Roy Walter via Exist-open <
exi...@li...> wrote:

> Hi,
>
> I can't be the only one seeing this in file browsers:
>
> 1. Date forrmat stuck on mm/dd/yyyy
> 2. When scrolling display does not update -- no files visible
> 3. Column sort options in file browers would be nice.
>
> Almost immediate login expiry is also a bit of a pain.
>
> Thanks,
> Roy
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

[Exist-open] Looking to create a docker image

[Loren C. <lor...@gm...>]

Hello folks,

I have several Git repositories.

A ReactJS web application
A data XAR application
An RestXQ API XAR application

What I would like is to create a docker image with the ReactJS web app deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone created such an image?

Thank you,
Loren

[Exist-open] WebRTC webcam snap shot and upload to EXIST-DB

[Gary <ga...@ra...>]

  
Hi Guys, 
  
I am trying to take a picture in the web browser using a webcam such as from a phone and upload to EXIST-DB and wonder if there is anyone who knows all about this already and could kindly share pointers to some documentation or some general tips, advice or recommendations how to achieve this. 
  
Chrome and some other browsers support taking pictures as part of the WebRTC standardization and there are lots of sites using this functionality such as: 
https://webcamtoy.com/ 
  
All the tutorial examples I found so far are using PHP/node-js back-end and I am hoping to work out instead a way to post to xquery from HTML/JavaScript HTML FORM video and canvas into EXIST-DB. I guess I need the binary-to-string like this on the server side: 
 xmldb:store($collection, $filename, util:binary-to-string(request:get-uploaded-file-data('file')))

It would be great to share ideas on this as it looks really useful for so many different use cases. I am also wondering about the best formatting png or JPEG etc., ideal file
and encoding (base64?), metadata and standard webcam picture sizing and am hoping for some pointers for some optimal settings for those.

Kindest regards,
Gary  

  

[Exist-open] Consistency Check

[Nick S. <nsi...@nu...>]

I had a system of mine crash due to a Java Heap Exception. When I 
restarted the system, I watched the exist.log and it reported the below 
information. The system is running now, but I am not sure if I should be 
concerned about these damaged and orphaned documents. Is my system OK 
with the exception of these damaged and orphaned documents? Or should I 
do a back up and restore and then later address these damaged and 
orphaned documents? I am not very concerned about these 4 documents. I 
am more concerned about if my system is damaged and will cause me 
problems in the future.

Nick


2021-10-08 04:32:38,739 [main] INFO  (NativeBroker.java [repair]:3607) - 
Removing index files ...
2021-10-08 04:32:38,796 [main] INFO  (NativeBroker.java [repair]:3615) - 
Recreating index files ...
2021-10-08 04:32:38,874 [main] INFO  (NativeBroker.java [repair]:3629) - 
Reindexing database files ...
2021-10-08 04:35:46,043 [main] INFO  (ConsistencyCheckTask.java 
[execute]:151) - Starting consistency check...
2021-10-08 04:35:53,055 [main] ERROR (ConsistencyCheckTask.java 
[execute]:164) - Errors found: 2
2021-10-08 04:35:53,055 [main] ERROR (ConsistencyCheckTask.java 
[execute]:169) - Fatal errors were found: pausing the consistency check 
task.
2021-10-08 04:35:53,055 [main] INFO  (ConsistencyCheckTask.java 
[execute]:174) - Finished consistency check
2021-10-08 04:35:53,055 [main] INFO  (ConsistencyCheckTask.java 
[execute]:178) - Starting backup...
2021-10-08 04:36:21,735 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0097849003590-20210622192014751.xml
2021-10-08 04:37:29,456 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0035159832783-20210505040911732.xml
2021-10-08 04:38:02,818 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0035159832783-20210505040911732.xml
2021-10-08 04:38:02,848 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0097849003590-20210622192014751.xml
2021-10-08 04:38:46,511 [main] INFO  (ConsistencyCheckTask.java 
[execute]:185) - Created backup to file: 
/mnt/data/exist-5.3.0-snapshot/etc/../data/sanity/full20211008-0435.zip
2021-10-08 04:38:46,511 [main] INFO  (ConsistencyCheckTask.java 
[execute]:188) - Finished backup



-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...
http://www.nuemeta.com
Skype: nsincaglia

[Exist-open] eXide display issues

[Roy W. <gar...@ya...>]

Hi,
I can't be the only one seeing this in file browsers:

1. Date forrmat stuck on mm/dd/yyyy2. When scrolling display does not update -- no files visible3. Column sort options in file browers would be nice.
Almost immediate login expiry is also a bit of a pain.

Thanks,Roy

Re: [Exist-open] mysql jdbc

[Roy W. <gar...@ya...>]

 Hi Loren,
Should this install from the package manager (eXist 5.2)? The only way I can make it work is a manual install per your post here:https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector
Thanks and regards,Roy

    On Tuesday, 5 October 2021, 19:42:36 BST, Loren Cahlander <lor...@gm...> wrote:  
 
 Hello Roy,
Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver
Loren


On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <exi...@li...> wrote:
Hi,
Could someone point me to a reference for implementing this in 5.x please.
Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
Thanks in advance,Roy
_______________________________________________
Exist-open mailing list
Exi...@li...
https://lists.sourceforge.net/lists/listinfo/exist-open


  

Re: [Exist-open] mysql jdbc

[Loren C. <lor...@gm...>]

Hello Roy,

Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver <https://github.com/eXist-db/exist-mysql-jdbc-driver>

Loren

> On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <exi...@li...> wrote:
> 
> Hi,
> 
> Could someone point me to a reference for implementing this in 5.x please.
> 
> Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
> 
> Thanks in advance,
> Roy
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

[Exist-open] mysql jdbc

[Roy W. <gar...@ya...>]

Hi,
Could someone point me to a reference for implementing this in 5.x please.
Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
Thanks in advance,Roy

[Exist-open] http request read environment variable

[Roy W. <gar...@ya...>]

I had a working SendGrid implementation using httpclient:post where  an API key was sent as header.
Having upgraded to 5.x, httpclient is no longer available so I am using http:send-request. My SendGrid implementation no longer works because the API key is sent as if from a browser, which is perceived at SendGrid's end as a security risk.
The recommendation is to store the API key in an environment variable. I have no idea how or whether this can be achieved in eXist.
Does anyone have any insight on this?
Thanks as ever,Roy

Re: [Exist-open] Fwd: Problem files after a crash

[Joe W. <jo...@gm...>]

Hi Nick,

Great, now that you have a backup, could you please open an issue and, if
possible, attach the backup there? We would also benefit from knowing what
query fails.

Joe

On Tue, Sep 28, 2021 at 10:36 PM Nick Sincaglia <nsi...@nu...>
wrote:

> I found another example of this issue today. I had a file which was
> located here:
>
> /db/apps/core/message-store/data/DEP-42/20210912/193872978031-20210912232055722.xml
>
> My scripts would fail when they tried to process it. I took a backup of
> the database. Then I opened the file in Oxygen, clicked the Format and
> Index icon and then saved it. My scripts processed this file without any
> problem.
>
> I have the database backup and would love to get some help in trying to
> explain what is wrong with this file or the indexes that is causing this
> problem.
>
> Nick
>
> On 9/27/21 9:07 AM, Nick Sincaglia wrote:
>
> Joe,
> I have experienced this issue on various different versions of eXist-db. I
> don't think it is specific to the version I am using.
>
> I have a variety of different eXist-db versions running for different
> clients. I usually try to get a new client using the latest version of
> eXist-db when I first start working with them and unless there is a good
> reason to upgrade, I usually keep them on that version for a while. Every
> new version of eXist-db comes with the potential risk that something that
> was working might break in the new version. So, I am reluctant to upgrade
> unless it there is a clear benefit.
>
> The issue I described is caused by the initial crash. It is just not clear
> to me why the re-index does not address the issue. It is hard to find these
> files as well. Usually I find them because the system is throwing an
> unexplained error. It would be helpful to be able to detect these files
> after a crash to proactively identify them before they cause the system to
> error in unexplained ways.
>
> Nick
>
> On 9/26/21 8:13 PM, Joe Wicentowski wrote:
>
> Hi Nick,
>
> I don't have any suggestions, except perhaps one: Have you considered
> upgrading to eXist 5? It's got a lot of fixes to locking and has been very
> stable for us in production.
>
> Joe
>
> On Sun, Sep 26, 2021 at 5:57 PM Nick Sincaglia <nsi...@nu...>
> wrote:
>
>> I brought this up on the last community call but I wanted to send the
>> e-mail to see if the wider community audience might have some suggestions.
>>
>> I had my eXist-db v4.5 crash a number of weeks ago. I restarted the
>> system, it ran through the data integrity check and everything seemed to be
>> OK. However, later, I noticed one of the files in my system that was not
>> indexed correctly. I could tell this because my file processing script
>> could find the file in the system but I was getting an error that did not
>> make any sense.
>>
>> So, what I decided to do next was to reindex the entire database
>> (xmldb:reindex('/db')). I tried running my script again and I still got the
>> same error. So, next I located the file in the system, opened up the file
>> and made a minor change to the XML file (The small change I made was I
>> added a white space to the end of the file, but I could have made any
>> change.) Then I saved the file. After that, I ran my script and everything
>> worked as expected.
>>
>> What I believe I understand about this issue is that there is something
>> that happens when you save a file, which forces a re-index of a file, which
>> is different then if you run xmldb:reindex(). Also, I have experimented
>> with downloading a collection of documents, then deleting the collection in
>> the database and then uploading the collection to the database using
>> WebDAV. This technique also does not solve the issue. There is something
>> about opening the file, changing it and then saving it that resolves this
>> issue. I was posting this because I see this issue every 6 months or so.
>> Whenever, I am completely stumped by a script not running properly, I have
>> learned to locate the file, modify it in a minor way and resave it and very
>> frequently it resolves my issue.
>>
>> When I brought this up on the community call, I was given 2 suggestions.
>> First, they thought maybe the XML files had a BOM character in them. This
>> is not the case for me because we are not working with any Windows servers.
>> I have seen this BOM character issue before and so I can confidently say,
>> this is not related to a BOM character.
>>
>> The second suggestion was that maybe our index was indexing an attribute
>> instead of a tag. I checked my index and I don't think this is the case. My
>> index file is below.
>> <collection xmlns="http://exist-db.org/collection-config/1.0"
>> <http://exist-db.org/collection-config/1.0>>
>>     <index>
>>         <!-- Disable the old full text index -->
>>         <fulltext default="none" attributes="false"/>
>>         <!-- New full text index based on Lucene indexes for full names
>> and song titles -->
>>         <lucene>
>>             <analyzer
>> class="org.apache.lucene.analysis.standard.StandardAnalyzer"/>
>>             <analyzer id="ws"
>> class="org.apache.lucene.analysis.WhitespaceAnalyzer"/>
>>         </lucene>
>>         <!-- Range indexes for fast ID lookups -->
>>         <range>
>>             <create qname="next-activity" type="xs:string"/>
>>             <create qname="data-exchange-id" type="xs:string"/>
>>             <create qname="data-origin-party-id" type="xs:string"/>
>>             <create qname="data-destination-party-id" type="xs:string"/>
>>             <create qname="release-id" type="xs:string"/>
>>             <create qname="search" type="xs:string"/>
>>             <create qname="delivery-type" type="xs:string"/>
>>             <create qname="queue-date-time" type="xs:string"/>
>>             <create qname="delivery-date-time" type="xs:string"/>
>>             <create qname="workflow-status" type="xs:string"/>
>>             <create qname="event-timestamp" type="xs:dateTime"/>
>>         </range>
>>     </index>
>> </collection>
>>
>> Any thoughts or suggestions are welcome!
>>
>> Nick
>>
>> --
>> Nick Sincaglia
>> President/Founder
>> NueMeta, LLC
>> Digital Media & Technology
>> Phone: +1-6...@nu... http://www.nuemeta.com
>> Skype: nsincaglia
>>
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li...
>> https://lists.sourceforge.net/lists/listinfo/exist-open
>>
> --
> Sent from my iPhone
>
>
> --
> Nick Sincaglia
> President/Founder
> NueMeta, LLC
> Digital Media & Technology
> Phone: +1-6...@nu... http://www.nuemeta.com
> Skype: nsincaglia
>
>
> --
> Nick Sincaglia
> President/Founder
> NueMeta, LLC
> Digital Media & Technology
> Phone: +1-6...@nu... http://www.nuemeta.com
> Skype: nsincaglia
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

[Exist-open] Declarative Amsterdam

[Erik S. <er...@xa...>]

The Program for Declarative Amsterdam 2021 (http://declarative.amsterdam/program) has been announced, featuring tutorials and presentations on topics such as Saxon-JS, ixml, XProc, DITA, declarative databases, and the social issues of declarative processes, featuring names such as Betsy Haibel, Debbie Lockett, Steven Pemberton, Erik Siegel, Michael Sperberg-McQueen, and Norm Tovey-Walsh.

 

The conference will be hybrid: you can attend in person or remotely, and is on November 4th and 5th. Registration is open at: https://declarative.amsterdam/submit?model=da-registration.

 

We hope to be see you there, either in person or virtually!

 

Best wishes,

The Declarative Amsterdam Conference Committee.

Re: [Exist-open] Can't list collections

[Roy W. <gar...@ya...>]

 Resolved by reinstalling and db restore.

R.

    On Sunday, 3 October 2021, 12:46:14 BST, Roy Walter via Exist-open <exi...@li...> wrote:  
 
 When trying to list collections in the Java admin client, Oxygen and the Collection Browser I am seeing this error:
org.xmldb.api.base.XMLDBException: Failed to invoke method describeResource in class org.exist.xmlrpc.RpcConnection: Unknown ACE Access TypeFailed to invoke method describeResource in class org.exist.xmlrpc.RpcConnection: Unknown ACE Access Type

I can list collections in eXide and over webdav.
Any ideas?
Thanks,Roy

_______________________________________________
Exist-open mailing list
Exi...@li...
https://lists.sourceforge.net/lists/listinfo/exist-open
  

[Exist-open] Can't list collections

[Roy W. <gar...@ya...>]

When trying to list collections in the Java admin client, Oxygen and the Collection Browser I am seeing this error:
org.xmldb.api.base.XMLDBException: Failed to invoke method describeResource in class org.exist.xmlrpc.RpcConnection: Unknown ACE Access TypeFailed to invoke method describeResource in class org.exist.xmlrpc.RpcConnection: Unknown ACE Access Type

I can list collections in eXide and over webdav.
Any ideas?
Thanks,Roy