exist-open — Open discussion

Re: [Exist-open] Sending mail via Amazon SES

[Kevin B. <kev...@xp...>]

We use multiple servers depending on PROD/QA/DEV as well as eXist-db locations in territories in the world. 

I cut one down to show you what we use. This sets the appropriate properties for the mail session using the credentials for the IAM user for sending email: 

 

declare variable $g:server.mail.properties := 
            <properties>
                <property name="mail.smtp.host" value="email-smtp.eu-west-1.amazonaws.com"/>
                <property name="mail.smtp.starttls.enable" value="true"/>
                <property name="mail.smtp.port" value="587"/>
                <property name="mail.smtp.auth" value="true"/>
                <property name="mail.smtp.allow8bitmime" value="true"/>
                <property name="mail.smtp.user" value="XXXXXXXXXXXXXXXXXX"/>
                <property name="mail.smtp.password" value="XXXXXXXXXXXXXXXXXXXXXXXXX"/>
            </properties>;

 

Then a simple function like below to send email given cc, bcc, subject, html body and attachements:

 

declare function xport:send-email2($to as item()*, $cc as item()*, $bcc as item()*,  $alternateFromDisplay as xs:string, $subject as xs:string, $html as element(), $text as xs:string, $attachments as item()*) as element()* {
let $from := 
    if(normalize-space($alternateFromDisplay) = '') then
        $g:server.mail-from-address
    else
        concat($alternateFromDisplay, ' &lt;', $g:server.mail-no-reply, '&gt;')
        
let $message :=
      <mail>
        <from>{$from}</from>
        { for $email in $to
            return <to>{$email}</to> }
        { for $email in $cc
            return <cc>{$email}</cc> }
        { for $email in $bcc
            return <bcc>{$email}</bcc> }
        <subject>{$subject}</subject>
        <message>
          <text>{$text}</text>
          <xhtml>{$html}</xhtml>
        </message>
        { for $attachment in $attachments/*
        return
         $attachment }
      </mail>
  let $mailsession := mail:get-mail-session($g:server.mail.properties)
  return mail:send-email($mailsession, $message)
} ;

 

 

Kevin

 

From: Len Schultz <le...@wi...> 
Sent: Thursday, October 28, 2021 12:24 PM
To: exist-open <exi...@li...>
Subject: [Exist-open] Sending mail via Amazon SES

 

Has anyone successfully sent email via Amazon SES via exist-db?  I’m sure I could get it working, but if there are any modules that do this already, any pointers would be greatly appreciated. 

 

--len

 

Re: [Exist-open] Sending mail via Amazon SES

[Roy W. <gar...@ya...>]

 Not SES but before upgrading to 5.x we sent a lot of mail via SendGrid. Just this:
    let $sendthemail :=
    httpclient:post(
    xs:anyURI("https://api.sendgrid.com/v3/mail/send"),
    sendgrid:get-json($mail),
    false(),
    <headers>
        <header name="authorization" value="xyz"/>
        <header name="content-type" value="application/json"/>
    </headers>
    )
httpclient:post is redundant, now replaced with HTTP Client Module. I've yet to get that working in the same way with 5.x as it raises a CORS error.
Regards,Roy


    On Friday, 29 October 2021, 12:28:25 BST, Nick Sincaglia <nsi...@nu...> wrote:  
 
  We also use SES. My recollection is that setting up SES in the AWS console and with my domain provider was the hardest part. We wrote a document on the step-by-step process. I am happy to share it with you (and anyone else who might be interested). I just need to remove all of our sensitive information before sending it out. The Xquery code is pretty minimal. I would be happy to send you what I have as well. 
 
 Let me carve out a little time this weekend and I will get what I have prepared to be sent out.
 
 Nick
 
 On 10/28/21 6:18 PM, Kevin Brown wrote:
  
 
 
We do Len. I will dig out the modules for you direct but not post here because of the keys required.
 
  
 
Kevin
 
  
   
From: Len Schultz <le...@wi...> 
 Sent: Thursday, October 28, 2021 12:24 PM
 To: exist-open <exi...@li...>
 Subject: [Exist-open] Sending mail via Amazon SES
   
  
 
Has anyone successfully sent email via Amazon SES via exist-db?  I’m sure I could get it working, but if there are any modules that do this already, any pointers would be greatly appreciated. 
  
  
   
--len
   
  
   
  
  _______________________________________________
Exist-open mailing list
Exi...@li...
https://lists.sourceforge.net/lists/listinfo/exist-open
 
 -- 
Nick Sincaglia 
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu... 
http://www.nuemeta.com
Skype: nsincaglia _______________________________________________
Exist-open mailing list
Exi...@li...
https://lists.sourceforge.net/lists/listinfo/exist-open
  

Re: [Exist-open] Sending mail via Amazon SES

[Nick S. <nsi...@nu...>]

We also use SES. My recollection is that setting up SES in the AWS 
console and with my domain provider was the hardest part. We wrote a 
document on the step-by-step process. I am happy to share it with you 
(and anyone else who might be interested). I just need to remove all of 
our sensitive information before sending it out. The Xquery code is 
pretty minimal. I would be happy to send you what I have as well.

Let me carve out a little time this weekend and I will get what I have 
prepared to be sent out.

Nick

On 10/28/21 6:18 PM, Kevin Brown wrote:
>
> We do Len. I will dig out the modules for you direct but not post here 
> because of the keys required.
>
> Kevin
>
> *From:* Len Schultz <le...@wi...>
> *Sent:* Thursday, October 28, 2021 12:24 PM
> *To:* exist-open <exi...@li...>
> *Subject:* [Exist-open] Sending mail via Amazon SES
>
> Has anyone successfully sent email via Amazon SES via exist-db?  I’m 
> sure I could get it working, but if there are any modules that do this 
> already, any pointers would be greatly appreciated.
>
> --len
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...  
http://www.nuemeta.com
Skype: nsincaglia

Re: [Exist-open] Sending mail via Amazon SES

[Kevin B. <kev...@xp...>]

We do Len. I will dig out the modules for you direct but not post here because of the keys required.

 

Kevin

 

From: Len Schultz <le...@wi...> 
Sent: Thursday, October 28, 2021 12:24 PM
To: exist-open <exi...@li...>
Subject: [Exist-open] Sending mail via Amazon SES

 

Has anyone successfully sent email via Amazon SES via exist-db?  I’m sure I could get it working, but if there are any modules that do this already, any pointers would be greatly appreciated. 

 

--len

 

[Exist-open] Sending mail via Amazon SES

[Len S. <le...@wi...>]

Has anyone successfully sent email via Amazon SES via exist-db?  I’m sure I could get it working, but if there are any modules that do this already, any pointers would be greatly appreciated.

--len

Re: [Exist-open] Cannot open existdb

[Radu C. <rad...@sy...>]

Hi,

To avoid this from happening the Exist dmg package should be notarized:

https://developer.apple.com/documentation/security/notarizing_macos_software_before_distribution

Until this happens, as another workaround which recently worked for me 
you can remove the quarantine flag from the Exist installation folder, 
we have a topic in the Oxygen user's manual about removing the 
quarantine flag for Oxygen, but it's similar:

https://www.oxygenxml.com/doc/versions/23.1/ug-editor/topics/archive-fails-to-run-mac.html#archive-fails-to-run-mac__solution

Regards,

Radu

Radu Coravu
Oxygen XML Editor

On 10/28/21 05:29, Elisa Beshero-Bondar wrote:
> Hi John,
> Apple tries to prevent people from running software released outside 
> their proprietary orbit. But you will still be able to open and run 
> it, and other non-Apple-vended software too. These instructions may be 
> helpful:
>
> https://support.apple.com/guide/mac-help/apple-cant-check-app-for-malicious-software-mchleab3a043/mac
>
> Last spring, I drafted some instructions to assist my students to 
> install eXist locally on Macs and PCs, building on the official 
> documentation (trying to anticipate things that might go wrong). In 
> case helpful here they are. I should probably add this Apple security 
> issue to my document!
>
> https://github.com/newtfire/textAnalysis-Hub/blob/main/Install-eXist-dB.md
>
> Cheers,
> Elisa
>
> Elisa Beshero-Bondar, PhD (she/they)
> Program Chair of Digital Media, Arts, and Technology | Professor of 
> Digital Humanities | Director of the Digital Humanities Lab at Penn 
> State Erie, The Behrend College
>
> Typeset by hand on my iPhone
>
>> On Oct 27, 2021, at 10:12 PM, John Preimonas <jpr...@ho...> 
>> wrote:
>>
>>  Hi eXist-db folk,
>> I have loaded eXist-db v5.3.0 and now Apple is *_blocking_* me from 
>> running eXist-db! I get the following message:
>>
>>     “eXist-db” can’t be opened because Apple cannot check if for
>>     malicious software.
>>     This software needs to be updated. Contact the developer for more
>>     information.
>>     Safari downloaded this file today at 11:34 from
>>     github.releases.githubusercontent.com
>>     <http://github.releases.githubusercontent.com>.
>>
>>
>> Please help, as I cannot progress with using v5.3.0 or do I need to 
>> restore to my v5.2.0?
>>
>>
>> John Preimonas
>> M: 0478936636
>> jpr...@ho...
>> /
>> Flying might not be all plain sailing, but the fun of it is worth the 
>> price.— Amelia Earhart/
>>
>>
>>
>>
>>
>>
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li...
>> https://lists.sourceforge.net/lists/listinfo/exist-open
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

Re: [Exist-open] Cannot open existdb

[Elisa Beshero-B. <ebb...@gm...>]

Hi John,
Apple tries to prevent people from running software released outside their proprietary orbit. But you will still be able to open and run it, and other non-Apple-vended software too. These instructions may be helpful:

https://support.apple.com/guide/mac-help/apple-cant-check-app-for-malicious-software-mchleab3a043/mac

Last spring, I drafted some instructions to assist my students to install eXist locally on Macs and PCs, building on the official documentation (trying to anticipate things that might go wrong). In case helpful here they are. I should probably add this Apple security issue to my document! 

https://github.com/newtfire/textAnalysis-Hub/blob/main/Install-eXist-dB.md

Cheers,
Elisa

Elisa Beshero-Bondar, PhD (she/they)
Program Chair of Digital Media, Arts, and Technology | Professor of Digital Humanities |  Director of the Digital Humanities Lab at Penn State Erie, The Behrend College 

Typeset by hand on my iPhone

> On Oct 27, 2021, at 10:12 PM, John Preimonas <jpr...@ho...> wrote:
> 
>  Hi eXist-db folk,
> I have loaded eXist-db v5.3.0 and now Apple is blocking me from running eXist-db! I get the following message: 
> “eXist-db” can’t be opened because Apple cannot check if for malicious software. 
> This software needs to be updated. Contact the developer for more information. 
> Safari downloaded this file today at 11:34 from github.releases.githubusercontent.com.
> 
> Please help, as I cannot progress with using v5.3.0 or do I need to restore to my v5.2.0?
> 
> 
> John Preimonas
> M: 0478936636
> jpr...@ho...
> 
> Flying might not be all plain sailing, but the fun of it is worth the price.— Amelia Earhart
> 
> 
> 
> 
> 
> 
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

[Exist-open] Cannot open existdb

[John P. <jpr...@ho...>]

Hi eXist-db folk,
I have loaded eXist-db v5.3.0 and now Apple is blocking me from running eXist-db! I get the following message: 
“eXist-db” can’t be opened because Apple cannot check if for malicious software. 
This software needs to be updated. Contact the developer for more information. 
Safari downloaded this file today at 11:34 from github.releases.githubusercontent.com.

Please help, as I cannot progress with using v5.3.0 or do I need to restore to my v5.2.0?


John Preimonas
M: 0478936636
jpr...@ho...

Flying might not be all plain sailing, but the fun of it is worth the price.— Amelia Earhart

Re: [Exist-open] mysql jdbc

[Слава С. <wet...@gm...>]

Hi,

I tried few days ago to connect eXist to MariaDB - sadly it not work at
least in my case. Exist can work as "New Exchange server" so i guess any
"connectors" should work "out of the box" or should be easily attached in
same way as "xar"-packages for example.

With best wishes,
Sla

ср, 20 окт. 2021 г., 18:55 Loren Cahlander <lor...@gm...>:

> It should install from the package manager.  I think that the SQL module
> will need to implement
>
> Class.forName(jdbcDriver.getStringValue()).newInstance();
>
> To be able to load the driver.  I have that in my own package that does
> JDBC calls for other reasons and it loads the JDBC driver.
>
> On Oct 7, 2021, at 2:11 PM, Roy Walter <gar...@ya...>
> wrote:
>
> Hi Loren,
>
> Should this install from the package manager (eXist 5.2)? The only way I
> can make it work is a manual install per your post here:
>
> https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector
> <https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connectorhttps://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector>
>
> Thanks and regards,
> Roy
>
> On Tuesday, 5 October 2021, 19:42:36 BST, Loren Cahlander <
> lor...@gm...> wrote:
>
>
> Hello Roy,
>
> Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver
>
> Loren
>
> On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <
> exi...@li...> wrote:
>
> Hi,
>
> Could someone point me to a reference for implementing this in 5.x please.
>
> Also, do I need to download the .jar file or is it installed with eXist
> (as some online sources suggest)?
>
> Thanks in advance,
> Roy
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

Re: [Exist-open] Function conflict?

[Nick S. <nsi...@nu...>]

All:
     I was able to resolve this issue by downgrading my version of Java 
to Java 8 from Java 11. That seemed to resolve the issue.

Nick

On 10/24/21 11:34 PM, Nick Sincaglia wrote:
> I just installed the latest eXist-db v5.3.0 on a server. I started to 
> copy over my XQuery code to the server using WebDAV. Everything was 
> copying over fine until I tried to copy a module I wrote called 
> utilities.xqm. When I tried copying utilities.xqm over to the server, 
> I got the following error:
>
> Could not initialize class org.exist.xquery.modules.mail.MailModule
>
> I found this very puzzling. So, I tried to create this file from 
> scratch in eXide. I created an empty utilities.xqm file and I then 
> copied one function at a time from my original utilities.xqm file and 
> I would save the new file. I did this for each function from my 
> original file. I discovered that when I copied and pasted a function 
> called utilities:date-time-directory(), this is when eXist-db would 
> display a pop-up window in eXide with the above mentioned error.
>
> Is this a function name conflict with something in 
> org.exist.xquery.modules.mail.MailModule?
>
> If I change my function name to utilities:date-time-directories() 
> instead, the file saves just fine. But if I change the function back 
> to utilities:date-time-directory(), I get the "Could not initialize 
> class org.exist.xquery.modules.mail.MailModule" error message.
>
> I tried looking through my code to see if there was any references to 
> utilities:date-time-directory() anywhere in my code and if any 
> references were in an XQuery module that imported the 
> org.exist.xquery.modules.mail.MailModule. However, when I tried to 
> pull of Edit -> Find in files in the eXide menu, that tool did not 
> respond. Normally a pop-up window would appear and allow me to search 
> my code for a particular string. No pop-up window would appear.
>
> I am a little confused. Does anyone have any insights to this issue?
>
> Nick
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...  
http://www.nuemeta.com
Skype: nsincaglia

[Exist-open] Function conflict?

[Nick S. <nsi...@nu...>]

I just installed the latest eXist-db v5.3.0 on a server. I started to 
copy over my XQuery code to the server using WebDAV. Everything was 
copying over fine until I tried to copy a module I wrote called 
utilities.xqm. When I tried copying utilities.xqm over to the server, I 
got the following error:

Could not initialize class org.exist.xquery.modules.mail.MailModule

I found this very puzzling. So, I tried to create this file from scratch 
in eXide. I created an empty utilities.xqm file and I then copied one 
function at a time from my original utilities.xqm file and I would save 
the new file. I did this for each function from my original file. I 
discovered that when I copied and pasted a function called 
utilities:date-time-directory(), this is when eXist-db would display a 
pop-up window in eXide with the above mentioned error.

Is this a function name conflict with something in 
org.exist.xquery.modules.mail.MailModule?

If I change my function name to utilities:date-time-directories() 
instead, the file saves just fine. But if I change the function back to 
utilities:date-time-directory(), I get the "Could not initialize class 
org.exist.xquery.modules.mail.MailModule" error message.

I tried looking through my code to see if there was any references to 
utilities:date-time-directory() anywhere in my code and if any 
references were in an XQuery module that imported the 
org.exist.xquery.modules.mail.MailModule. However, when I tried to pull 
of Edit -> Find in files in the eXide menu, that tool did not respond. 
Normally a pop-up window would appear and allow me to search my code for 
a particular string. No pop-up window would appear.

I am a little confused. Does anyone have any insights to this issue?

Nick

[Exist-open] Serialization

[Roy W. <gar...@ya...>]

Hi,
Pre 5.x this used to work for converting special characters, e.g., &lt; to <, when outputting HTM:

let $cleanedAnswer := util:serialize($wrans//Answer/Value/text(),"method=text")
This, however, doesn't work:
let $cleanedAnswer := serialize($wrans//Answer/Value/text(), map{"method" : "text"})
What am I  missing?
Thanks as ever,Roy

Re: [Exist-open] Looking to create a docker image

[Loren C. <lor...@gm...>]

Hello Mathias,

I will try that. Thank you for the information.  

Best,
Loren



> On Oct 18, 2021, at 6:33 AM, Mathias Göbel <go...@su...> wrote:
> 
> Hi Loren,
> 
> i would recommend creating a docker-compose setup with three containers: nginx, react app, eXist-db. So you can seamless update your applications and it will increase the security by increased isolation.
> 
> Basically you can take the exist-db docker and simply COPY your XAR packages to the autodeploy directory:
> 
> FROM existdb/existdb:5.3.0
> 
> # copy EXPath packages
> COPY [PATHTO]/*.xar /exist/autodeploy/
> COPY [PATHTO-dependencies]/*.xar /exist/autodeploy/
> 
> 
> For using with apache httpd you can find a more complete setup at https://gitlab.gwdg.de/subugoe/ahiqar/backend/-/tree/develop/docker <https://gitlab.gwdg.de/subugoe/ahiqar/backend/-/tree/develop/docker>
> best,
> Mathias
> 
> On 15.10.21 21:44, Loren Cahlander wrote:
>> Hello folks,
>> 
>> I have several Git repositories.
>> 
>> A ReactJS web application
>> A data XAR application
>> An RestXQ API XAR application
>> 
>> What I would like is to create a docker image with the ReactJS web app deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone created such an image?
>> 
>> Thank you,
>> Loren
>> 
>> 
>> 
>> 
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li... <mailto:Exi...@li...>
>> https://lists.sourceforge.net/lists/listinfo/exist-open <https://lists.sourceforge.net/lists/listinfo/exist-open>
> -- 
> Mathias Göbel
> University of Göttingen
> Göttingen State and University Library
> D-37070 Göttingen
> 
> Research and Development
> Papendiek 14 (hist. Building, Room 2.408 <https://lageplan.uni-goettingen.de/?ident=7209_4_2.OG_2.408>)
> +49 551 39-25823 (Tel., Wednesday to Friday)
> +49 551 39-33856 (Fax.)
> 
> Digital Library
> Software and Service Development
> Platz der Göttinger Sieben 1 (Central Library, Room 2.129 <https://lageplan.uni-goettingen.de/?ident=5383_1_2.OG_2.129>)
> +49 551 39-10230 (Tel., Monday/Tuesday)
> 
> go...@su... <mailto:goebel@sub.uni=          -goettingen.de>
> http://www.sub.uni-goettingen.de <https://www.sub.uni-goettingen.de/en/news/>_______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

Re: [Exist-open] Looking to create a docker image

[Loren C. <lor...@gm...>]

Thank you for your feedback.  I will try that.

> On Oct 18, 2021, at 1:51 AM, Peter Stadler <st...@ed...> wrote:
> 
> Hi Loren,
> 
> I would usually do this with three containers. One frontend nginx container with the React app and another backend existdb container with the data and API. The reverse proxying can be done with jwilder/nginx-proxy or some other HAProxy that fits your infrastructure.
> This setup would allow you to use generic Docker images into which you only need to mount your data.
> 
> Sorry, that does not answer your request but maybe it helps (someone) anyway?
> 
> Best
> Peter
> 
> 
>> Am 15.10.2021 um 21:44 schrieb Loren Cahlander <lor...@gm...>:
>> 
>> Signierter PGP-Teil
>> Hello folks,
>> 
>> I have several Git repositories.
>> 
>> 	• A ReactJS web application
>> 	• A data XAR application
>> 	• An RestXQ API XAR application
>> 
>> What I would like is to create a docker image with the ReactJS web app deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone created such an image?
>> 
>> Thank you,
>> Loren
>> 
>> 
>> 
> 

Re: [Exist-open] mysql jdbc

[Loren C. <lor...@gm...>]

It should install from the package manager.  I think that the SQL module will need to implement

Class.forName(jdbcDriver.getStringValue()).newInstance();
To be able to load the driver.  I have that in my own package that does JDBC calls for other reasons and it loads the JDBC driver.

> On Oct 7, 2021, at 2:11 PM, Roy Walter <gar...@ya...> wrote:
> 
> Hi Loren,
> 
> Should this install from the package manager (eXist 5.2)? The only way I can make it work is a manual install per your post here:
> https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector <https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connectorhttps://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector>
> 
> Thanks and regards,
> Roy
> 
> On Tuesday, 5 October 2021, 19:42:36 BST, Loren Cahlander <lor...@gm...> wrote:
> 
> 
> Hello Roy,
> 
> Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver <https://github.com/eXist-db/exist-mysql-jdbc-driver>
> 
> Loren
> 
>> On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <exi...@li... <mailto:exi...@li...>> wrote:
>> 
>> Hi,
>> 
>> Could someone point me to a reference for implementing this in 5.x please.
>> 
>> Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
>> 
>> Thanks in advance,
>> Roy
>> _______________________________________________
>> Exist-open mailing list
>> Exi...@li... <mailto:Exi...@li...>
>> https://lists.sourceforge.net/lists/listinfo/exist-open
> 

[Exist-open] Damaged and Orphaned Documents

[Nick S. <nsi...@nu...>]

One of my eXist-db systems became unresponsive today. I was forced to 
shut it down. When I restarted it, it ran through the typical checks and 
it found 2 damaged and orphaned documents (see below). My question is, 
"Is my system OK? It started up after discovering these problems. Is 
there something more I should do? Will these damaged and orphaned 
documents haunt me in the future?"

Nick

2021-10-19 02:28:54,744 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3643) - Rebuilding index dom.dbx
2021-10-19 02:29:15,690 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3645) - Index dom.dbx was rebuilt.
2021-10-19 02:29:15,690 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3643) - Rebuilding index collections.dbx
2021-10-19 02:29:16,174 [main] INFO  (NativeBroker.java 
[rebuildIndex]:3645) - Index collections.dbx was rebuilt.
2021-10-19 02:29:16,574 [main] INFO  (BlobStoreImplService.java 
[startSystem]:72) - Opened de-duplicating Blob Store v1. 
metadata=blob.dbx, store=blob/
2021-10-19 02:29:16,710 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,723 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,731 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,745 [main] ERROR (AnalyzerConfig.java 
[configureAnalyzer]:174) - Lucene index: analyzer class 
org.apache.lucene.analysis.WhitespaceAnalyzer not found. 
(org.apache.lucene.analysis.WhitespaceAnalyzer)
2021-10-19 02:29:16,861 [main] INFO  (NativeBroker.java [repair]:3607) - 
Removing index files ...
2021-10-19 02:29:16,903 [main] INFO  (NativeBroker.java [repair]:3615) - 
Recreating index files ...
2021-10-19 02:29:16,967 [main] INFO  (NativeBroker.java [repair]:3629) - 
Reindexing database files ...
2021-10-19 02:32:25,048 [main] INFO  (ConsistencyCheckTask.java 
[execute]:151) - Starting consistency check...
2021-10-19 02:32:32,420 [main] ERROR (ConsistencyCheckTask.java 
[execute]:164) - Errors found: 2
2021-10-19 02:32:32,420 [main] ERROR (ConsistencyCheckTask.java 
[execute]:169) - Fatal errors were found: pausing the consistency check 
task.
2021-10-19 02:32:32,421 [main] INFO  (ConsistencyCheckTask.java 
[execute]:174) - Finished consistency check
2021-10-19 02:32:32,421 [main] INFO  (ConsistencyCheckTask.java 
[execute]:178) - Starting backup...
2021-10-19 02:33:00,314 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0097849003590-20210622192014751.xml
2021-10-19 02:34:08,481 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0035159832783-20210505040911732.xml
2021-10-19 02:34:43,977 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0035159832783-20210505040911732.xml
2021-10-19 02:34:44,008 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0097849003590-20210622192014751.xml
2021-10-19 02:35:28,485 [main] INFO  (ConsistencyCheckTask.java 
[execute]:185) - Created backup to file: 
/mnt/data/exist-5.3.0-snapshot/etc/../data/sanity/full20211019-0232.zip
2021-10-19 02:35:28,486 [main] INFO  (ConsistencyCheckTask.java 
[execute]:188) - Finished backup

-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...
http://www.nuemeta.com
Skype: nsincaglia

Re: [Exist-open] Looking to create a docker image

[Mathias G. <go...@su...>]

Hi Loren,

i would recommend creating a docker-compose setup with three containers: 
nginx, react app, eXist-db. So you can seamless update your applications 
and it will increase the security by increased isolation.

Basically you can take the exist-db docker and simply COPY your XAR 
packages to the autodeploy directory:

    FROM existdb/existdb:5.3.0

    # copy EXPath packages
    COPY [PATHTO]/*.xar /exist/autodeploy/
    COPY [PATHTO-dependencies]/*.xar /exist/autodeploy/

For using with apache httpd you can find a more complete setup at 
https://gitlab.gwdg.de/subugoe/ahiqar/backend/-/tree/develop/docker

best,
Mathias

On 15.10.21 21:44, Loren Cahlander wrote:
> Hello folks,
>
> I have several Git repositories.
>
>   * A ReactJS web application
>   * A data XAR application
>   * An RestXQ API XAR application
>
>
> What I would like is to create a docker image with the ReactJS web app 
> deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two 
> XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone 
> created such an image?
>
> Thank you,
> Loren
>
>
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
-- 
Mathias Göbel
University of Göttingen
Göttingen State and University Library
D-37070 Göttingen

Research and Development
Papendiek 14 (hist. Building, Room 2.408 
<https://lageplan.uni-goettingen.de/?ident=7209_4_2.OG_2.408>)
+49 551 39-25823 (Tel., Wednesday to Friday)
+49 551 39-33856 (Fax.)

Digital Library
Software and Service Development
Platz der Göttinger Sieben 1 (Central Library, Room 2.129 
<https://lageplan.uni-goettingen.de/?ident=5383_1_2.OG_2.129>)
+49 551 39-10230 (Tel., Monday/Tuesday)

go...@su... <mailto:goebel@sub.uni= -goettingen.de>
http://www.sub.uni-goettingen.de 
<https://www.sub.uni-goettingen.de/en/news/>

Re: [Exist-open] eXide display issues

[Joe W. <jo...@gm...>]

Hi Roy,

Several issues, including your #2, were fixed in the just-released eXide
3.1.1 (available via Dashboard > Package Manager). See the release notes
here:

  https://github.com/eXist-db/eXide/releases

For the other problems you mentioned, I'd encourage you to file issues in
the eXide repository.

Cheers,
Joe

On Thu, Oct 7, 2021 at 2:49 PM Roy Walter via Exist-open <
exi...@li...> wrote:

> Hi,
>
> I can't be the only one seeing this in file browsers:
>
> 1. Date forrmat stuck on mm/dd/yyyy
> 2. When scrolling display does not update -- no files visible
> 3. Column sort options in file browers would be nice.
>
> Almost immediate login expiry is also a bit of a pain.
>
> Thanks,
> Roy
>
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>

[Exist-open] Looking to create a docker image

[Loren C. <lor...@gm...>]

Hello folks,

I have several Git repositories.

A ReactJS web application
A data XAR application
An RestXQ API XAR application

What I would like is to create a docker image with the ReactJS web app deployed in Nginx with a reverse proxy to eXist-db 5.3.0 and the two XAR to be packaged (maven) and XARs placed in auto deploy.  Has anyone created such an image?

Thank you,
Loren

[Exist-open] WebRTC webcam snap shot and upload to EXIST-DB

[Gary <ga...@ra...>]

  
Hi Guys, 
  
I am trying to take a picture in the web browser using a webcam such as from a phone and upload to EXIST-DB and wonder if there is anyone who knows all about this already and could kindly share pointers to some documentation or some general tips, advice or recommendations how to achieve this. 
  
Chrome and some other browsers support taking pictures as part of the WebRTC standardization and there are lots of sites using this functionality such as: 
https://webcamtoy.com/ 
  
All the tutorial examples I found so far are using PHP/node-js back-end and I am hoping to work out instead a way to post to xquery from HTML/JavaScript HTML FORM video and canvas into EXIST-DB. I guess I need the binary-to-string like this on the server side: 
 xmldb:store($collection, $filename, util:binary-to-string(request:get-uploaded-file-data('file')))

It would be great to share ideas on this as it looks really useful for so many different use cases. I am also wondering about the best formatting png or JPEG etc., ideal file
and encoding (base64?), metadata and standard webcam picture sizing and am hoping for some pointers for some optimal settings for those.

Kindest regards,
Gary  

  

[Exist-open] Consistency Check

[Nick S. <nsi...@nu...>]

I had a system of mine crash due to a Java Heap Exception. When I 
restarted the system, I watched the exist.log and it reported the below 
information. The system is running now, but I am not sure if I should be 
concerned about these damaged and orphaned documents. Is my system OK 
with the exception of these damaged and orphaned documents? Or should I 
do a back up and restore and then later address these damaged and 
orphaned documents? I am not very concerned about these 4 documents. I 
am more concerned about if my system is damaged and will cause me 
problems in the future.

Nick


2021-10-08 04:32:38,739 [main] INFO  (NativeBroker.java [repair]:3607) - 
Removing index files ...
2021-10-08 04:32:38,796 [main] INFO  (NativeBroker.java [repair]:3615) - 
Recreating index files ...
2021-10-08 04:32:38,874 [main] INFO  (NativeBroker.java [repair]:3629) - 
Reindexing database files ...
2021-10-08 04:35:46,043 [main] INFO  (ConsistencyCheckTask.java 
[execute]:151) - Starting consistency check...
2021-10-08 04:35:53,055 [main] ERROR (ConsistencyCheckTask.java 
[execute]:164) - Errors found: 2
2021-10-08 04:35:53,055 [main] ERROR (ConsistencyCheckTask.java 
[execute]:169) - Fatal errors were found: pausing the consistency check 
task.
2021-10-08 04:35:53,055 [main] INFO  (ConsistencyCheckTask.java 
[execute]:174) - Finished consistency check
2021-10-08 04:35:53,055 [main] INFO  (ConsistencyCheckTask.java 
[execute]:178) - Starting backup...
2021-10-08 04:36:21,735 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0097849003590-20210622192014751.xml
2021-10-08 04:37:29,456 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Skipping damaged document 
0035159832783-20210505040911732.xml
2021-10-08 04:38:02,818 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0035159832783-20210505040911732.xml
2021-10-08 04:38:02,848 [main] ERROR (ConsistencyCheckTask.java 
[error]:249) - EXPORT: Found an orphaned document: 
0097849003590-20210622192014751.xml
2021-10-08 04:38:46,511 [main] INFO  (ConsistencyCheckTask.java 
[execute]:185) - Created backup to file: 
/mnt/data/exist-5.3.0-snapshot/etc/../data/sanity/full20211008-0435.zip
2021-10-08 04:38:46,511 [main] INFO  (ConsistencyCheckTask.java 
[execute]:188) - Finished backup



-- 
Nick Sincaglia
President/Founder
NueMeta, LLC
Digital Media & Technology
Phone: +1-630-303-7035
nsi...@nu...
http://www.nuemeta.com
Skype: nsincaglia

[Exist-open] eXide display issues

[Roy W. <gar...@ya...>]

Hi,
I can't be the only one seeing this in file browsers:

1. Date forrmat stuck on mm/dd/yyyy2. When scrolling display does not update -- no files visible3. Column sort options in file browers would be nice.
Almost immediate login expiry is also a bit of a pain.

Thanks,Roy

Re: [Exist-open] mysql jdbc

[Roy W. <gar...@ya...>]

 Hi Loren,
Should this install from the package manager (eXist 5.2)? The only way I can make it work is a manual install per your post here:https://stackoverflow.com/questions/65483026/exist-db-installing-mysql-connector
Thanks and regards,Roy

    On Tuesday, 5 October 2021, 19:42:36 BST, Loren Cahlander <lor...@gm...> wrote:  
 
 Hello Roy,
Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver
Loren


On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <exi...@li...> wrote:
Hi,
Could someone point me to a reference for implementing this in 5.x please.
Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
Thanks in advance,Roy
_______________________________________________
Exist-open mailing list
Exi...@li...
https://lists.sourceforge.net/lists/listinfo/exist-open


  

Re: [Exist-open] mysql jdbc

[Loren C. <lor...@gm...>]

Hello Roy,

Please check out https://github.com/eXist-db/exist-mysql-jdbc-driver <https://github.com/eXist-db/exist-mysql-jdbc-driver>

Loren

> On Oct 5, 2021, at 5:37 AM, Roy Walter via Exist-open <exi...@li...> wrote:
> 
> Hi,
> 
> Could someone point me to a reference for implementing this in 5.x please.
> 
> Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
> 
> Thanks in advance,
> Roy
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open

[Exist-open] mysql jdbc

[Roy W. <gar...@ya...>]

Hi,
Could someone point me to a reference for implementing this in 5.x please.
Also, do I need to download the .jar file or is it installed with eXist (as some online sources suggest)?
Thanks in advance,Roy