exist-development — eXist Developer's List

Re: [Exist-development] Errors from Stress tests on xquery update

[Wolfgang M. <wol...@ex...>]

> Thanks. I will test this workaround. So would you consider this to be a bug
> that will be eventually fixed in eXist, or will developers always need to be
> aware of this when using the update methods?

There seems to be a bug. eXist does allow dirty reads, which means it
is possible for node references to become invalid during a query.
Nevertheless a started transaction must not abort.

I have received another test from someone else which fails for similar
reasons. We have to figure out what causes this. It's not easy though.
If you have a reproducible test, I'll be happy to compare it to the
other scenario I have.

Wolfgang

Re: [Exist-development] Errors from Stress tests on xquery update

[Casey J. <cas...@jo...>]

Wolfgang,

Thanks. I will test this workaround. So would you consider this to be a bug
that will be eventually fixed in eXist, or will developers always need to
be aware of this when using the update methods?

Thanks,

Casey

On Wed, Jul 18, 2012 at 2:18 PM, Wolfgang Meier <wol...@ex...>wrote:

> Hi Casey,
>
> the NullPointerException in your logs occur after the corresponding
> documents have been locked. It thus seems the locking did fail or miss
> some nodes for unknown reasons and the update tried to operate on a
> node which was deleted.
>
> To avoid such issues, it might help to explicitely put a lock on the
> documents before you start the actual modifications. There's a
> (pseudo-) function: util:exclusive-lock($nodes as node()*, $expression
> as item()*) item()*. It takes a sequence of nodes from documents to be
> locked and acquires an exclusive lock before it executes the code
> block given in $expression.
>
> Wolfgang
>



-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

[Exist-development] Fwd: Errors from Stress tests on xquery update

[Wolfgang M. <wol...@ex...>]

Hi Casey,

the NullPointerException in your logs occur after the corresponding
documents have been locked. It thus seems the locking did fail or miss
some nodes for unknown reasons and the update tried to operate on a
node which was deleted.

To avoid such issues, it might help to explicitely put a lock on the
documents before you start the actual modifications. There's a
(pseudo-) function: util:exclusive-lock($nodes as node()*, $expression
as item()*) item()*. It takes a sequence of nodes from documents to be
locked and acquires an exclusive lock before it executes the code
block given in $expression.

Wolfgang

[Exist-development] Errors from Stress tests on xquery update

[Casey J. <cas...@jo...>]

Hi all,

Just added a stress test for trunk which performs lot's of xquery updates
across 3 large documents in the same collection. The goal was to simulate
collisions between heavy update operations. When only "update insert" was
used the database seemed to preform fine, when "update delete" was added
the database threw many errors and would not restart (See output samples at
end of email)

The test simulates 30 simultaneous users each doing 1000 runs through the
REST api.

There are 3 operations that each run does: (insert attribute, insert
element, delete element). The testing data contains 3 1MB xml files with
lots of <scm:edge> nodes.

The query's look like this:

----- Insert attributes -------
*let $all-nodes :=
collection('/db/xupdate-test-collection')//*[local-name() = 'edge']
let $sub-nodes := subsequence($all-nodes, 0, 50)
*
*return
*
*for $node in $sub-nodes return update insert attrbute foo {'bar'} into
$node*

----- Insert elements -------
*let $all-nodes :=
collection('/db/xupdate-test-collection')//*[local-name() = 'edge']
let $sub-nodes := subsequence($all-nodes, 0, 50)
*
*return
*
*for $node in $sub-nodes return update insert element {'bar'}{} into $node*

----- Delete elements -------
*let $all-nodes :=
collection('/db/xupdate-test-collection')//*[local-name() = 'edge']
let $sub-nodes := subsequence($all-nodes, 0, 50)
*
*return
*
*for $node in $sub-nodes return update delete $node*

When utilizing all three, the logs filled with NPE's like these:

*17 Jul 2012 17:40:00,193 [eXistThread-52] WARN  (ServletHandler.java
[doHandle]:553) - /exist/rest/db/
java.lang.NullPointerException
    at
org.exist.xquery.update.Modification.selectAndLock(Modification.java:157)
    at org.exist.xquery.update.Delete.eval(Delete.java:123)
    at
org.exist.xquery.DebuggableExpression.eval(DebuggableExpression.java:56)
    at
org.exist.xquery.DebuggableExpression.eval(DebuggableExpression.java:63)
    at org.exist.xquery.ForExpr.eval(ForExpr.java:303)
    at org.exist.xquery.BindingExpression.eval(BindingExpression.java:156)
    at
org.exist.xquery.DebuggableExpression.eval(DebuggableExpression.java:56)
    at
org.exist.xquery.DebuggableExpression.eval(DebuggableExpression.java:63)
    at org.exist.xquery.LetExpr.eval(LetExpr.java:200)
    at org.exist.xquery.LetExpr.eval(LetExpr.java:198)
    at org.exist.xquery.BindingExpression.eval(BindingExpression.java:156)
    at org.exist.xquery.AbstractExpression.eval(AbstractExpression.java:71)
    at org.exist.xquery.PathExpr.eval(PathExpr.java:268)
    at org.exist.xquery.AbstractExpression.eval(AbstractExpression.java:71)
    at org.exist.xquery.XQuery.execute(XQuery.java:246)
 .....
17 Jul 2012 17:40:00,193 [eXistThread-52] WARN  (ServletHandler.java
[doHandle]:553) - /exist/rest/db/
java.lang.NullPointerException
    at
org.exist.xquery.update.Modification.selectAndLock(Modification.java:157)
    at org.exist.xquery.update.Insert.eval(Insert.java:139)
    at
org.exist.xquery.DebuggableExpression.eval(DebuggableExpression.java:56)
    at
org.exist.xquery.DebuggableExpression.eval(DebuggableExpression.java:63)
    at org.exist.xquery.ForExpr.eval(ForExpr.java:303)
    at org.exist.xquery.BindingExpression.eval(BindingExpression.java:156)
    at
org.exist.xquery.DebuggableExpression.eval(DebuggableExpression.java:56)
.....
*

After shutting down the database and running a consistency check the
following output was observed:

*Running consistency check

File lock last access timestamp: Jul 17, 2012
[path-omitted]/eXist/../data/dbx_dir.lck
Found a stale lockfile. Trying to remove it:
[path-omitted]/eXist/../data/dbx_dir.lck
File lock last access timestamp: Jul 17, 2012
[path-omitted]/eXist/../data/journal.lck
Found a stale lockfile. Trying to remove it:
[path-omitted]/eXist/../data/journal.lck
ERROR: Failed to open database: java.lang.StackOverflowError*

I would like to understand what is causing this better so we can ither
improve the handling in eXist, or offer a workaround to developers which
will be using xquery updates in high load situations.

Thanks,

Casey

-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

Re: [Exist-development] Subversion extension breaking build in trunk?

[Joe W. <jo...@gm...>]

Hi Dmitriy,

>>> use older version of svn jar
>>
>> DO you mean Joe needs to use an older version of a jar? is it the svnkit jar files?
>
> yes

I see: the SVN extension skips downloading the svnkit jars if they're
already present, but if they're missing, it downloads version 1.3.3
(see extensions/svn/build.xml line 75).  Since I had already run
"build.sh svn-download", the jars were present, but this
"svn-download" step actually downloaded version 1.3.7
(build/scripts/subversion.xml line 29).

Given this, I thought the solution was to change
build/scripts/subversion.xml to reference version 1.3.3, but when I do
this, "build svn-download" fails, since this version isn't available
at the location where the script looks:
http://maven.tmatesoft.com/content/repositories/releases/org/tmatesoft/svnkit/svnkit-cli/1.3.3/svnkit-cli-1.3.3.jar.
 So I think our options for fixing the build are either:

1. Find 1.3.3 and update the download URLs in
build/scripts/subversion.xml to point to that instead of 1.3.7.

- or -

2. Fix the SVN extension's apparent incompatibility with 1.3.7.

If there's anything I can do to help, let me know.

Thanks,
Joe

Re: [Exist-development] Subversion extension breaking build in trunk?

[Dmitriy S. <sha...@gm...>]

On Sat, Jul 7, 2012 at 11:18 PM, Dannes Wessels <da...@ex...> wrote:

> HI
>
> On Saturday, 7 July 2012 at 20:14 , Dmitriy Shabanov wrote:
>
> use older version of svn jar
>
>  DO you mean Joe needs to use an older version of a jar? is it the svnkit
> jar files?
>
>
yes

-- 
Dmitriy Shabanov

Re: [Exist-development] Subversion extension breaking build in trunk?

[Dannes W. <da...@ex...>]

HI

On Saturday, 7 July 2012 at 20:14 , Dmitriy Shabanov wrote:

> use older version of svn jar 
DO you mean Joe needs to use an older version of a jar? is it the svnkit jar files? 

cheers

Dannes

-- 
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

Re: [Exist-development] Subversion extension breaking build in trunk?

[Dmitriy S. <sha...@gm...>]

use older version of svn jar

On Sat, Jul 7, 2012 at 11:10 PM, Joe Wicentowski <jo...@gm...> wrote:

> p.s. Changing the SVN extension to "false" causes the build to succeed.
>
> p.p.s. This is on Mac OS X 10.7.4.
>
>
-- 
Dmitriy Shabanov

Re: [Exist-development] Subversion extension breaking build in trunk?

[Joe W. <jo...@gm...>]

p.s. Changing the SVN extension to "false" causes the build to succeed.

p.p.s. This is on Mac OS X 10.7.4.

Re: [Exist-development] Commit notifications

[Casey J. <cas...@jo...>]

Thanks Loren. Guess I should have looked harder ;)

On Sun, Jun 17, 2012 at 4:54 PM, Loren Cahlander
<lor...@gm...>wrote:

> Casey,
>
> A link to the mailing list for exist-commits is on the eXist homepage.
>
> https://lists.sourceforge.net/lists/listinfo/exist-commits
>
> Loren
>
> On Jun 17, 2012, at 3:35 PM, Casey Jordan <cas...@jo...> wrote:
>
> Is there a way to get notifications of commits with log messages via
> email? It would be really helpful.
>
> Thanks,
>
> Casey
>
> --
> --
> Casey Jordan
> easyDITA a product of Jorsek LLC
> "CaseyDJordan" on LinkedIn, Twitter & Facebook
> (585) 348 7399
> easydita.com
>
>
> This message is intended only for the use of the Addressee(s) and may
> contain information that is privileged, confidential, and/or exempt from
> disclosure under applicable law.  If you are not the intended recipient,
> please be advised that any disclosure  copying, distribution, or use of
> the information contained herein is prohibited.  If you have received
> this communication in error, please destroy all copies of the message,
> whether in electronic or hard copy format, as well as attachments, and
> immediately contact the sender by replying to this e-mail or by phone.
> Thank you.
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats.
> http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>
>
>


-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

Re: [Exist-development] Commit notifications

[Loren C. <lor...@gm...>]

Casey,

A link to the mailing list for exist-commits is on the eXist homepage.

https://lists.sourceforge.net/lists/listinfo/exist-commits 

Loren

On Jun 17, 2012, at 3:35 PM, Casey Jordan <cas...@jo...> wrote:

> Is there a way to get notifications of commits with log messages via email? It would be really helpful.
> 
> Thanks,
> 
> Casey
> 
> -- 
> --
> Casey Jordan
> easyDITA a product of Jorsek LLC
> "CaseyDJordan" on LinkedIn, Twitter & Facebook
> (585) 348 7399
> easydita.com
> 
> 
> This message is intended only for the use of the Addressee(s) and may
> contain information that is privileged, confidential, and/or exempt from
> disclosure under applicable law.  If you are not the intended recipient,
> please be advised that any disclosure  copying, distribution, or use of
> the information contained herein is prohibited.  If you have received
> this communication in error, please destroy all copies of the message,
> whether in electronic or hard copy format, as well as attachments, and
> immediately contact the sender by replying to this e-mail or by phone.
> Thank you.
> 
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and 
> threat landscape has changed and how IT managers can respond. Discussions 
> will include endpoint security, mobile security and the latest in malware 
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development

[Exist-development] Commit notifications

[Casey J. <cas...@jo...>]

Is there a way to get notifications of commits with log messages via email?
It would be really helpful.

Thanks,

Casey

-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

Re: [Exist-development] Bug in permissions or am I missing something?

[Casey J. <cas...@jo...>]

Thanks guys, I understand.

On Wed, Jun 13, 2012 at 5:37 PM, Adam Retter <ad...@ex...> wrote:

> This is not a bug. The answer is in the messages in the log, if not subtly
> ;-)
>
> Basically the message you get is -
>
> "Permission denied to open collection: /db/organizations by
> te...@ea..."
>
> The permissions on /db/organizations are 'rwxr-xr--' and the owner is
> 'admin:dba', however the user 'te...@ea...' does not have
> permission to open the collection. That is to say that you need to
> grant execute 'x' access on the collection /db/organizations for that
> account.
>
>
>
> On 13 June 2012 02:31, Casey Jordan <cas...@jo...> wrote:
> > Hi all,
> >
> > Doing more stress testing on trunk and I started to get a lot of 401
> > unauthorized errors. I did some investigation and found something
> strange.
> >
> > I have a collection /db/organizations owned by admin and group dba, but
> with
> > world readable permissions (rwxr-x-r--).
> >
> > When I login as my test user (not guest) via oXygen I get a permission
> > denied error. Looking at the logs I see:
> >
> > 2012-06-12 21:23:16,109 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> > [authenticate]:395) - Authentication try for 'te...@ea...'.
> > 2012-06-12 21:23:16,109 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> > [authenticate]:436) - Authenticated by 'exist' as '[auth] <account
> > name="te...@ea..." id="11"><group name="__test-org"
> > id="12"></group><group name="__test-org__contributor-dita-langref"
> > id="17"></group><group name="__test-org-dita-langref"
> > id="16"></group></user>'.
> > 2012-06-12 21:23:16,109 [eXistThread-37] ERROR (ExistCollection.java
> > [initMetadata]:117) - org.exist.security.PermissionDeniedException:
> > Permission denied to open collection: /db/organizations by
> > te...@ea...
> > 2012-06-12 21:23:16,110 [eXistThread-37] DEBUG (MiltonResource.java
> > [authenticate]:343) - User 'te...@ea...' has been authenticated.
> > 2012-06-12 21:23:16,111 [eXistThread-37] INFO  (MiltonResource.java
> > [authorise]:350) - PROPFIND /db/organizations (write=false)
> > 2012-06-12 21:23:16,112 [eXistThread-37] DEBUG (MiltonResource.java
> > [authorise]:402) - User te...@ea... is NOT authorized to read
> > resource, abort.
> >
> >
> > However the admin client is reporting to me that I should have read
> > permissions  (See first screenshot)
> >
> > I also tried logging in to admin client as that user, and experienced the
> > same thing:
> >
> > Failed to invoke method describeCollection in class
> > org.exist.xmlrpc.RpcConnection: Permission denied to open collection:
> > /db/organizations by te...@ea...
> >
> > org.xmldb.api.base.XMLDBException: Failed to invoke method
> > describeCollection in class org.exist.xmlrpc.RpcConnection: Permission
> > denied to open collection: /db/organizations by te...@ea...
> >     at
> >
> org.exist.xmldb.RemoteCollection.readCollection(RemoteCollection.java:461)
> >     at
> >
> org.exist.xmldb.RemoteCollection.listChildCollections(RemoteCollection.java:278)
> >     at
> >
> org.exist.client.InteractiveClient.getResources(InteractiveClient.java:371)
> >     at
> > org.exist.client.InteractiveClient.process(InteractiveClient.java:556)
> >     at
> org.exist.client.ClientFrame$ProcessThread.run(ClientFrame.java:1662)
> > Caused by: org.apache.xmlrpc.XmlRpcException: Failed to invoke method
> > describeCollection in class org.exist.xmlrpc.RpcConnection: Permission
> > denied to open collection: /db/organizations by te...@ea...
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcStreamTransport.readResponse(XmlRpcStreamTransport.java:197)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:156)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
> >     at
> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
> >     at
> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:158)
> >     at
> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:147)
> >     at
> >
> org.exist.xmldb.RemoteCollection.readCollection(RemoteCollection.java:459)
> >     ... 4 more
> > Caused by: org.apache.xmlrpc.XmlRpcException: Failed to invoke method
> > describeCollection in class org.exist.xmlrpc.RpcConnection: Permission
> > denied to open collection: /db/organizations by te...@ea...
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcStreamTransport.readResponse(XmlRpcStreamTransport.java:197)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:156)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
> >     at
> >
> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
> >     at
> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
> >     at
> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:158)
> >     at
> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:147)
> >     at
> >
> org.exist.xmldb.RemoteCollection.readCollection(RemoteCollection.java:459)
> >     at
> >
> org.exist.xmldb.RemoteCollection.listChildCollections(RemoteCollection.java:278)
> >     at
> >
> org.exist.client.InteractiveClient.getResources(InteractiveClient.java:371)
> >     at
> > org.exist.client.InteractiveClient.process(InteractiveClient.java:556)
> >     at
> org.exist.client.ClientFrame$ProcessThread.run(ClientFrame.java:1662)
> >
> >
> > and in the logs:
> >
> > 2012-06-12 21:28:42,981 [eXistThread-44] DEBUG (SecurityManagerImpl.java
> > [authenticate]:395) - Authentication try for 'te...@ea...'.
> > 2012-06-12 21:28:42,981 [eXistThread-44] DEBUG (SecurityManagerImpl.java
> > [authenticate]:436) - Authenticated by 'exist' as '[auth] <account
> > name="te...@ea..." id="11"><group name="__test-org"
> > id="12"></group><group name="__test-org__contributor-dita-langref"
> > id="17"></group><group name="__test-org-dita-langref"
> > id="16"></group></user>'.
> > 2012-06-12 21:28:42,981 [eXistThread-44] DEBUG (RpcConnection.java
> > [handleException]:120) - Permission denied to open collection:
> > /db/organizations by te...@ea...
> > org.exist.security.PermissionDeniedException: Permission denied to open
> > collection: /db/organizations by te...@ea...
> >     at
> org.exist.storage.NativeBroker.openCollection(NativeBroker.java:893)
> >     at
> org.exist.storage.NativeBroker.openCollection(NativeBroker.java:738)
> >     at
> > org.exist.xmlrpc.RpcConnection.describeCollection(RpcConnection.java:730)
> >     at
> > org.exist.xmlrpc.RpcConnection.describeCollection(RpcConnection.java:711)
> >     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >     at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >     at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >     at java.lang.reflect.Method.invoke(Method.java:616)
> >     at
> >
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:115)
> >     at
> >
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:106)
> >     at
> >
> org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46)
> >     at
> org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86)
> >     at
> >
> org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200)
> >     at
> >
> org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112)
> >     at
> > org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196)
> >     at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:68)
> >     at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
> >     at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> >     at
> > org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
> >     at
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
> >     at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> >     at
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542)
> >     at
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
> >     at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
> >     at
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> >     at
> >
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> >     at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> >     at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> >     at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:224)
> >     at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:98)
> >     at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:47)
> >     at
> >
> org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:211)
> >     at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> >     at
> > org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
> >     at
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
> >     at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> >     at
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:499)
> >     at
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
> >     at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
> >     at
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> >     at
> >
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> >     at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> >     at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> >     at
> >
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
> >     at
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
> >     at org.eclipse.jetty.server.Server.handle(Server.java:350)
> >     at
> >
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
> >     at
> >
> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
> >     at
> >
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
> >     at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:851)
> >     at
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> >     at
> >
> org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)
> >     at
> >
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)
> >     at
> >
> org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)
> >     at
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)
> >     at
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)
> >     at java.lang.Thread.run(Thread.java:636)
> >
> > Anyone know whats going on here?
> >
> > --
> > --
> > Casey Jordan
> > easyDITA a product of Jorsek LLC
> > "CaseyDJordan" on LinkedIn, Twitter & Facebook
> > (585) 348 7399
> > easydita.com
> >
> >
> > This message is intended only for the use of the Addressee(s) and may
> > contain information that is privileged, confidential, and/or exempt from
> > disclosure under applicable law.  If you are not the intended recipient,
> > please be advised that any disclosure  copying, distribution, or use of
> > the information contained herein is prohibited.  If you have received
> > this communication in error, please destroy all copies of the message,
> > whether in electronic or hard copy format, as well as attachments, and
> > immediately contact the sender by replying to this e-mail or by phone.
> > Thank you.
> >
> >
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> > _______________________________________________
> > Exist-development mailing list
> > Exi...@li...
> > https://lists.sourceforge.net/lists/listinfo/exist-development
> >
>
>
>
> --
> Adam Retter
>
> eXist Developer
> { United Kingdom }
> ad...@ex...
> irc://irc.freenode.net/existdb
>



-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

Re: [Exist-development] Bug in permissions or am I missing something?

[Adam R. <ad...@ex...>]

This is not a bug. The answer is in the messages in the log, if not subtly ;-)

Basically the message you get is -

"Permission denied to open collection: /db/organizations by te...@ea..."

The permissions on /db/organizations are 'rwxr-xr--' and the owner is
'admin:dba', however the user 'te...@ea...' does not have
permission to open the collection. That is to say that you need to
grant execute 'x' access on the collection /db/organizations for that
account.



On 13 June 2012 02:31, Casey Jordan <cas...@jo...> wrote:
> Hi all,
>
> Doing more stress testing on trunk and I started to get a lot of 401
> unauthorized errors. I did some investigation and found something strange.
>
> I have a collection /db/organizations owned by admin and group dba, but with
> world readable permissions (rwxr-x-r--).
>
> When I login as my test user (not guest) via oXygen I get a permission
> denied error. Looking at the logs I see:
>
> 2012-06-12 21:23:16,109 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> [authenticate]:395) - Authentication try for 'te...@ea...'.
> 2012-06-12 21:23:16,109 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> [authenticate]:436) - Authenticated by 'exist' as '[auth] <account
> name="te...@ea..." id="11"><group name="__test-org"
> id="12"></group><group name="__test-org__contributor-dita-langref"
> id="17"></group><group name="__test-org-dita-langref"
> id="16"></group></user>'.
> 2012-06-12 21:23:16,109 [eXistThread-37] ERROR (ExistCollection.java
> [initMetadata]:117) - org.exist.security.PermissionDeniedException:
> Permission denied to open collection: /db/organizations by
> te...@ea...
> 2012-06-12 21:23:16,110 [eXistThread-37] DEBUG (MiltonResource.java
> [authenticate]:343) - User 'te...@ea...' has been authenticated.
> 2012-06-12 21:23:16,111 [eXistThread-37] INFO  (MiltonResource.java
> [authorise]:350) - PROPFIND /db/organizations (write=false)
> 2012-06-12 21:23:16,112 [eXistThread-37] DEBUG (MiltonResource.java
> [authorise]:402) - User te...@ea... is NOT authorized to read
> resource, abort.
>
>
> However the admin client is reporting to me that I should have read
> permissions  (See first screenshot)
>
> I also tried logging in to admin client as that user, and experienced the
> same thing:
>
> Failed to invoke method describeCollection in class
> org.exist.xmlrpc.RpcConnection: Permission denied to open collection:
> /db/organizations by te...@ea...
>
> org.xmldb.api.base.XMLDBException: Failed to invoke method
> describeCollection in class org.exist.xmlrpc.RpcConnection: Permission
> denied to open collection: /db/organizations by te...@ea...
>     at
> org.exist.xmldb.RemoteCollection.readCollection(RemoteCollection.java:461)
>     at
> org.exist.xmldb.RemoteCollection.listChildCollections(RemoteCollection.java:278)
>     at
> org.exist.client.InteractiveClient.getResources(InteractiveClient.java:371)
>     at
> org.exist.client.InteractiveClient.process(InteractiveClient.java:556)
>     at org.exist.client.ClientFrame$ProcessThread.run(ClientFrame.java:1662)
> Caused by: org.apache.xmlrpc.XmlRpcException: Failed to invoke method
> describeCollection in class org.exist.xmlrpc.RpcConnection: Permission
> denied to open collection: /db/organizations by te...@ea...
>     at
> org.apache.xmlrpc.client.XmlRpcStreamTransport.readResponse(XmlRpcStreamTransport.java:197)
>     at
> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:156)
>     at
> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
>     at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
>     at
> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
>     at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>     at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:158)
>     at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:147)
>     at
> org.exist.xmldb.RemoteCollection.readCollection(RemoteCollection.java:459)
>     ... 4 more
> Caused by: org.apache.xmlrpc.XmlRpcException: Failed to invoke method
> describeCollection in class org.exist.xmlrpc.RpcConnection: Permission
> denied to open collection: /db/organizations by te...@ea...
>     at
> org.apache.xmlrpc.client.XmlRpcStreamTransport.readResponse(XmlRpcStreamTransport.java:197)
>     at
> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:156)
>     at
> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
>     at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
>     at
> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
>     at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>     at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:158)
>     at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:147)
>     at
> org.exist.xmldb.RemoteCollection.readCollection(RemoteCollection.java:459)
>     at
> org.exist.xmldb.RemoteCollection.listChildCollections(RemoteCollection.java:278)
>     at
> org.exist.client.InteractiveClient.getResources(InteractiveClient.java:371)
>     at
> org.exist.client.InteractiveClient.process(InteractiveClient.java:556)
>     at org.exist.client.ClientFrame$ProcessThread.run(ClientFrame.java:1662)
>
>
> and in the logs:
>
> 2012-06-12 21:28:42,981 [eXistThread-44] DEBUG (SecurityManagerImpl.java
> [authenticate]:395) - Authentication try for 'te...@ea...'.
> 2012-06-12 21:28:42,981 [eXistThread-44] DEBUG (SecurityManagerImpl.java
> [authenticate]:436) - Authenticated by 'exist' as '[auth] <account
> name="te...@ea..." id="11"><group name="__test-org"
> id="12"></group><group name="__test-org__contributor-dita-langref"
> id="17"></group><group name="__test-org-dita-langref"
> id="16"></group></user>'.
> 2012-06-12 21:28:42,981 [eXistThread-44] DEBUG (RpcConnection.java
> [handleException]:120) - Permission denied to open collection:
> /db/organizations by te...@ea...
> org.exist.security.PermissionDeniedException: Permission denied to open
> collection: /db/organizations by te...@ea...
>     at org.exist.storage.NativeBroker.openCollection(NativeBroker.java:893)
>     at org.exist.storage.NativeBroker.openCollection(NativeBroker.java:738)
>     at
> org.exist.xmlrpc.RpcConnection.describeCollection(RpcConnection.java:730)
>     at
> org.exist.xmlrpc.RpcConnection.describeCollection(RpcConnection.java:711)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:115)
>     at
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:106)
>     at
> org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46)
>     at org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86)
>     at
> org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200)
>     at
> org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112)
>     at
> org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196)
>     at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:68)
>     at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>     at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>     at
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
>     at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
>     at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>     at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542)
>     at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>     at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>     at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>     at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>     at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>     at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>     at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:224)
>     at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:98)
>     at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:47)
>     at
> org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:211)
>     at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>     at
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
>     at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
>     at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>     at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:499)
>     at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>     at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>     at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>     at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>     at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>     at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>     at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>     at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>     at org.eclipse.jetty.server.Server.handle(Server.java:350)
>     at
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>     at
> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>     at
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>     at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:851)
>     at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>     at
> org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)
>     at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)
>     at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)
>     at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)
>     at
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)
>     at java.lang.Thread.run(Thread.java:636)
>
> Anyone know whats going on here?
>
> --
> --
> Casey Jordan
> easyDITA a product of Jorsek LLC
> "CaseyDJordan" on LinkedIn, Twitter & Facebook
> (585) 348 7399
> easydita.com
>
>
> This message is intended only for the use of the Addressee(s) and may
> contain information that is privileged, confidential, and/or exempt from
> disclosure under applicable law.  If you are not the intended recipient,
> please be advised that any disclosure  copying, distribution, or use of
> the information contained herein is prohibited.  If you have received
> this communication in error, please destroy all copies of the message,
> whether in electronic or hard copy format, as well as attachments, and
> immediately contact the sender by replying to this e-mail or by phone.
> Thank you.
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

Re: [Exist-development] Bug in permissions or am I missing something?

[Wolfgang M. <wol...@ex...>]

> I have a collection /db/organizations owned by admin and group dba, but with
> world readable permissions (rwxr-x-r--).

If you have read, but not execute rights on /db/organizations, you
will see the collection if you list /db, but you should not be able to
change into that collection and see it's contents. Just like on a Unix
system, you need the execute permission to change into the collection
and do anything inside. I think this is the correct behavior.

Wolfgang

Re: [Exist-development] Bug in permissions or am I missing something?

[Dmitriy S. <sha...@gm...>]

On Wed, Jun 13, 2012 at 6:31 AM, Casey Jordan <cas...@jo...>wrote:

>
> Doing more stress testing on trunk and I started to get a lot of 401
> unauthorized errors. I did some investigation and found something strange.
>
> I have a collection /db/organizations owned by admin and group dba, but
> with world readable permissions (rwxr-x-r--).
>

You need to set 'x' flag to permit entering collection.

-- 
Dmitriy Shabanov

[Exist-development] Java7 … NPEs…

[Dannes W. <da...@ex...>]

Hi,

when running junit/trunk on java7 i see a lot like:

  [junit] ERROR org.apache.xmlrpc.server.XmlRpcErrorLogger : java.lang.NullPointerException
    [junit] java.lang.NullPointerException
    [junit]     at org.exist.xmlrpc.XmldbRequestProcessorFactory.authenticate(XmldbRequestProcessorFactory.java:88)
    [junit]     at org.exist.xmlrpc.XmldbRequestProcessorFactory.getRequestProcessor(XmldbRequestProcessorFactory.java:69)
    [junit]     at org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.getInstance(ReflectiveXmlRpcHandler.java:78)
    [junit]     at org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:90)
    [junit]     at org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46)
    [junit]     at org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86)
    [junit]     at org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200)
    [junit]     at org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112)
    [junit]     at org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196)
    [junit]     at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:68)

and

org.quartz.core.JobRunShell : Job eXist.internal.FileLockHeartBeat: /Users/...........eXist-db/2.1/trunk/webapp/WEB-INF/data/dbx_dir.lck threw an unhandled Exception: java.lang.IllegalArgumentException
    [junit]     at java.nio.Buffer.position(Buffer.java:236)
    [junit]     at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:185)
    [junit]     at java.nio.ByteBuffer.put(ByteBuffer.java:832)
    [junit]     at org.exist.storage.lock.FileLock.save(FileLock.java:228)
    [junit]     at org.exist.storage.lock.FileLockHeartBeat.execute(FileLockHeartBeat.java:67)
    [junit]     at org.quartz.core.JobRunShell.run(JobRunShell.java:223)
    [junit]     at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
    [junit] ERROR org.quartz.core.ErrorLogger : Job (eXist.internal.FileLockHeartBeat: /Users/........./eXist-db/2.1/trunk/webapp/WEB-INF/data/dbx_dir.lck threw an exception.
    [junit] org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.IllegalArgumentException]
    [junit]     at org.quartz.core.JobRunShell.run(JobRunShell.java:234)
    [junit]     at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
    [junit] Caused by: java.lang.IllegalArgumentException
    [junit]     at java.nio.Buffer.position(Buffer.java:236)
    [junit]     at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:185)
    [junit]     at java.nio.ByteBuffer.put(ByteBuffer.java:832)
    [junit]     at org.exist.storage.lock.FileLock.save(FileLock.java:228)
    [junit]     at org.exist.storage.lock.FileLockHeartBeat.execute(FileLockHeartBeat.java:67)
    [junit]     at org.quartz.core.JobRunShell.run(JobRunShell.java:223)

Did not check the same for 2.0 yet, but I think we should have a look before releasing......

cheers

Dannes

eXist-db Native XML Database
http://www.exist-db.org

[Exist-development] util:catch()

[Jens Ø. P. <oe...@gm...>]

Hi,

I ran into a util:catch() problem - seen this before, don't know why, but never mind.

Cannot compile xquery: error found while loading module browse: Error while loading module browse.xqm: Access to deprecated functions is not allowed. Call to 'util:catch()' denied. Use the XQuery 3.0 try/catch expression in stead.
This function could be removed at anytime during the 1.5 development and will be removed in the 1.6 release. [at line 66, column 9]

(from FunctionSignature.java and FunctionFactory.java).

However, the util:catch() function is still called in around 15 files in trunk; the roadmap also contains an outdated reference to it.

Shouldn't this be fixed before 2.0?

Cheers,

Jens

Re: [Exist-development] Proposal - Project Migration

[Dmitriy S. <sha...@gm...>]

On Wed, May 16, 2012 at 1:53 PM, Dannes Wessels <da...@ex...> wrote:

>
> On Wed, May 16, 2012 at 10:26 AM, Wolfgang Meier <wol...@ex...>wrote:
>
>> Please also remember that aspect4j is still incredibly slow in the
>> current build scripts ;-) This is slowing down all my development.
>>
>
> aspect4j actually supports some shortcuts here, so things are not
> re-generated over and over again.
>
> I had a look but was not successful in changing. Let a fix be a
> prerequisite for the switch to maven, because Maven will slowdown
> development (compilation) a bit more..... [my experiences so far]
>

Maven have same speed as ant (my experience), but modular - no needs to
complier modules that wasn't change (that potentially can speed up).

+ resolve jars dependences (I see a lot of problems for starters because of
missing jars)

-- 
Dmitriy Shabanov

Re: [Exist-development] Proposal - Project Migration

[Dannes W. <da...@ex...>]

Hi

On Wed, May 16, 2012 at 10:26 AM, Wolfgang Meier <wol...@ex...>wrote:

> Please also remember that aspect4j is still incredibly slow in the
> current build scripts ;-) This is slowing down all my development.
>

aspect4j actually supports some shortcuts here, so things are not
re-generated over and over again.

I had a look but was not successful in changing. Let a fix be a
prerequisite for the switch to maven, because Maven will slowdown
development (compilation) a bit more..... [my experiences so far]

cheers

Dannes


-- 
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

Re: [Exist-development] Proposal - Project Migration

[Wolfgang M. <wol...@ex...>]

> However, SF dont yet support multiple repo's by the
> looks of it.

This would be a show stopper if it were true. We just started to move
the documentation, samples and all apps into separate packages, so
webapp/ will be nearly empty in 2.0. It would be confusing if we had
to keep the documentation or the admin app on a different server.

Fortunately, SF does support multipe git repositories:

https://sourceforge.net/apps/trac/sourceforge/wiki/Git#CreatingMultipleRepositories


>>> 3) I shift the project layout of trunk to follow a standard project
>>> layout and update the Ant build to work with this.

Please also remember that aspect4j is still incredibly slow in the
current build scripts ;-) This is slowing down all my development.

Wolfgang

Re: [Exist-development] Proposal - Project Migration

[Adam R. <ad...@ex...>]

> githut support http.

They do. But I think the project has too much invested in SF, i.e.
mailing lists, bug tracker, homepage etc.


>>> 3) I shift the project layout of trunk to follow a standard project
>>> layout and update the Ant build to work with this.
>>> This will make our planned move to Maven much easier and allow me to
>>> carry on that work.
>
> ready too, call?

Great thanks. Lets get 2.0 out the door first.

> Well, we can freeze sf's svn and move to any git.

I think it is best to move repo wholesale. Having a Git and a SVN
hanging around will just confuse people about which is to be used! We
should just leave a TXT file in our old SVN repo that says - "MOVED TO
SF GIT.txt" with the URL of the new repo in it.



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

Re: [Exist-development] Proposal - Project Migration

[Adam R. <ad...@ex...>]

>> I propose that after 2.0 release -
>>
>> 1) I upgrade our SourceForge project to the latest software platform
>> version on SourceForge. This gives us some shiny new features and
>> options but will change the URL or our source repos.
>
>
> Oh? missed this news, do  you have an URL regarding?

I think you can only see this if you are a project admin, see the
attached screenshot.

>> 2) We migrate from Subversion to Git (still on SourceForge), there is
>> a tool for doing this -
>> git://github.com/jcoglan/svn2git.git
>
>
> Looks like the way to go (is HTTP supported on sf.net?), but...... to limit
> the overall size of the github repo (stored locally), we probably must split
> [if possible] the database from the applications like tamboti? Or am I wrong
> here?

Yes. There are many things in trunk that should not be there. eXide,
Tamboti, examples, webapps, docs, etc. These all need to become
modules. Ideally some of these would have their own git repo's under
the eXist project. However, SF dont yet support multiple repo's by the
looks of it. GitHub do support multiple repo's, but I think we have
too much invested in SF, e.g. mailing lists, bug tracker etc.


>> 3) I shift the project layout of trunk to follow a standard project
>> layout and update the Ant build to work with this.
>> This will make our planned move to Maven much easier and allow me to
>> carry on that work.
>
> good idea, I volunteer to help you here (talk offline).

Great :-)

> I have some additional ideas, which can be implemented easily, making the
> migration to maven more easy......

Okay sounds good.

Also, a good Maven layout to study is probably that of the Hibernate
project https://repository.jboss.org/nexus/content/groups/public/org/hibernate/

I think the Spring project also follow a similar layout.


-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

Re: [Exist-development] Proposal - Project Migration

[Dmitriy S. <sha...@gm...>]

On Wed, May 16, 2012 at 11:22 AM, Dannes Wessels <da...@ex...>wrote:

>
> On Mon, May 14, 2012 at 11:19 PM, Adam Retter <ad...@ex...> wrote:
>
>> I propose that after 2.0 release -
>>
>> 1) I upgrade our SourceForge project to the latest software platform
>> version on SourceForge. This gives us some shiny new features and
>> options but will change the URL or our source repos.
>>
>
> Oh? missed this news, do  you have an URL regarding?
>
>>
>> 2) We migrate from Subversion to Git (still on SourceForge), there is
>> a tool for doing this -
>> git://github.com/jcoglan/svn2git.git
>>
>
> Looks like the way to go (is HTTP supported on sf.net?), but...... to
> limit the overall size of the github repo (stored locally), we probably
> must split [if possible] the database from the applications like tamboti?
> Or am I wrong here?
>

githut support http.

>
> I certainly need to study git..... :-)
>

yeap, you have too -P


>> 3) I shift the project layout of trunk to follow a standard project
>> layout and update the Ant build to work with this.
>> This will make our planned move to Maven much easier and allow me to
>> carry on that work.
>>
>
> good idea, I volunteer to help you here (talk offline).
>
> I have some additional ideas, which can be implemented easily, making the
> migration to maven more easy......
>

ready too, call?

Well, we can freeze sf's svn and move to any git.

-- 
Dmitriy Shabanov

Re: [Exist-development] Proposal - Project Migration

[Dannes W. <da...@ex...>]

Hi Adam

On Mon, May 14, 2012 at 11:19 PM, Adam Retter <ad...@ex...> wrote:

> I propose that after 2.0 release -
>
> 1) I upgrade our SourceForge project to the latest software platform
> version on SourceForge. This gives us some shiny new features and
> options but will change the URL or our source repos.
>

Oh? missed this news, do  you have an URL regarding?

>
> 2) We migrate from Subversion to Git (still on SourceForge), there is
> a tool for doing this -
> git://github.com/jcoglan/svn2git.git
>

Looks like the way to go (is HTTP supported on sf.net?), but...... to limit
the overall size of the github repo (stored locally), we probably must
split [if possible] the database from the applications like tamboti? Or am
I wrong here?

I certainly need to study git..... :-)

>
> 3) I shift the project layout of trunk to follow a standard project
> layout and update the Ant build to work with this.
> This will make our planned move to Maven much easier and allow me to
> carry on that work.
>

good idea, I volunteer to help you here (talk offline).

I have some additional ideas, which can be implemented easily, making the
migration to maven more easy......

cheers

Dannes


-- 
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624