[Exist-open] writing to db causes ant remote store task to abort

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

Hello,

I'm (still) having problems with xdb:store task in ant. I use exist 1.4 out
of the box.

I use this ant script to store files remotely:
        <xdb:store
uri="xmldb:exist://${remote-host}/exist/xmlrpc/db/${collection}"
createcollection="true" createsubcollections="true" user="${remote-user}"
password="${remote-pass}">
            <fileset dir="D:/exist_backup/extract">
                <include name="**/*.xml"/>
                <include name="**/*.xsl"/>
            </fileset>
        </xdb:store>

While this task was happily running I tried to create a user using the
client shell remotely. Log says it was still storing then, but I noticed
some lag in response in the client. I exited the client and reopened it to
see my user was created. I then proceeded to create a collection. After that
the client hung, db was inaccessible and I noticed the store task had been
aborted with neither errors nor success notification. I didn't find any
errors in the log after that point either. Db seems now corrupt, as journal
scan hangs.

The only thing I can figure out is that it was a bad idea to write to db
while it was storing remotely (I hope not). Or perhaps it's a bad idea to
exit the client when it isn't responding.

What I cannot figure out is if exist was locking, and how this corrupted the
db.

Thanks in advance for any input.

LOG:
2011-02-03 19:19:07,016 [P1-8] DEBUG (Collection.java
[validateXMLResourceInternal]:1218) - Scanning document
/db/benjamins/article/chlel.xxvi.05per.xml
2011-02-03 19:19:07,017 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:07,017 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:07,019 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:07,019 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:07,019 [P1-8] DEBUG (Collection.java
[validateXMLResourceInternal]:1223) - removing old document
chlel.xxvi.05per.xml
2011-02-03 19:19:07,019 [P1-8] INFO  (NativeBroker.java
[removeXMLResource]:2222) - Removing document chlel.xxvi.05per.xml (12676)
...
2011-02-03 19:19:07,871 [P1-8] DEBUG (NativeTextEngine.java
[dropIndex]:1072) - Removing 0 tokens
2011-02-03 19:19:07,871 [P1-8] DEBUG (NativeTextEngine.java
[dropIndex]:1072) - Removing 0 tokens
2011-02-03 19:19:07,871 [P1-8] DEBUG (NativeTextEngine.java
[dropIndex]:1072) - Removing 0 tokens
2011-02-03 19:19:18,872 [P1-10] DEBUG (XMLSecurityManager.java [save]:350) -
storing acl file
2011-02-03 19:19:18,888 [P1-10] DEBUG (NGramIndex.java [sync]:86) - SYNC
NGRAM
2011-02-03 19:19:18,889 [P1-10] INFO  (NativeBroker.java [sync]:3191) -
Memory: 783,104K total; 1,864,192K max; 481,581K free
2011-02-03 19:19:18,889 [P1-10] INFO  (BTree.java [printStatistics]:2348) -
dom.dbx INDEX Buffers occupation : 100% (144 out of 144) Cache efficiency :
96%
2011-02-03 19:19:18,889 [P1-10] INFO  (DOMFile.java [printStatistics]:1434)
- dom.dbx DATA Buffers occupation : 100% (255 out of 256) Cache efficiency :
50%
2011-02-03 19:19:18,890 [P1-10] INFO  (BTree.java [printStatistics]:2348) -
collections.dbx INDEX Buffers occupation : 100% (144 out of 144) Cache
efficiency : 97%
2011-02-03 19:19:18,890 [P1-10] INFO  (BFile.java [printStatistics]:427) -
collections.dbx DATA Buffers occupation : 100% (471 out of 472) Cache
efficiency : 98%
2011-02-03 19:19:18,890 [P1-10] INFO  (BTree.java [printStatistics]:2348) -
elements.dbx INDEX Buffers occupation : 25% (16 out of 64) Cache efficiency
: 100%
2011-02-03 19:19:18,890 [P1-10] INFO  (BFile.java [printStatistics]:427) -
elements.dbx DATA Buffers occupation : 100% (2807 out of 2807) Cache
efficiency : 93%
2011-02-03 19:19:18,890 [P1-10] INFO  (BTree.java [printStatistics]:2348) -
values.dbx INDEX Buffers occupation : 0% (0 out of 64) Cache efficiency :
N/A
2011-02-03 19:19:18,891 [P1-10] INFO  (BFile.java [printStatistics]:427) -
values.dbx DATA Buffers occupation : 0% (0 out of 64) Cache efficiency : N/A
2011-02-03 19:19:18,891 [P1-10] DEBUG (Collection.java
[checkPermissions]:1347) - Found old doc 1
2011-02-03 19:19:18,891 [P1-10] DEBUG (Collection.java
[validateXMLResourceInternal]:1218) - Scanning document /db/system/users.xml
2011-02-03 19:19:18,892 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:18,893 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:18,894 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:18,894 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:18,894 [P1-10] DEBUG (Collection.java
[validateXMLResourceInternal]:1223) - removing old document users.xml
2011-02-03 19:19:18,894 [P1-10] INFO  (NativeBroker.java
[removeXMLResource]:2222) - Removing document users.xml (1) ...
2011-02-03 19:19:18,895 [P1-10] DEBUG (NativeTextEngine.java
[dropIndex]:1072) - Removing 0 tokens
2011-02-03 19:19:18,896 [P1-10] DEBUG (NativeTextEngine.java
[dropIndex]:1072) - Removing 0 tokens
2011-02-03 19:19:18,896 [P1-10] DEBUG (NativeTextEngine.java
[dropIndex]:1072) - Removing 0 tokens
2011-02-03 19:19:42,907 [P1-8] DEBUG (NativeBroker.java
[removeXMLResource]:2229) - removeDocument() - removing dom
2011-02-03 19:19:42,911 [P1-10] DEBUG (NativeBroker.java
[removeXMLResource]:2229) - removeDocument() - removing dom
2011-02-03 19:19:42,911 [P1-8] DEBUG (NativeBroker.java
[removeResourceMetadata]:2326) - Removing resource metadata for 12676
2011-02-03 19:19:42,911 [P1-8] DEBUG (Collection.java
[validateXMLResourceInternal]:1244) - removed old document
chlel.xxvi.05per.xml
2011-02-03 19:19:42,911 [P1-10] DEBUG (NativeBroker.java
[removeResourceMetadata]:2326) - Removing resource metadata for 1
2011-02-03 19:19:42,911 [P1-8] DEBUG (Collection.java
[storeXMLInternal]:1036) - storing document 12676 ...
2011-02-03 19:19:42,912 [P1-10] DEBUG (Collection.java
[validateXMLResourceInternal]:1244) - removed old document users.xml
2011-02-03 19:19:42,912 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:42,912 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:42,913 [P1-10] DEBUG (Collection.java
[storeXMLInternal]:1036) - storing document 1 ...
2011-02-03 19:19:42,915 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:42,915 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:42,918 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:42,919 [P1-10] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:42,919 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:81) - Retrieve initial grammarset (
http://www.w3.org/TR/REC-xml).
2011-02-03 19:19:42,919 [P1-8] DEBUG (GrammarPool.java
[retrieveInitialGrammarSet]:85) - Found 0 grammars.
2011-02-03 19:19:42,920 [P1-10] DEBUG (Collection.java
[storeXMLInternal]:1050) - document stored.
2011-02-03 19:19:42,920 [P1-10] DEBUG (Collection.java
[storeXMLInternal]:1056) - users.xml changed
2011-02-03 19:19:42,920 [P1-10] DEBUG (XMLSecurityManager.java [attach]:142)
- loading acl
2011-02-03 19:19:42,921 [P1-10] DEBUG (BrokerPool.java
[reloadSecurityManager]:1384) - Security manager reloaded
2011-02-03 19:22:47,518 [P1-13] DEBUG (NativeBroker.java
[getOrCreateCollection]:630) - Creating collection
'/db/benjamins/content'...
2011-02-03 19:25:04,560 [P1-11] DEBUG (XQuery.java [execute]:231) -
Execution took 0 ms
2011-02-03 19:25:04,561 [P1-11] DEBUG (HTTPUtils.java
[addLastModifiedHeader]:61) - mostRecentDocumentTime: 0
2011-02-03 19:26:09,229 [P1-1] DEBUG (XQuery.java [execute]:231) - Execution
took 1 ms
2011-02-03 19:26:09,229 [P1-1] DEBUG (HTTPUtils.java
[addLastModifiedHeader]:61) - mostRecentDocumentTime: 0
2011-02-03 19:39:48,658 [main] DEBUG (ConfigurationHelper.java
[getExistHome]:61) - Could not retieve instance of brokerpool: database
instance 'exist' is not available
2011-02-03 19:39:48,662 [main] DEBUG (ConfigurationHelper.java
[getExistHome]:68) - Got eXist home from system property 'exist.home':
/usr/local/exist
2011-02-03 19:39:48,911 [P1-5] INFO  (BrokerPool.java [shutdown]:1506) -
Database is shutting down ...

-- 

W.S. Hager
Lagua Web Solutions
http://lagua.nl

[Exist-open] writing to db causes ant remote store task to abort

eXist-db is a feature rich Open Source native XML database

[Exist-open] writing to db causes ant remote store task to abort