Re: [Exist-open] Restxq - ERROR No request object found in the current XQuery context

[Adam Retter <adam@ex...>]

Out of interest, why do you need the Session module from RESTXQ? Is it
for authentication, or for something more?


On 16 October 2012 23:24, Adam Retter <adam@...> wrote:
> Hello Christophe,
>
> The first plan is to standardise the HTTP Request module, and then
> make this accessible for RESTXQ. From there we could also consider a
> session module perhaps. So the answer is that yes there are tentative
> plans, but that they are some way away from implementation at the
> moment. Although I think once the planning is in place it should not
> bee too hard.
>
> Thanks Adam.
>
> On 16 October 2012 22:25, christophe geiser
> <christophe.geiser@...> wrote:
>> Hi all,
>> I am in the process of restxq-enabling some old ajax code, and realize only
>> now that session information is not available in restxq resource functions -
>> my fault!
>>
>> I will work on some temporary solution to keep me going, but would somehow
>> need to know if there is any tentative plan to integrate session functions
>> within restxq context.
>>
>> Thanks for (any) answer (and for this nice piece of code - restxq)
>> Cheers,
>> C.
>>
>>
>
>
>
> --
> Adam Retter
>
> eXist Developer
> { United Kingdom }
> adam@...
> irc://irc.freenode.net/existdb



-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] Restxq - ERROR No request object found in the current XQuery context

[Adam Retter <adam@ex...>]

Hello Christophe,

The first plan is to standardise the HTTP Request module, and then
make this accessible for RESTXQ. From there we could also consider a
session module perhaps. So the answer is that yes there are tentative
plans, but that they are some way away from implementation at the
moment. Although I think once the planning is in place it should not
bee too hard.

Thanks Adam.

On 16 October 2012 22:25, christophe geiser
<christophe.geiser@...> wrote:
> Hi all,
> I am in the process of restxq-enabling some old ajax code, and realize only
> now that session information is not available in restxq resource functions -
> my fault!
>
> I will work on some temporary solution to keep me going, but would somehow
> need to know if there is any tentative plan to integrate session functions
> within restxq context.
>
> Thanks for (any) answer (and for this nice piece of code - restxq)
> Cheers,
> C.
>
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] Restxq - ERROR No request object found in the current XQuery context

[christophe geiser <christophe.geiser@e-...>]

Hi all,
I am in the process of restxq-enabling some old ajax code, and realize only
now that session information is not available in restxq resource functions
- my fault!

I will work on some temporary solution to keep me going, but would somehow
need to know if there is any tentative plan to integrate session functions
within restxq context.

Thanks for (any) answer (and for this nice piece of code - restxq)
Cheers,
C.

Re: [Exist-open] [Exist-Open] datetime cardinality error question

[David Baird <dbtripledc@gm...>]

Hi.

Thanks for the help. yes. the node matches the xpath value. I guess I will
have to try the util:log() and document-uri() option. Regrettfully I can't
copy the code because it sits on a self contained server with no means to
copy it. :(

Once again, thanks.

Dave

On Tue, Oct 16, 2012 at 9:56 PM, Adam Retter <adam@...> wrote:

> > I use eXist 1.4.1. I have inherited a date-picker where by you pick a
> date
> > range on a TO calendar and FROM calendar and it brings back all the
> articles
> > published on that date. It works great for all dates except for
> 10/09/2012.
> > I keep getting an error for that date -
> >
> > Error checking function parameter 1 in call
> > datetime:format-date(untyped-value-check[xs:date,
> >
> $article/descendants-or-self::.../child::pubsDateList/attribute::firstTimePublished
> > cast as xs:dateTime], "MM/dd/yyyy"): The actual cardinality for
> parameter 1
> > does not match the cardinality declared in function's signature:
> > datetime:format-date($date as xs:date, $simple-date-format as xs:string)
> > xs:string. Expected cardinality: exactly one, got 0 [at line 49,
> column13].
> >
> > I have tried to reindex the DB but it still fails. So, I am wondering
> could
> > it be that one of the files are corrupted on it's firstTimePublished
> date?
> > If so, does anyone have any idea what kind of query I can do to find it
> and
> > fix it? Or, if thats not the case, what else could be the problem?
>
> Are you absolutely sure that you have a node in the database that
> matches that xpath for that value that you have chosen from the
> datepicker?
>
> At this stage - util:log() statements combined with
> document-uri(root($node)) could help you find the issue...
>
> Also posting a simplification of your path expression with all
> variables expanded here might help us to help you.
>
>
>
> > I have been beating my head against the wall for an several hours trying
> to
> > find a solution and really need some help. BTW: I am a newbie to Xquery
> so
> > be gentle. :)
> >
> >
> ------------------------------------------------------------------------------
> > Don't let slow site performance ruin your business. Deploy New Relic APM
> > Deploy New Relic app performance management and know exactly
> > what is happening inside your Ruby, Python, PHP, Java, and .NET app
> > Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> > http://p.sf.net/sfu/newrelic-dev2dev
> > _______________________________________________
> > Exist-open mailing list
> > Exist-open@...
> > https://lists.sourceforge.net/lists/listinfo/exist-open
> >
>
>
>
> --
> Adam Retter
>
> eXist Developer
> { United Kingdom }
> adam@...
> irc://irc.freenode.net/existdb
>

Re: [Exist-open] Bulk Loading ... how to?

[Wolfgang Meier <wolfgang@ex...>]

Casey,
> What is the bottleneck that requires more than 512MB?

The caches. It is usually possible to upload large amounts of XML with 512MB, but you will probably see a dramatic slowdown after some time due to the page caches being too small to hold at least the inner btree pages in memory. eXist will thus start reloading pages from disk over and over again. By default, the cacheSize is set to 48m only. I usually increase it to 256m, but then I also need to increase the memory available to Java in order to accommodate for the larger cache size.
> I would like to understand this better for our production systems. Sometimes files larger than 2GB will be uploaded, sometimes multiple files at once, we haven't had any problems but I was under the impression everything was done through streaming so arbitrarily large documents could be handled with small amounts of memory.

Uploading, parsing and indexing documents is indeed done through streaming, so memory consumption should be low.

Wolfgang

Re: [Exist-open] [Exist-Open] datetime cardinality error question

[Adam Retter <adam@ex...>]

> I use eXist 1.4.1. I have inherited a date-picker where by you pick a date
> range on a TO calendar and FROM calendar and it brings back all the articles
> published on that date. It works great for all dates except for 10/09/2012.
> I keep getting an error for that date -
>
> Error checking function parameter 1 in call
> datetime:format-date(untyped-value-check[xs:date,
> $article/descendants-or-self::.../child::pubsDateList/attribute::firstTimePublished
> cast as xs:dateTime], "MM/dd/yyyy"): The actual cardinality for parameter 1
> does not match the cardinality declared in function's signature:
> datetime:format-date($date as xs:date, $simple-date-format as xs:string)
> xs:string. Expected cardinality: exactly one, got 0 [at line 49, column13].
>
> I have tried to reindex the DB but it still fails. So, I am wondering could
> it be that one of the files are corrupted on it's firstTimePublished date?
> If so, does anyone have any idea what kind of query I can do to find it and
> fix it? Or, if thats not the case, what else could be the problem?

Are you absolutely sure that you have a node in the database that
matches that xpath for that value that you have chosen from the
datepicker?

At this stage - util:log() statements combined with
document-uri(root($node)) could help you find the issue...

Also posting a simplification of your path expression with all
variables expanded here might help us to help you.



> I have been beating my head against the wall for an several hours trying to
> find a solution and really need some help. BTW: I am a newbie to Xquery so
> be gentle. :)
>
> ------------------------------------------------------------------------------
> Don't let slow site performance ruin your business. Deploy New Relic APM
> Deploy New Relic app performance management and know exactly
> what is happening inside your Ruby, Python, PHP, Java, and .NET app
> Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> http://p.sf.net/sfu/newrelic-dev2dev
> _______________________________________________
> Exist-open mailing list
> Exist-open@...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] Stricter function parameter checks

[Wolfgang Meier <wolfgang@ex...>]

Casey, 
> Since we have close to 100k lines of XQuery I have a feeling this is going to be very hard to debug this. Perhaps this should be configurable to either throw an error or a warning? This way people could still take advantage of the new features in trunk, without having to worry about this creating regressions in their code.

The lax handling of parameter cardinality was clearly a bug in eXist. You should not face any problems if you were careful when declaring your function parameters (I admit I was too lazy sometimes). Otherwise it should be easy to identify the problem if you look at the function signatures. 

I'm not sure this can be made configurable because it is a core XQuery requirement, but if you need it, I'll think about how to allow lax checks again.

Wolfgang

Re: [Exist-open] possible lock problems with oXygen

[Adam Retter <adam@ex...>]

> yeah, I know - was almost banging my head against the wall on this one ...
>
> working fine after 17337, sorry for not reporting earlier

Great. Not at all, it was your reports and details of how to reproduce
that enabled me to solve this in about 4 hours :-)

>
> Thanks and cheers,
> C.
>
> On Tue, Oct 16, 2012 at 9:24 PM, Adam Retter <adam@...> wrote:
>>
>> Phew! That was a tricky one. I only looked into the issue you reported
>> when the RESTXQ Trigger is enabled, as that is the stack-trace that
>> you provided.
>>
>> I think it may now, at least as RESTXQ is concerned, fixed as revision
>> 17337 in trunk.
>>
>> Let me know...
>>
>>
>> > Hi all,
>> >
>> > I tried to dig a bit more into this and discovered some strange
>> > behaviors
>> > when urlRewrite + templating + circular module dependencies are
>> > involved,
>> > that eventually lead to the lock problem described above (and to the
>> > fact
>> > that xquery modules take quite a long time - 10sec + - to be commited to
>> > the
>> > database), and sometimes to database corruption.
>> >
>> > One test case not too cumbersome to reproduce is to :
>> > 0- backup your data (in my case the following steps lead to a corrupted
>> > db
>> > !)
>> > 1- load the demo package to the database
>> > 2- modify demo/modules/templates.xql - > demo/modules/templates.xqm
>> > 3- modify the ref of import modules in config.xqm and view.xql from
>> > templates/xql to templates.xqm
>> > 4- try to save the modifications
>> >
>> > Under my current configuration (Linux Mint - latest trunk version of
>> > eXist),
>> > this lead to :
>> >
>> > a message box in oxygen :
>> > Cannot save the file. Failed to invoke method storeBinary in class
>> > org.exist.xmlrpc.RpcConnection: java.lang.NullPointerException
>> >
>> > >From now on, db fails to re-start and to recover...
>> >
>> > in exist.log:
>> > 2012-10-08 15:58:35,762 [eXistThread-37] DEBUG (TransactionManager.java
>> > [execute]:153) - Starting new transaction: 15
>> > 2012-10-08 15:58:35,762 [eXistThread-37] DEBUG (RpcConnection.java
>> > [storeBinary]:2411) - Storing binary resource to collection
>> > /db/demo/modules
>> > 2012-10-08 15:58:35,763 [eXistThread-37] DEBUG (Collection.java
>> > [checkPermissionsForAddDocument]:1756) - Found old doc 11255
>> > 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (Collection.java
>> > [addBinaryResource]:1862) - removing old document config.xqm
>> > 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (NativeBroker.java
>> > [removeBinaryResource]:2718) - removing binary resource 11255...
>> > 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG
>> > (RenameBinaryLoggable.java
>> > [<init>]:39) - Rename binary created
>> >
>> > /home/christophe/eXist-db/webapp/WEB-INF/data/fs/db/demo/modules/config.xqm
>> > ->
>> >
>> > /home/christophe/eXist-db/webapp/WEB-INF/data/fs.journal/txn.15/db/demo/modules/config.xqm
>> > 2012-10-08 15:58:35,766 [eXistThread-37] DEBUG (NativeBroker.java
>> > [removeResourceMetadata]:2761) - Removing resource metadata for 11255
>> > 2012-10-08 15:58:35,766 [eXistThread-37] DEBUG
>> > (CreateBinaryLoggable.java
>> > [<init>]:36) - CreateBinaryLoggable created
>> > 2012-10-08 15:58:35,779 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from templates.xqm
>> > 2012-10-08 15:58:35,850 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from config.xqm
>> > 2012-10-08 15:58:35,863 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/templates
>> > already
>> > present.
>> > 2012-10-08 15:58:35,874 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:173) -
>> > Query diagnostics:
>> > [skipped: more than 150 expressions]
>> > 2012-10-08 15:58:35,875 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:178) -
>> > Compilation took 107 ms
>> > 2012-10-08 15:58:35,879 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from templates.xqm
>> > 2012-10-08 15:58:35,950 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from config.xqm
>> > 2012-10-08 15:58:35,963 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/templates
>> > already
>> > present.
>> > 2012-10-08 15:58:35,973 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > ../examples/web/shakespeare.xql
>> > 2012-10-08 15:58:35,987 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/config
>> > already
>> > present.
>> > 2012-10-08 15:58:35,987 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/templates
>> > already
>> > present.
>> > 2012-10-08 15:58:35,988 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > resource:org/exist/xquery/lib/kwic.xql
>> > 2012-10-08 15:58:36,022 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from i18n-templates.xql
>> > 2012-10-08 15:58:36,027 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > xmldb:exist:///db/demo/modules/i18n.xql
>> > 2012-10-08 15:58:36,065 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/templates
>> > already
>> > present.
>> > 2012-10-08 15:58:36,065 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/config
>> > already
>> > present.
>> > 2012-10-08 15:58:36,066 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/config
>> > already
>> > present.
>> > 2012-10-08 15:58:36,067 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from demo.xql
>> > 2012-10-08 15:58:36,072 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > xmldb:exist:///db/demo/examples/tests/shakespeare-tests.xql
>> > 2012-10-08 15:58:36,076 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > resource:org/exist/xquery/lib/xqsuite/xqsuite.xql
>> > 2012-10-08 15:58:36,214 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/apps/demo/shakespeare
>> > already present.
>> > 2012-10-08 15:58:36,215 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/xqsuite already
>> > present.
>> > 2012-10-08 15:58:36,217 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > ../examples/web/guess-templates.xql
>> > 2012-10-08 15:58:36,225 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/templates
>> > already
>> > present.
>> > 2012-10-08 15:58:36,227 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from cex.xql
>> > 2012-10-08 15:58:36,238 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/config
>> > already
>> > present.
>> > 2012-10-08 15:58:36,238 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/kwic already
>> > present.
>> > 2012-10-08 15:58:36,244 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:171) -
>> > Query diagnostics:
>> > let  <15>
>> >     $lookup := function(xs:string*, xs:int*) item()*,
>> >     let  <22>
>> >         $content := request:get-data()
>> >     return
>> >         templates:apply($content, untyped-value-check[function,
>> > $lookup],
>> > untyped-value-check[map, ])
>> > 2012-10-08 15:58:36,245 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:178) -
>> > Compilation took 368 ms
>> > 2012-10-08 15:58:36,250 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > xmldb:exist:///db/demo/modules/i18n.xql
>> > 2012-10-08 15:58:36,297 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from config.xqm
>> > 2012-10-08 15:58:36,310 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from templates.xqm
>> > 2012-10-08 15:58:36,383 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/config
>> > already
>> > present.
>> > 2012-10-08 15:58:36,392 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > resource:org/exist/xquery/lib/kwic.xql
>> > 2012-10-08 15:58:36,425 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:173) -
>> > Query diagnostics:
>> > [skipped: more than 150 expressions]
>> > 2012-10-08 15:58:36,426 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:178) -
>> > Compilation took 137 ms
>> > 2012-10-08 15:58:36,442 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from ../../modules/config.xqm
>> > 2012-10-08 15:58:36,455 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from templates.xqm
>> > 2012-10-08 15:58:36,529 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/config
>> > already
>> > present.
>> > 2012-10-08 15:58:36,540 [eXistThread-37] DEBUG (XQueryContext.java
>> > [importModule]:2685) - Module http://exist-db.org/xquery/templates
>> > already
>> > present.
>> > 2012-10-08 15:58:36,540 [eXistThread-37] DEBUG (XQueryContext.java
>> > [compileModule]:2855) - Loading module from
>> > resource:org/exist/xquery/lib/kwic.xql
>> > 2012-10-08 15:58:36,573 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:173) -
>> > Query diagnostics:
>> > [skipped: more than 150 expressions]
>> > 2012-10-08 15:58:36,574 [eXistThread-37] DEBUG (XQuery.java
>> > [compile]:178) -
>> > Compilation took 144 ms
>> > 2012-10-08 15:58:36,574 [eXistThread-37] DEBUG (Collection.java
>> > [getDocument]:734) - Document templates.xql not found!
>> > 2012-10-08 15:58:36,575 [eXistThread-37] DEBUG (NativeBroker.java
>> > [getResource]:2173) - document '/db/demo/modules/templates.xql' not
>> > found!
>> > 2012-10-08 15:58:36,576 [eXistThread-37] DEBUG (RpcConnection.java
>> > [handleException]:120) -
>> > java.lang.NullPointerException
>> >         at
>> >
>> > org.exist.extensions.exquery.restxq.impl.XQueryCompiler.compile(XQueryCompiler.java:88)
>> >         at
>> >
>> > org.exist.extensions.exquery.restxq.impl.RestXqTrigger.findServices(RestXqTrigger.java:217)
>> >         at
>> >
>> > org.exist.extensions.exquery.restxq.impl.RestXqTrigger.reexamineModulesWithResolvedDependencies(RestXqTrigger.java:286)
>> >         at
>> >
>> > org.exist.extensions.exquery.restxq.impl.RestXqTrigger.findServices(RestXqTrigger.java:230)
>> >         at
>> >
>> > org.exist.extensions.exquery.restxq.impl.RestXqTrigger.after(RestXqTrigger.java:155)
>> >         at
>> >
>> > org.exist.extensions.exquery.restxq.impl.RestXqTrigger.afterUpdateDocument(RestXqTrigger.java:105)
>> >         at
>> >
>> > org.exist.collections.triggers.DocumentTriggersVisitor.afterUpdateDocument(DocumentTriggersVisitor.java:98)
>> >         at
>> > org.exist.collections.Collection.addBinaryResource(Collection.java:1887)
>> >         at
>> > org.exist.collections.Collection.addBinaryResource(Collection.java:1806)
>> >         at
>> > org.exist.collections.Collection.addBinaryResource(Collection.java:1794)
>> >         at
>> > org.exist.collections.Collection.addBinaryResource(Collection.java:1788)
>> >         at
>> > org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2413)
>> >         at
>> > org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2376)
>> >         at
>> > org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:5061)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> >
>> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> >         at
>> >
>> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >         at java.lang.reflect.Method.invoke(Method.java:597)
>> >         at
>> >
>> > org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:115)
>> >         at
>> >
>> > org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:106)
>> >         at
>> >
>> > org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46)
>> >         at
>> > org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86)
>> >         at
>> >
>> > org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200)
>> >         at
>> >
>> > org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112)
>> >         at
>> > org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196)
>> >         at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:68)
>> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>> >         at
>> > org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
>> >         at
>> >
>> > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>> >         at
>> >
>> > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542)
>> >         at
>> >
>> > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>> >         at
>> >
>> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>> >         at
>> >
>> > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>> >         at
>> > org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:224)
>> >         at
>> > org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:98)
>> >         at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:47)
>> >         at
>> >
>> > org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:211)
>> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>> >         at
>> > org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
>> >         at
>> >
>> > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>> >         at
>> >
>> > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:499)
>> >         at
>> >
>> > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>> >         at
>> >
>> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>> >         at
>> >
>> > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>> >         at
>> >
>> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>> >         at org.eclipse.jetty.server.Server.handle(Server.java:350)
>> >         at
>> >
>> > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>> >         at
>> >
>> > org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>> >         at
>> >
>> > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>> >         at
>> > org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:851)
>> >         at
>> > org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>> >         at
>> >
>> > org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)
>> >         at
>> >
>> > org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)
>> >         at
>> >
>> > org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)
>> >         at
>> >
>> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)
>> >         at
>> >
>> > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)
>> >         at java.lang.Thread.run(Thread.java:662)
>> > 2012-10-08 15:58:36,620 [eXistThread-30] DEBUG (SecurityManagerImpl.java
>> > [authenticate]:399) - Authentication try for 'admin'.
>> > 2012-10-08 15:58:36,621 [eXistThread-30] DEBUG (SecurityManagerImpl.java
>> > [authenticate]:442) - Authenticated by 'exist' as '[auth] <account
>> > name="admin" id="1048574"><group name="dba"
>> > id="1048575"></group></user>'.
>> > 2012-10-08 15:58:37,621 [eXistThread-37] DEBUG (SecurityManagerImpl.java
>> > [authenticate]:399) - Authentication try for 'admin'.
>> > 2012-10-08 15:58:37,622 [eXistThread-37] DEBUG (SecurityManagerImpl.java
>> > [authenticate]:442) - Authenticated by 'exist' as '[auth] <account
>> > name="admin" id="1048574"><group name="dba"
>> > id="1048575"></group></user>'.
>> >
>> >
>> >
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> > http://exist.2174344.n4.nabble.com/possible-lock-problems-with-oXygen-tp4656554p4656629.html
>> > Sent from the exist-open mailing list archive at Nabble.com.
>> >
>> >
>> > ------------------------------------------------------------------------------
>> > Don't let slow site performance ruin your business. Deploy New Relic APM
>> > Deploy New Relic app performance management and know exactly
>> > what is happening inside your Ruby, Python, PHP, Java, and .NET app
>> > Try New Relic at no cost today and get our sweet Data Nerd shirt too!
>> > http://p.sf.net/sfu/newrelic-dev2dev
>> > _______________________________________________
>> > Exist-open mailing list
>> > Exist-open@...
>> > https://lists.sourceforge.net/lists/listinfo/exist-open
>>
>>
>>
>> --
>> Adam Retter
>>
>> eXist Developer
>> { United Kingdom }
>> adam@...
>> irc://irc.freenode.net/existdb
>
>
>
>
> --
> Christophe Geiser, social entrepreneur
> e-Smile, solutions in monitoring and information management
> --
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] Stricter function parameter checks

[Casey Jordan <casey.jordan@jo...>]

Wolfgang,

Since we have close to 100k lines of XQuery I have a feeling this is going
to be very hard to debug this. Perhaps this should be configurable
to either throw an error or a warning? This way people could still take
advantage of the new features in trunk, without having to worry about this
creating regressions in their code.

Thanks,

Casey

---------- Forwarded message ----------
From: Wolfgang Meier <wolfgang@...>
Date: Tue, Oct 16, 2012 at 4:19 PM
Subject: [Exist-open] Stricter function parameter checks
To: eXist open <exist-open@...>


Hi,

if you are running trunk, please note that I fixed the cardinality checks
for function parameters. This may require minor changes in your XQuery
code. eXist was rather lax about the cardinality of a function parameter:
you could pass the empty sequence even if the parameter was declared to
expect exactly one item. This was certainly wrong with respect to the specs
and has now been changed.

Wolfgang

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open



-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

Re: [Exist-open] trying to figure out what is wrong with sequence in (my ?) map objects ...

[Wolfgang Meier <wolfgang@ex...>]

> This looks like a bug within the map constructor (or the way it is parsed). I could reduce the test to the following query:

Just for the record: this was indeed a bug in the XQuery parser which has now been fixed.

Wolfgang

Re: [Exist-open] possible lock problems with oXygen

[christophe geiser <christophe.geiser@e-...>]

yeah, I know - was almost banging my head against the wall on this one ...

working fine after 17337, sorry for not reporting earlier

Thanks and cheers,
C.

On Tue, Oct 16, 2012 at 9:24 PM, Adam Retter <adam@...> wrote:

> Phew! That was a tricky one. I only looked into the issue you reported
> when the RESTXQ Trigger is enabled, as that is the stack-trace that
> you provided.
>
> I think it may now, at least as RESTXQ is concerned, fixed as revision
> 17337 in trunk.
>
> Let me know...
>
>
> > Hi all,
> >
> > I tried to dig a bit more into this and discovered some strange behaviors
> > when urlRewrite + templating + circular module dependencies are involved,
> > that eventually lead to the lock problem described above (and to the fact
> > that xquery modules take quite a long time - 10sec + - to be commited to
> the
> > database), and sometimes to database corruption.
> >
> > One test case not too cumbersome to reproduce is to :
> > 0- backup your data (in my case the following steps lead to a corrupted
> db
> > !)
> > 1- load the demo package to the database
> > 2- modify demo/modules/templates.xql - > demo/modules/templates.xqm
> > 3- modify the ref of import modules in config.xqm and view.xql from
> > templates/xql to templates.xqm
> > 4- try to save the modifications
> >
> > Under my current configuration (Linux Mint - latest trunk version of
> eXist),
> > this lead to :
> >
> > a message box in oxygen :
> > Cannot save the file. Failed to invoke method storeBinary in class
> > org.exist.xmlrpc.RpcConnection: java.lang.NullPointerException
> >
> > >From now on, db fails to re-start and to recover...
> >
> > in exist.log:
> > 2012-10-08 15:58:35,762 [eXistThread-37] DEBUG (TransactionManager.java
> > [execute]:153) - Starting new transaction: 15
> > 2012-10-08 15:58:35,762 [eXistThread-37] DEBUG (RpcConnection.java
> > [storeBinary]:2411) - Storing binary resource to collection
> /db/demo/modules
> > 2012-10-08 15:58:35,763 [eXistThread-37] DEBUG (Collection.java
> > [checkPermissionsForAddDocument]:1756) - Found old doc 11255
> > 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (Collection.java
> > [addBinaryResource]:1862) - removing old document config.xqm
> > 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (NativeBroker.java
> > [removeBinaryResource]:2718) - removing binary resource 11255...
> > 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (RenameBinaryLoggable.java
> > [<init>]:39) - Rename binary created
> >
> /home/christophe/eXist-db/webapp/WEB-INF/data/fs/db/demo/modules/config.xqm
> > ->
> >
> /home/christophe/eXist-db/webapp/WEB-INF/data/fs.journal/txn.15/db/demo/modules/config.xqm
> > 2012-10-08 15:58:35,766 [eXistThread-37] DEBUG (NativeBroker.java
> > [removeResourceMetadata]:2761) - Removing resource metadata for 11255
> > 2012-10-08 15:58:35,766 [eXistThread-37] DEBUG (CreateBinaryLoggable.java
> > [<init>]:36) - CreateBinaryLoggable created
> > 2012-10-08 15:58:35,779 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from templates.xqm
> > 2012-10-08 15:58:35,850 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from config.xqm
> > 2012-10-08 15:58:35,863 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/templatesalready
> > present.
> > 2012-10-08 15:58:35,874 [eXistThread-37] DEBUG (XQuery.java
> [compile]:173) -
> > Query diagnostics:
> > [skipped: more than 150 expressions]
> > 2012-10-08 15:58:35,875 [eXistThread-37] DEBUG (XQuery.java
> [compile]:178) -
> > Compilation took 107 ms
> > 2012-10-08 15:58:35,879 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from templates.xqm
> > 2012-10-08 15:58:35,950 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from config.xqm
> > 2012-10-08 15:58:35,963 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/templatesalready
> > present.
> > 2012-10-08 15:58:35,973 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> ../examples/web/shakespeare.xql
> > 2012-10-08 15:58:35,987 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/configalready
> > present.
> > 2012-10-08 15:58:35,987 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/templatesalready
> > present.
> > 2012-10-08 15:58:35,988 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > resource:org/exist/xquery/lib/kwic.xql
> > 2012-10-08 15:58:36,022 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from i18n-templates.xql
> > 2012-10-08 15:58:36,027 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > xmldb:exist:///db/demo/modules/i18n.xql
> > 2012-10-08 15:58:36,065 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/templatesalready
> > present.
> > 2012-10-08 15:58:36,065 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/configalready
> > present.
> > 2012-10-08 15:58:36,066 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/configalready
> > present.
> > 2012-10-08 15:58:36,067 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from demo.xql
> > 2012-10-08 15:58:36,072 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > xmldb:exist:///db/demo/examples/tests/shakespeare-tests.xql
> > 2012-10-08 15:58:36,076 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > resource:org/exist/xquery/lib/xqsuite/xqsuite.xql
> > 2012-10-08 15:58:36,214 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/apps/demo/shakespeare
> > already present.
> > 2012-10-08 15:58:36,215 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/xqsuite already
> > present.
> > 2012-10-08 15:58:36,217 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > ../examples/web/guess-templates.xql
> > 2012-10-08 15:58:36,225 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/templatesalready
> > present.
> > 2012-10-08 15:58:36,227 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from cex.xql
> > 2012-10-08 15:58:36,238 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/configalready
> > present.
> > 2012-10-08 15:58:36,238 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/kwic already
> > present.
> > 2012-10-08 15:58:36,244 [eXistThread-37] DEBUG (XQuery.java
> [compile]:171) -
> > Query diagnostics:
> > let  <15>
> >     $lookup := function(xs:string*, xs:int*) item()*,
> >     let  <22>
> >         $content := request:get-data()
> >     return
> >         templates:apply($content, untyped-value-check[function, $lookup],
> > untyped-value-check[map, ])
> > 2012-10-08 15:58:36,245 [eXistThread-37] DEBUG (XQuery.java
> [compile]:178) -
> > Compilation took 368 ms
> > 2012-10-08 15:58:36,250 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > xmldb:exist:///db/demo/modules/i18n.xql
> > 2012-10-08 15:58:36,297 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from config.xqm
> > 2012-10-08 15:58:36,310 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from templates.xqm
> > 2012-10-08 15:58:36,383 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/configalready
> > present.
> > 2012-10-08 15:58:36,392 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > resource:org/exist/xquery/lib/kwic.xql
> > 2012-10-08 15:58:36,425 [eXistThread-37] DEBUG (XQuery.java
> [compile]:173) -
> > Query diagnostics:
> > [skipped: more than 150 expressions]
> > 2012-10-08 15:58:36,426 [eXistThread-37] DEBUG (XQuery.java
> [compile]:178) -
> > Compilation took 137 ms
> > 2012-10-08 15:58:36,442 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from ../../modules/config.xqm
> > 2012-10-08 15:58:36,455 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from templates.xqm
> > 2012-10-08 15:58:36,529 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/apps/configalready
> > present.
> > 2012-10-08 15:58:36,540 [eXistThread-37] DEBUG (XQueryContext.java
> > [importModule]:2685) - Module http://exist-db.org/xquery/templatesalready
> > present.
> > 2012-10-08 15:58:36,540 [eXistThread-37] DEBUG (XQueryContext.java
> > [compileModule]:2855) - Loading module from
> > resource:org/exist/xquery/lib/kwic.xql
> > 2012-10-08 15:58:36,573 [eXistThread-37] DEBUG (XQuery.java
> [compile]:173) -
> > Query diagnostics:
> > [skipped: more than 150 expressions]
> > 2012-10-08 15:58:36,574 [eXistThread-37] DEBUG (XQuery.java
> [compile]:178) -
> > Compilation took 144 ms
> > 2012-10-08 15:58:36,574 [eXistThread-37] DEBUG (Collection.java
> > [getDocument]:734) - Document templates.xql not found!
> > 2012-10-08 15:58:36,575 [eXistThread-37] DEBUG (NativeBroker.java
> > [getResource]:2173) - document '/db/demo/modules/templates.xql' not
> found!
> > 2012-10-08 15:58:36,576 [eXistThread-37] DEBUG (RpcConnection.java
> > [handleException]:120) -
> > java.lang.NullPointerException
> >         at
> >
> org.exist.extensions.exquery.restxq.impl.XQueryCompiler.compile(XQueryCompiler.java:88)
> >         at
> >
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.findServices(RestXqTrigger.java:217)
> >         at
> >
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.reexamineModulesWithResolvedDependencies(RestXqTrigger.java:286)
> >         at
> >
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.findServices(RestXqTrigger.java:230)
> >         at
> >
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.after(RestXqTrigger.java:155)
> >         at
> >
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.afterUpdateDocument(RestXqTrigger.java:105)
> >         at
> >
> org.exist.collections.triggers.DocumentTriggersVisitor.afterUpdateDocument(DocumentTriggersVisitor.java:98)
> >         at
> org.exist.collections.Collection.addBinaryResource(Collection.java:1887)
> >         at
> org.exist.collections.Collection.addBinaryResource(Collection.java:1806)
> >         at
> org.exist.collections.Collection.addBinaryResource(Collection.java:1794)
> >         at
> org.exist.collections.Collection.addBinaryResource(Collection.java:1788)
> >         at
> org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2413)
> >         at
> org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2376)
> >         at
> org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:5061)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >         at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at
> >
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:115)
> >         at
> >
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:106)
> >         at
> >
> org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46)
> >         at
> org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86)
> >         at
> >
> org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200)
> >         at
> >
> org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112)
> >         at
> org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196)
> >         at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:68)
> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> >         at
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
> >         at
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
> >         at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> >         at
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542)
> >         at
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
> >         at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
> >         at
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> >         at
> >
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> >         at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> >         at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> >         at
> org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:224)
> >         at
> org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:98)
> >         at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:47)
> >         at
> >
> org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:211)
> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> >         at
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
> >         at
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
> >         at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> >         at
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:499)
> >         at
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
> >         at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
> >         at
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> >         at
> >
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> >         at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> >         at
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> >         at
> >
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
> >         at
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
> >         at org.eclipse.jetty.server.Server.handle(Server.java:350)
> >         at
> >
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
> >         at
> >
> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
> >         at
> >
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
> >         at
> org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:851)
> >         at
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> >         at
> >
> org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)
> >         at
> >
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)
> >         at
> >
> org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)
> >         at
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)
> >         at
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)
> >         at java.lang.Thread.run(Thread.java:662)
> > 2012-10-08 15:58:36,620 [eXistThread-30] DEBUG (SecurityManagerImpl.java
> > [authenticate]:399) - Authentication try for 'admin'.
> > 2012-10-08 15:58:36,621 [eXistThread-30] DEBUG (SecurityManagerImpl.java
> > [authenticate]:442) - Authenticated by 'exist' as '[auth] <account
> > name="admin" id="1048574"><group name="dba"
> id="1048575"></group></user>'.
> > 2012-10-08 15:58:37,621 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> > [authenticate]:399) - Authentication try for 'admin'.
> > 2012-10-08 15:58:37,622 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> > [authenticate]:442) - Authenticated by 'exist' as '[auth] <account
> > name="admin" id="1048574"><group name="dba"
> id="1048575"></group></user>'.
> >
> >
> >
> >
> >
> >
> > --
> > View this message in context:
> http://exist.2174344.n4.nabble.com/possible-lock-problems-with-oXygen-tp4656554p4656629.html
> > Sent from the exist-open mailing list archive at Nabble.com.
> >
> >
> ------------------------------------------------------------------------------
> > Don't let slow site performance ruin your business. Deploy New Relic APM
> > Deploy New Relic app performance management and know exactly
> > what is happening inside your Ruby, Python, PHP, Java, and .NET app
> > Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> > http://p.sf.net/sfu/newrelic-dev2dev
> > _______________________________________________
> > Exist-open mailing list
> > Exist-open@...
> > https://lists.sourceforge.net/lists/listinfo/exist-open
>
>
>
> --
> Adam Retter
>
> eXist Developer
> { United Kingdom }
> adam@...
> irc://irc.freenode.net/existdb
>



-- 
Christophe Geiser, social entrepreneur
e-Smile, solutions in monitoring and information management
--

[Exist-open] Stricter function parameter checks

[Wolfgang Meier <wolfgang@ex...>]

Hi, 

if you are running trunk, please note that I fixed the cardinality checks for function parameters. This may require minor changes in your XQuery code. eXist was rather lax about the cardinality of a function parameter: you could pass the empty sequence even if the parameter was declared to expect exactly one item. This was certainly wrong with respect to the specs and has now been changed.

Wolfgang

Re: [Exist-open] failing to commit circular module definition

[christophe geiser <christophe.geiser@e-...>]

working on my end as well, thanks,
C.

On Tue, Oct 16, 2012 at 9:39 PM, Adam Retter <adam@...> wrote:

> Okay I have tried to store your modules into the database in the
> following order:
>
> test.xqm
> test1.xqm
> test2.xqm
> test3.xqm
>
> And that does appear to work, can you tell me if I am doing something
> wrong, or I wonder if its that revision 17337 has also fixed this.
>
> Let me know...
>
> On 16 October 2012 20:32, Adam Retter <adam@...> wrote:
> >> I guess one should be able to use circular modules even with restxq
> enabled
> >
> > Indeed. I did fix a circular resolution problem previously. After the
> > fix I have just done, I am now trying this test case as well and will
> > come back with some comments...
> >
> >
> >
> >
> > --
> > Adam Retter
> >
> > eXist Developer
> > { United Kingdom }
> > adam@...
> > irc://irc.freenode.net/existdb
>
>
>
> --
> Adam Retter
>
> eXist Developer
> { United Kingdom }
> adam@...
> irc://irc.freenode.net/existdb
>



-- 
Christophe Geiser, social entrepreneur
e-Smile, solutions in monitoring and information management
--

[Exist-open] [Exist-Open] datetime cardinality error question

[David Baird <dbtripledc@gm...>]

I use eXist 1.4.1. I have inherited a date-picker where by you pick a date
range on a TO calendar and FROM calendar and it brings back all the
articles published on that date. It works great for all dates except for
10/09/2012. I keep getting an error for that date -

*Error checking function parameter 1 in call
datetime:format-date(untyped-value-check[xs:date,
$article/descendants-or-self::.../child::pubsDateList/attribute::firstTimePublished
cast as xs:dateTime], "MM/dd/yyyy"): The actual cardinality for parameter 1
does not match the cardinality declared in function's signature:
datetime:format-date($date as xs:date, $simple-date-format as xs:string)
xs:string. Expected cardinality: exactly one, got 0 [at line 49, column13]*.

I have tried to reindex the DB but it still fails. So, I am wondering could
it be that one of the files are corrupted on it's firstTimePublished date?
If so, does anyone have any idea what kind of query I can do to find it and
fix it? Or, if thats not the case, what else could be the problem?

I have been beating my head against the wall for an several hours trying to
find a solution and really need some help. BTW: I am a newbie to Xquery so
be gentle. :)

Re: [Exist-open] failing to commit circular module definition

[Adam Retter <adam@ex...>]

Okay I have tried to store your modules into the database in the
following order:

test.xqm
test1.xqm
test2.xqm
test3.xqm

And that does appear to work, can you tell me if I am doing something
wrong, or I wonder if its that revision 17337 has also fixed this.

Let me know...

On 16 October 2012 20:32, Adam Retter <adam@...> wrote:
>> I guess one should be able to use circular modules even with restxq enabled
>
> Indeed. I did fix a circular resolution problem previously. After the
> fix I have just done, I am now trying this test case as well and will
> come back with some comments...
>
>
>
>
> --
> Adam Retter
>
> eXist Developer
> { United Kingdom }
> adam@...
> irc://irc.freenode.net/existdb



-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] failing to commit circular module definition

[Adam Retter <adam@ex...>]

> I guess one should be able to use circular modules even with restxq enabled

Indeed. I did fix a circular resolution problem previously. After the
fix I have just done, I am now trying this test case as well and will
come back with some comments...




-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] failing to commit circular module definition

[Adam Retter <adam@ex...>]

> In my conf.xml :
> ...
>    <!-- EXQuery RESTXQ trigger to load the RESTXQ Registry at startup time
> -->
>         <!--trigger
> class="org.exist.extensions.exquery.restxq.impl.RestXqStartupTrigger"/-->
> ...
>   <!-- EXQuery Modules -->
>             <!-- RESTXQ -->
>             <!--module uri="http://exquery.org/ns/restxq";
> class="org.exist.extensions.exquery.restxq.impl.xquery.RestXqModule"/-->
>
> So, I presume restxq is disabled.

That does not disable RESTXQ. The first startup trigger, simply
initialises the RESTXQ registry at startup time so your RESTXQ
services are available as soon as the database is, but if you disable
that, RESTXQ will be simply lazily instantiated later if you have
RestXqTrigger enabled.

To disable RestXQ you need to comment out any definitions in your
collection.xconf files.


> But I do see some restxq error message in exist.log, especially when I save
> modules having dependencies, e.g. like the one below. That was actually the
> reason why I tried to investigate circular module dependencies: I suspect
> this issue is causing delays in committing modules and eventually lead to db
> lock and corruption as reported previously by Dan McCreary.
>
> Cheers and thanks for the attention,
> C.
>
> 2012-10-09 08:59:51,847 [eXistThread-45] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://e-smile.org/common/session already
> present.
> 2012-10-09 08:59:51,850 [eXistThread-45] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from map-extensions.xqm
> 2012-10-09 08:59:51,861 [eXistThread-45] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> 2012-10-09 08:59:52,098 [eXistThread-45] WARN  (Type.java
> [getSuperType]:396) - no supertype for empty()
> java.lang.Throwable
> at org.exist.xquery.value.Type.getSuperType(Type.java:396)
> at org.exist.xquery.value.Type.getCommonSuperType(Type.java:422)
> at
> org.exist.xquery.ConditionalExpression.returnsType(ConditionalExpression.java:149)
> at org.exist.xquery.PathExpr.returnsType(PathExpr.java:393)
> at org.exist.xquery.CastExpression.<init>(CastExpression.java:54)
> at org.exist.xquery.FunctionFactory.castExpression(FunctionFactory.java:294)
> at org.exist.xquery.FunctionFactory.createFunction(FunctionFactory.java:87)
> at org.exist.xquery.FunctionFactory.createFunction(FunctionFactory.java:53)
> at
> org.exist.xquery.parser.XQueryTreeParser.functionCall(XQueryTreeParser.java:9586)
> at
> org.exist.xquery.parser.XQueryTreeParser.primaryExpr(XQueryTreeParser.java:6857)
> at org.exist.xquery.parser.XQueryTreeParser.expr(XQueryTreeParser.java:3482)
> at
> org.exist.xquery.parser.XQueryTreeParser.functionDecl(XQueryTreeParser.java:5477)
> at
> org.exist.xquery.parser.XQueryTreeParser.prolog(XQueryTreeParser.java:4673)
> at
> org.exist.xquery.parser.XQueryTreeParser.libraryModule(XQueryTreeParser.java:3937)
> at
> org.exist.xquery.parser.XQueryTreeParser.module(XQueryTreeParser.java:3773)
> at
> org.exist.xquery.parser.XQueryTreeParser.xpath(XQueryTreeParser.java:3562)
> at org.exist.xquery.XQueryContext.compileModule(XQueryContext.java:2887)
> at
> org.exist.xquery.XQueryContext.compileOrBorrowModule(XQueryContext.java:2823)
> at
> org.exist.xquery.XQueryContext.resolveInEXPathRepository(XQueryContext.java:364)
> at org.exist.xquery.XQueryContext.importModule(XQueryContext.java:2690)
> at
> org.exist.xquery.parser.XQueryTreeParser.importDecl(XQueryTreeParser.java:5593)
> at
> org.exist.xquery.parser.XQueryTreeParser.prolog(XQueryTreeParser.java:4666)
> at
> org.exist.xquery.parser.XQueryTreeParser.libraryModule(XQueryTreeParser.java:3937)
> at
> org.exist.xquery.parser.XQueryTreeParser.module(XQueryTreeParser.java:3773)
> at
> org.exist.xquery.parser.XQueryTreeParser.xpath(XQueryTreeParser.java:3562)
> at org.exist.xquery.XQueryContext.compileModule(XQueryContext.java:2887)
> at
> org.exist.xquery.XQueryContext.compileOrBorrowModule(XQueryContext.java:2823)
> at org.exist.xquery.XQueryContext.importModule(XQueryContext.java:2745)
> at
> org.exist.xquery.parser.XQueryTreeParser.importDecl(XQueryTreeParser.java:5593)
> at
> org.exist.xquery.parser.XQueryTreeParser.prolog(XQueryTreeParser.java:4666)
> at
> org.exist.xquery.parser.XQueryTreeParser.libraryModule(XQueryTreeParser.java:3937)
> at
> org.exist.xquery.parser.XQueryTreeParser.module(XQueryTreeParser.java:3773)
> at
> org.exist.xquery.parser.XQueryTreeParser.xpath(XQueryTreeParser.java:3562)
> at org.exist.xquery.XQueryContext.compileModule(XQueryContext.java:2887)
> at
> org.exist.xquery.XQueryContext.compileOrBorrowModule(XQueryContext.java:2823)
> at org.exist.xquery.XQueryContext.importModule(XQueryContext.java:2745)
> at
> org.exist.xquery.parser.XQueryTreeParser.importDecl(XQueryTreeParser.java:5593)
> at
> org.exist.xquery.parser.XQueryTreeParser.prolog(XQueryTreeParser.java:4666)
> at
> org.exist.xquery.parser.XQueryTreeParser.libraryModule(XQueryTreeParser.java:3937)
> at
> org.exist.xquery.parser.XQueryTreeParser.module(XQueryTreeParser.java:3773)
> at
> org.exist.xquery.parser.XQueryTreeParser.xpath(XQueryTreeParser.java:3562)
> at org.exist.xquery.XQueryContext.compileModule(XQueryContext.java:2887)
> at
> org.exist.xquery.XQueryContext.compileOrBorrowModule(XQueryContext.java:2823)
> at org.exist.xquery.XQueryContext.importModule(XQueryContext.java:2745)
> at
> org.exist.xquery.parser.XQueryTreeParser.importDecl(XQueryTreeParser.java:5593)
> at
> org.exist.xquery.parser.XQueryTreeParser.prolog(XQueryTreeParser.java:4666)
> at
> org.exist.xquery.parser.XQueryTreeParser.libraryModule(XQueryTreeParser.java:3937)
> at
> org.exist.xquery.parser.XQueryTreeParser.module(XQueryTreeParser.java:3773)
> at
> org.exist.xquery.parser.XQueryTreeParser.xpath(XQueryTreeParser.java:3562)
> at org.exist.xquery.XQuery.compile(XQuery.java:157)
> at org.exist.xquery.XQuery.compile(XQuery.java:106)
> at org.exist.xquery.XQuery.compile(XQuery.java:90)
> at
> org.exist.extensions.exquery.restxq.impl.XQueryCompiler.compile(XQueryCompiler.java:83)
> at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.findServices(RestXqTrigger.java:217)
> at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.after(RestXqTrigger.java:155)
> at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.afterUpdateDocument(RestXqTrigger.java:105)
> at
> org.exist.collections.triggers.DocumentTriggersVisitor.afterUpdateDocument(DocumentTriggersVisitor.java:98)
> at org.exist.collections.Collection.addBinaryResource(Collection.java:1887)
> at org.exist.collections.Collection.addBinaryResource(Collection.java:1806)
> at org.exist.collections.Collection.addBinaryResource(Collection.java:1794)
> at org.exist.collections.Collection.addBinaryResource(Collection.java:1788)
> at org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2413)
> at org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2376)
> at org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:5061)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:115)
> at
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:106)
> at
> org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46)
> at org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86)
> at
> org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200)
> at
> org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112)
> at org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196)
> at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:68)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:224)
> at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:98)
> at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:47)
> at
> org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:211)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:499)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
> at org.eclipse.jetty.server.Server.handle(Server.java:350)
> at
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
> at
> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
> at
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:851)
> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> at
> org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)
> at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)
> at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)
> at java.lang.Thread.run(Thread.java:662)
>
>
>
> On Tue, Oct 9, 2012 at 8:51 AM, Dmitriy Shabanov <shabanovd@...>
> wrote:
>>
>> restxq enabled?
>>
>>
>> On Tue, Oct 9, 2012 at 11:34 AM, christophe geiser
>> <christophe.geiser@...> wrote:
>>>
>>> Oups, that make sense to ask...
>>> Latest trunk, rev 17278.
>>
>>
>> --
>> Dmitriy Shabanov
>
>
>
>
> --
> Christophe Geiser, social entrepreneur
> e-Smile, solutions in monitoring and information management
> --
>
>
> ------------------------------------------------------------------------------
> Don't let slow site performance ruin your business. Deploy New Relic APM
> Deploy New Relic app performance management and know exactly
> what is happening inside your Ruby, Python, PHP, Java, and .NET app
> Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> http://p.sf.net/sfu/newrelic-dev2dev
> _______________________________________________
> Exist-open mailing list
> Exist-open@...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] possible lock problems with oXygen

[Adam Retter <adam@ex...>]

Phew! That was a tricky one. I only looked into the issue you reported
when the RESTXQ Trigger is enabled, as that is the stack-trace that
you provided.

I think it may now, at least as RESTXQ is concerned, fixed as revision
17337 in trunk.

Let me know...


> Hi all,
>
> I tried to dig a bit more into this and discovered some strange behaviors
> when urlRewrite + templating + circular module dependencies are involved,
> that eventually lead to the lock problem described above (and to the fact
> that xquery modules take quite a long time - 10sec + - to be commited to the
> database), and sometimes to database corruption.
>
> One test case not too cumbersome to reproduce is to :
> 0- backup your data (in my case the following steps lead to a corrupted db
> !)
> 1- load the demo package to the database
> 2- modify demo/modules/templates.xql - > demo/modules/templates.xqm
> 3- modify the ref of import modules in config.xqm and view.xql from
> templates/xql to templates.xqm
> 4- try to save the modifications
>
> Under my current configuration (Linux Mint - latest trunk version of eXist),
> this lead to :
>
> a message box in oxygen :
> Cannot save the file. Failed to invoke method storeBinary in class
> org.exist.xmlrpc.RpcConnection: java.lang.NullPointerException
>
> >From now on, db fails to re-start and to recover...
>
> in exist.log:
> 2012-10-08 15:58:35,762 [eXistThread-37] DEBUG (TransactionManager.java
> [execute]:153) - Starting new transaction: 15
> 2012-10-08 15:58:35,762 [eXistThread-37] DEBUG (RpcConnection.java
> [storeBinary]:2411) - Storing binary resource to collection /db/demo/modules
> 2012-10-08 15:58:35,763 [eXistThread-37] DEBUG (Collection.java
> [checkPermissionsForAddDocument]:1756) - Found old doc 11255
> 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (Collection.java
> [addBinaryResource]:1862) - removing old document config.xqm
> 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (NativeBroker.java
> [removeBinaryResource]:2718) - removing binary resource 11255...
> 2012-10-08 15:58:35,765 [eXistThread-37] DEBUG (RenameBinaryLoggable.java
> [<init>]:39) - Rename binary created
> /home/christophe/eXist-db/webapp/WEB-INF/data/fs/db/demo/modules/config.xqm
> ->
> /home/christophe/eXist-db/webapp/WEB-INF/data/fs.journal/txn.15/db/demo/modules/config.xqm
> 2012-10-08 15:58:35,766 [eXistThread-37] DEBUG (NativeBroker.java
> [removeResourceMetadata]:2761) - Removing resource metadata for 11255
> 2012-10-08 15:58:35,766 [eXistThread-37] DEBUG (CreateBinaryLoggable.java
> [<init>]:36) - CreateBinaryLoggable created
> 2012-10-08 15:58:35,779 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from templates.xqm
> 2012-10-08 15:58:35,850 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from config.xqm
> 2012-10-08 15:58:35,863 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/templates already
> present.
> 2012-10-08 15:58:35,874 [eXistThread-37] DEBUG (XQuery.java [compile]:173) -
> Query diagnostics:
> [skipped: more than 150 expressions]
> 2012-10-08 15:58:35,875 [eXistThread-37] DEBUG (XQuery.java [compile]:178) -
> Compilation took 107 ms
> 2012-10-08 15:58:35,879 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from templates.xqm
> 2012-10-08 15:58:35,950 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from config.xqm
> 2012-10-08 15:58:35,963 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/templates already
> present.
> 2012-10-08 15:58:35,973 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from ../examples/web/shakespeare.xql
> 2012-10-08 15:58:35,987 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/apps/config already
> present.
> 2012-10-08 15:58:35,987 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/templates already
> present.
> 2012-10-08 15:58:35,988 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> resource:org/exist/xquery/lib/kwic.xql
> 2012-10-08 15:58:36,022 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from i18n-templates.xql
> 2012-10-08 15:58:36,027 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> xmldb:exist:///db/demo/modules/i18n.xql
> 2012-10-08 15:58:36,065 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/templates already
> present.
> 2012-10-08 15:58:36,065 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/apps/config already
> present.
> 2012-10-08 15:58:36,066 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/apps/config already
> present.
> 2012-10-08 15:58:36,067 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from demo.xql
> 2012-10-08 15:58:36,072 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> xmldb:exist:///db/demo/examples/tests/shakespeare-tests.xql
> 2012-10-08 15:58:36,076 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> resource:org/exist/xquery/lib/xqsuite/xqsuite.xql
> 2012-10-08 15:58:36,214 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/apps/demo/shakespeare
> already present.
> 2012-10-08 15:58:36,215 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/xqsuite already
> present.
> 2012-10-08 15:58:36,217 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> ../examples/web/guess-templates.xql
> 2012-10-08 15:58:36,225 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/templates already
> present.
> 2012-10-08 15:58:36,227 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from cex.xql
> 2012-10-08 15:58:36,238 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/apps/config already
> present.
> 2012-10-08 15:58:36,238 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/kwic already
> present.
> 2012-10-08 15:58:36,244 [eXistThread-37] DEBUG (XQuery.java [compile]:171) -
> Query diagnostics:
> let  <15>
>     $lookup := function(xs:string*, xs:int*) item()*,
>     let  <22>
>         $content := request:get-data()
>     return
>         templates:apply($content, untyped-value-check[function, $lookup],
> untyped-value-check[map, ])
> 2012-10-08 15:58:36,245 [eXistThread-37] DEBUG (XQuery.java [compile]:178) -
> Compilation took 368 ms
> 2012-10-08 15:58:36,250 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> xmldb:exist:///db/demo/modules/i18n.xql
> 2012-10-08 15:58:36,297 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from config.xqm
> 2012-10-08 15:58:36,310 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from templates.xqm
> 2012-10-08 15:58:36,383 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/apps/config already
> present.
> 2012-10-08 15:58:36,392 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> resource:org/exist/xquery/lib/kwic.xql
> 2012-10-08 15:58:36,425 [eXistThread-37] DEBUG (XQuery.java [compile]:173) -
> Query diagnostics:
> [skipped: more than 150 expressions]
> 2012-10-08 15:58:36,426 [eXistThread-37] DEBUG (XQuery.java [compile]:178) -
> Compilation took 137 ms
> 2012-10-08 15:58:36,442 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from ../../modules/config.xqm
> 2012-10-08 15:58:36,455 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from templates.xqm
> 2012-10-08 15:58:36,529 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/apps/config already
> present.
> 2012-10-08 15:58:36,540 [eXistThread-37] DEBUG (XQueryContext.java
> [importModule]:2685) - Module http://exist-db.org/xquery/templates already
> present.
> 2012-10-08 15:58:36,540 [eXistThread-37] DEBUG (XQueryContext.java
> [compileModule]:2855) - Loading module from
> resource:org/exist/xquery/lib/kwic.xql
> 2012-10-08 15:58:36,573 [eXistThread-37] DEBUG (XQuery.java [compile]:173) -
> Query diagnostics:
> [skipped: more than 150 expressions]
> 2012-10-08 15:58:36,574 [eXistThread-37] DEBUG (XQuery.java [compile]:178) -
> Compilation took 144 ms
> 2012-10-08 15:58:36,574 [eXistThread-37] DEBUG (Collection.java
> [getDocument]:734) - Document templates.xql not found!
> 2012-10-08 15:58:36,575 [eXistThread-37] DEBUG (NativeBroker.java
> [getResource]:2173) - document '/db/demo/modules/templates.xql' not found!
> 2012-10-08 15:58:36,576 [eXistThread-37] DEBUG (RpcConnection.java
> [handleException]:120) -
> java.lang.NullPointerException
>         at
> org.exist.extensions.exquery.restxq.impl.XQueryCompiler.compile(XQueryCompiler.java:88)
>         at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.findServices(RestXqTrigger.java:217)
>         at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.reexamineModulesWithResolvedDependencies(RestXqTrigger.java:286)
>         at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.findServices(RestXqTrigger.java:230)
>         at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.after(RestXqTrigger.java:155)
>         at
> org.exist.extensions.exquery.restxq.impl.RestXqTrigger.afterUpdateDocument(RestXqTrigger.java:105)
>         at
> org.exist.collections.triggers.DocumentTriggersVisitor.afterUpdateDocument(DocumentTriggersVisitor.java:98)
>         at org.exist.collections.Collection.addBinaryResource(Collection.java:1887)
>         at org.exist.collections.Collection.addBinaryResource(Collection.java:1806)
>         at org.exist.collections.Collection.addBinaryResource(Collection.java:1794)
>         at org.exist.collections.Collection.addBinaryResource(Collection.java:1788)
>         at org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2413)
>         at org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:2376)
>         at org.exist.xmlrpc.RpcConnection.storeBinary(RpcConnection.java:5061)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:115)
>         at
> org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:106)
>         at
> org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46)
>         at org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86)
>         at
> org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200)
>         at
> org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112)
>         at org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196)
>         at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:68)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>         at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
>         at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
>         at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>         at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542)
>         at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>         at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>         at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>         at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>         at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>         at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>         at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:224)
>         at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:98)
>         at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:47)
>         at
> org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:211)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>         at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598)
>         at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486)
>         at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>         at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:499)
>         at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>         at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>         at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>         at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>         at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>         at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>         at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>         at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>         at org.eclipse.jetty.server.Server.handle(Server.java:350)
>         at
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>         at
> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>         at
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:851)
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>         at
> org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)
>         at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)
>         at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)
>         at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)
>         at
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)
>         at java.lang.Thread.run(Thread.java:662)
> 2012-10-08 15:58:36,620 [eXistThread-30] DEBUG (SecurityManagerImpl.java
> [authenticate]:399) - Authentication try for 'admin'.
> 2012-10-08 15:58:36,621 [eXistThread-30] DEBUG (SecurityManagerImpl.java
> [authenticate]:442) - Authenticated by 'exist' as '[auth] <account
> name="admin" id="1048574"><group name="dba" id="1048575"></group></user>'.
> 2012-10-08 15:58:37,621 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> [authenticate]:399) - Authentication try for 'admin'.
> 2012-10-08 15:58:37,622 [eXistThread-37] DEBUG (SecurityManagerImpl.java
> [authenticate]:442) - Authenticated by 'exist' as '[auth] <account
> name="admin" id="1048574"><group name="dba" id="1048575"></group></user>'.
>
>
>
>
>
>
> --
> View this message in context: http://exist.2174344.n4.nabble.com/possible-lock-problems-with-oXygen-tp4656554p4656629.html
> Sent from the exist-open mailing list archive at Nabble.com.
>
> ------------------------------------------------------------------------------
> Don't let slow site performance ruin your business. Deploy New Relic APM
> Deploy New Relic app performance management and know exactly
> what is happening inside your Ruby, Python, PHP, Java, and .NET app
> Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> http://p.sf.net/sfu/newrelic-dev2dev
> _______________________________________________
> Exist-open mailing list
> Exist-open@...
> https://lists.sourceforge.net/lists/listinfo/exist-open



-- 
Adam Retter

eXist Developer
{ United Kingdom }
adam@...
irc://irc.freenode.net/existdb

Re: [Exist-open] Bulk Loading ... how to?

[Casey Jordan <casey.jordan@jo...>]

Wolfgang,

What is the bottleneck that requires more than 512MB?

I would like to understand this better for our production systems.
Sometimes files larger than 2GB will be uploaded, sometimes multiple files
at once, we haven't had any problems but I was under the impression
everything was done through streaming so arbitrarily large documents could
be handled with small amounts of memory.

Thanks,

Casey

On Tue, Oct 16, 2012 at 9:41 AM, Wolfgang Meier <wolfgang@...>wrote:

> Hi Peter,
>
> I just imported your data set on a spare machine. It wasn't a problem. You
> need to give Java more than the 512mb default memory though. I used
> -Xmx2048m and 256m for cacheSize in conf.xml.
>
> The best way to bulk import data is to launch the Java client in local
> mode (by passing parameter -l to it).
>
> Wolfgang
>
> Am Dienstag, 16. Oktober 2012 um 14:41 schrieb peter winstanley:
>
> > Hello List
> > I tried bulk loading eXist v2.0 with the XML download files for the
> Scottish Neighbourhood Statistics using the java front end (java -jar
> start.jar) The files are available at
> http://www.sns.gov.uk/BulkDownloads/SNS_FullData_XML_7_3_2012.zip there
> are many tens of files and some are about 5Mb. My system choked. What is
> the most effective way of doing this? Is eXist an appropriate tool for
> working with this number and size of XML files?
> >
> > Cheers
> >
> > Peter
>
>
>
>
> ------------------------------------------------------------------------------
> Don't let slow site performance ruin your business. Deploy New Relic APM
> Deploy New Relic app performance management and know exactly
> what is happening inside your Ruby, Python, PHP, Java, and .NET app
> Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> http://p.sf.net/sfu/newrelic-dev2dev
> _______________________________________________
> Exist-open mailing list
> Exist-open@...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>



-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

Re: [Exist-open] Bulk Loading ... how to?

[Wolfgang Meier <wolfgang@ex...>]

Hi Peter, 

I just imported your data set on a spare machine. It wasn't a problem. You need to give Java more than the 512mb default memory though. I used -Xmx2048m and 256m for cacheSize in conf.xml.

The best way to bulk import data is to launch the Java client in local mode (by passing parameter -l to it).

Wolfgang 

Am Dienstag, 16. Oktober 2012 um 14:41 schrieb peter winstanley:

> Hello List
> I tried bulk loading eXist v2.0 with the XML download files for the Scottish Neighbourhood Statistics using the java front end (java -jar start.jar) The files are available at http://www.sns.gov.uk/BulkDownloads/SNS_FullData_XML_7_3_2012.zip there are many tens of files and some are about 5Mb. My system choked. What is the most effective way of doing this? Is eXist an appropriate tool for working with this number and size of XML files?
> 
> Cheers
> 
> Peter

Re: [Exist-open] FW: Bulk loading of eXist.... how to?

[Casey Jordan <casey.jordan@jo...>]

Hi Peter,

Assuming you are giving eXist enough resources, eXist should have no
problem handling thousands of large files.

Are you using the java admin client to do the upload?
http://exist-db.org/exist/quickstart.xml#administering

I have uploaded thousands of documents, some as large as 500MB using the
client with no issues. If you are still having problems, please supply more
details, error messages or log output.

Hope this helps.



On Tue, Oct 16, 2012 at 8:25 AM, peter winstanley <p.w@...> wrote:

> **
> Hello List
>
> I tried bulk loading eXist v2.0 with the XML download files for the
> Scottish Neighbourhood Statistics  using the java front end (java -jar
> start.jar) The files are available at
> http://www.sns.gov.uk/BulkDownloads/SNS_FullData_XML_7_3_2012.zip  there
> are many tens of files and some are about 5Mb.  My system choked.  What is
> the most effective way of doing this?  Is eXist an appropriate tool for
> working with this number and size of XML files?
>
> Cheers
>
> Peter
> ------------------------------
>  [image: 3D Marine Aquarium Screensaver Preview]<http://www.inbox.com/marineaquarium>;
> *Free 3D Marine Aquarium Screensaver*
> **Watch dolphins, sharks & orcas on your desktop!** **Check it out at
> http://www.inbox.com/marineaquarium**
>
>
> ------------------------------------------------------------------------------
> Don't let slow site performance ruin your business. Deploy New Relic APM
> Deploy New Relic app performance management and know exactly
> what is happening inside your Ruby, Python, PHP, Java, and .NET app
> Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> http://p.sf.net/sfu/newrelic-dev2dev
> _______________________________________________
> Exist-open mailing list
> Exist-open@...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
>


-- 
--
Casey Jordan
easyDITA a product of Jorsek LLC
"CaseyDJordan" on LinkedIn, Twitter & Facebook
(585) 348 7399
easydita.com


This message is intended only for the use of the Addressee(s) and may
contain information that is privileged, confidential, and/or exempt from
disclosure under applicable law.  If you are not the intended recipient,
please be advised that any disclosure  copying, distribution, or use of
the information contained herein is prohibited.  If you have received
this communication in error, please destroy all copies of the message,
whether in electronic or hard copy format, as well as attachments, and
immediately contact the sender by replying to this e-mail or by phone.
Thank you.

[Exist-open] Bulk Loading ... how to?

[peter winstanley <p.w@in...>]

Hello List
I tried bulk loading eXist v2.0 with the XML download files for the Scottish Neighbourhood Statistics  using the java front end (java -jar start.jar) The files are available at http://www.sns.gov.uk/BulkDownloads/SNS_FullData_XML_7_3_2012.zip  there are many tens of files and some are about 5Mb.  My system choked.  What is the most effective way of doing this?  Is eXist an appropriate tool for working with this number and size of XML files?

Cheers

Peter

____________________________________________________________
FREE 3D EARTH SCREENSAVER - Watch the Earth right on your desktop!
Check it out at http://www.inbox.com/earth

[Exist-open] FW: Bulk loading of eXist.... how to?

[peter winstanley <p.w@in...>]

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML>
<HEAD><META http-equiv=Content-Type content="text/html; charset=utf-8"><META content="INBOX.COM" name=GENERATOR></HEAD>
<BODY>
<DIV>Hello List</DIV>
<DIV class=oldBody>
<DIV>
<P>I tried bulk loading eXist v2.0 with the XML download files for the Scottish Neighbourhood Statistics&nbsp; using the java front end (java -jar start.jar) The files are available at <A href="http://www.sns.gov.uk/BulkDownloads/SNS_FullData_XML_7_3_2012.zip">http://www.sns.gov.uk/BulkDownloads/SNS_FullData_XML_7_3_2012.zip</A>&nbsp; there are many tens of files and some are about 5Mb.&nbsp; My system choked.&nbsp; What is the most effective way of doing this?&nbsp; Is eXist an appropriate tool for working with this number and size of XML files?</P>
<P>Cheers</P>
<P>Peter</P></DIV></DIV><hr size="1px" noshade style="clear:both;margin-top:10px;height:1px;">
<div style="font:12px Verdana,sans-serif;color:Black;background:white;padding:3px;line-height:1.3em">
<a href="http://www.inbox.com/marineaquarium"><img src="http://my.inbox.com/img/ftrs/marine.jpg"; width="104" hight="90" alt="3D Marine Aquarium Screensaver Preview" align="left" border="0" style="margin-right:15px" /></a>
<br><strong><font color="2086c3">Free 3D Marine Aquarium Screensaver</font></strong><br>
<nobr>Watch dolphins, sharks &amp; orcas on your desktop!</nobr> <nobr>Check it out at <a href="http://www.inbox.com/marineaquarium">www.inbox.com/marineaquarium</a></nobr></div>;
</BODY>
</HTML>

[Exist-open] WORKAROUND - eXist crashes after large upload!

[Erik Siegel <mailing@xa...>]

Hi all,

 

Although this original post was misused to discuss about another interesting problem, the original problem didn't go away...

 

I did some trial-and-error and found a way around the problem. HOWEVER: The bug/problem remains and points to a serious memory/buffer overflow or other deep down issue.

But what I did and helped was:

 

1) Do the upload on a page that only does the upload. 

2) After that, perform a redirect to a new page - This ends the upload XQuery script

3) Do the processing in the XQuery script we redirected to

 

Erik Siegel

 

Van: Erik Siegel [mailto:mailing@...] 
Verzonden: donderdag 11 oktober 2012 16:05
Aan: exist-open@...
Onderwerp: [Exist-open] eXist crashes after large upload!

 

Hello,

 

I have an annoying problem. I tried to pin it down. Here is what I did:

Version: Latest trunk version (5min ago), mem.max 2Gb Stack max 2Mb. Problem observed on W7 and Ubuntu

 

·        I have a form on which I upload a large file (27Mb) (enctype="multipart/form-data" method="post")

·        The target page of this form (also an XQuery script) stores the file in the DB and starts checking it (it is a zip file). This is a lengthy process.

·        eXist crashes: All my 8 cores go to 100% (!!!) and I have to kill the eXist process

·        For smaller files (up to a few Mb) this works ok

 

Two important observations:

·        When I simply do the processing (without going through the form/upload) on the file already stored in the database it all works absolutely fine. So it seems to be the upload that causes the problem.

·        When I rewrite the target page to ignore the uploaded file (I don't do an request:get-uploaded-file-data ()) and process the file stored in the database, things go pear-shaped also.... So its not the processing of the uploaded file, its the upload itself.

 

My guess is that a large upload corrupts some memory buffer. Could that be the case? I hope anybody can help me out or provide with a pointer where to look for a solution.

 

Thanks

Erik Siegel

Re: [Exist-open] can't build when demo.exist-db.org is down

[Leif-Jöran Olsson <ljo@ex...>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Jens, to start with the quick fix. If you give property
*use.autodeploy.feature*=false or give property *public-repo* any other
value than "http://demo.exist-db.org/exist/apps/public-repo/public/";
then you can build without external interference.

On my agenda is though to make the public repos distributed so that we
have failover to cover these kinds of short outages.

Leif-Jöran


Den 2012-10-15 16:12, Jens Østergaard Petersen skrev:
> Hi,
> 
> Since building eXist now involves downloading .xar's for the main apps, a standard build fails when the server is down (as it was for some time this afternoon). 
> 
> Is it possible to have alternate download sites in the build script?
> 
> Jens
> ------------------------------------------------------------------------------
> Don't let slow site performance ruin your business. Deploy New Relic APM
> Deploy New Relic app performance management and know exactly
> what is happening inside your Ruby, Python, PHP, Java, and .NET app
> Try New Relic at no cost today and get our sweet Data Nerd shirt too!
> http://p.sf.net/sfu/newrelic-dev2dev
> _______________________________________________
> Exist-open mailing list
> Exist-open@...
> https://lists.sourceforge.net/lists/listinfo/exist-open
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.18 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://www.enigmail.net/

iD8DBQFQfTB8hcIn5aVXOPIRAjYOAJ4tCZ+qsiTyAb0gsMedJvrM1K61KACglzDD
oK380u7xkSIZycIKN5xlyZg=
=XAoG
-----END PGP SIGNATURE-----