exist-development — eXist Developer's List

Re: [Exist-development] collection function performance

[Masoud V. <ma...@gm...>]

now, about 320,000 documents and 3,000 sub collections.

On Sun, Jul 24, 2016 at 6:59 PM, Joe Wicentowski <jo...@gm...> wrote:

> Just curious - about how many documents/subcollections are in the
> collection in question?
>
> On Sun, Jul 24, 2016 at 10:16 AM, Masoud Vakili <ma...@gm...> wrote:
>
>> default value is 128mb and in the bellow link said
>>
>>> Usually this setting does not need to be changed unless you really have
>>> more than a few thousand collections in the db. Increase it carefully,
>>> maybe up to 128M.
>>
>> http://exist-db.org/exist/apps/doc/configuration.xml
>>
>> I changed it to 256mb, but it had no effect. continue increasing?
>>
>> On Sun, Jul 24, 2016 at 6:30 PM, Wolfgang Meier <wol...@ex...>
>> wrote:
>>
>>> > this function is high dependence on documents count. when The number
>>> of documents is large, the collection function not optimized and will be
>>> slow (200ms).
>>> > how can I improve its execution?
>>>
>>> Please try to increase the collectionCache setting in conf.xml
>>>
>>> Wolfgang
>>
>>
>>
>

Re: [Exist-development] collection function performance

[Joe W. <jo...@gm...>]

Just curious - about how many documents/subcollections are in the
collection in question?

On Sun, Jul 24, 2016 at 10:16 AM, Masoud Vakili <ma...@gm...> wrote:

> default value is 128mb and in the bellow link said
>
>> Usually this setting does not need to be changed unless you really have
>> more than a few thousand collections in the db. Increase it carefully,
>> maybe up to 128M.
>
> http://exist-db.org/exist/apps/doc/configuration.xml
>
> I changed it to 256mb, but it had no effect. continue increasing?
>
> On Sun, Jul 24, 2016 at 6:30 PM, Wolfgang Meier <wol...@ex...>
> wrote:
>
>> > this function is high dependence on documents count. when The number of
>> documents is large, the collection function not optimized and will be slow
>> (200ms).
>> > how can I improve its execution?
>>
>> Please try to increase the collectionCache setting in conf.xml
>>
>> Wolfgang
>
>
>

Re: [Exist-development] collection function performance

[Masoud V. <ma...@gm...>]

default value is 128mb and in the bellow link said

> Usually this setting does not need to be changed unless you really have
> more than a few thousand collections in the db. Increase it carefully,
> maybe up to 128M.

http://exist-db.org/exist/apps/doc/configuration.xml

I changed it to 256mb, but it had no effect. continue increasing?

On Sun, Jul 24, 2016 at 6:30 PM, Wolfgang Meier <wol...@ex...>
wrote:

> > this function is high dependence on documents count. when The number of
> documents is large, the collection function not optimized and will be slow
> (200ms).
> > how can I improve its execution?
>
> Please try to increase the collectionCache setting in conf.xml
>
> Wolfgang

Re: [Exist-development] collection function performance

[Wolfgang M. <wol...@ex...>]

> this function is high dependence on documents count. when The number of documents is large, the collection function not optimized and will be slow (200ms).
> how can I improve its execution?

Please try to increase the collectionCache setting in conf.xml

Wolfgang

Re: [Exist-development] collection function performance

[Masoud V. <ma...@gm...>]

eXist-db v2.2
this function is high dependence on documents count. when The number
of documents
is large, the collection function not optimized and will be slow (200ms).
how can I improve its execution?

On Sun, Jul 24, 2016 at 6:13 PM, Joe Wicentowski <jo...@gm...> wrote:

> Hi Masoud,
>
> > the collection function is heavily dependent on its documents subset path
> > and is very slow (for example 200 ms)!
>
> I'm not quite following what you mean by "heavily dependent on its
> documents subset path."  Could you explain this in a bit more detail?
> Also, which eXist version?
>
> Joe
>

Re: [Exist-development] collection function performance

[Joe W. <jo...@gm...>]

Hi Masoud,

> the collection function is heavily dependent on its documents subset path
> and is very slow (for example 200 ms)!

I'm not quite following what you mean by "heavily dependent on its
documents subset path."  Could you explain this in a bit more detail?
Also, which eXist version?

Joe

[Exist-development] collection function performance

[Masoud V. <ma...@gm...>]

Hi all,
the collection function is heavily dependent on its documents subset path
and is very slow (for example 200 ms)!
is there any way for improve performance?
(my CollectionCache is 128M and I tested 250M too, but it had no effect)
Please help me.

Re: [Exist-development] eXist-db log-level

[Dmitriy S. <sha...@gm...>]

yes, here <https://github.com/eXist-db/exist/blob/develop/log4j2.xml#L218>

On Wed, Jun 22, 2016 at 4:17 PM, Masoud Vakili <ma...@gm...> wrote:

> Does eXist-db have log-level config? (info, error, debug, ...)
>
>
> ------------------------------------------------------------------------------
> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
> Francisco, CA to explore cutting-edge tech and listen to tech luminaries
> present their vision of the future. This family event has something for
> everyone, including kids. Get more information and register today.
> http://sdm.link/attshape
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>
>


-- 
Dmitriy Shabanov

[Exist-development] eXist-db log-level

[Masoud V. <ma...@gm...>]

Does eXist-db have log-level config? (info, error, debug, ...)

Re: [Exist-development] XACML

[Dmitriy S. <sha...@gm...>]

Here the PR https://github.com/eXist-db/exist/pull/996

On Thu, May 5, 2016 at 7:47 PM, Adam Retter <ad...@ex...> wrote:

> AFAIK it is broken. When it did  work it was hideously slow.
>
> Also I don't believe anyone is really using it anymore, so it would
> probably be better just to remove it as a dead-feature.
>
> On 5 May 2016 at 11:28, Dmitriy Shabanov <sha...@gm...> wrote:
> > Hi,
> >
> > Is XACML in use this days? If no I can make PR to cleanup it.
> >
> > --
> > Dmitriy Shabanov
> >
> >
> ------------------------------------------------------------------------------
> > Find and fix application performance issues faster with Applications
> Manager
> > Applications Manager provides deep performance insights into multiple
> tiers
> > of
> > your business applications. It resolves application problems quickly and
> > reduces your MTTR. Get your free trial!
> > https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
> > _______________________________________________
> > Exist-development mailing list
> > Exi...@li...
> > https://lists.sourceforge.net/lists/listinfo/exist-development
> >
>
>
>
> --
> Adam Retter
>
> eXist Developer
> { United Kingdom }
> ad...@ex...
> irc://irc.freenode.net/existdb
>



-- 
Dmitriy Shabanov

Re: [Exist-development] XACML

[Adam R. <ad...@ex...>]

AFAIK it is broken. When it did  work it was hideously slow.

Also I don't believe anyone is really using it anymore, so it would
probably be better just to remove it as a dead-feature.

On 5 May 2016 at 11:28, Dmitriy Shabanov <sha...@gm...> wrote:
> Hi,
>
> Is XACML in use this days? If no I can make PR to cleanup it.
>
> --
> Dmitriy Shabanov
>
> ------------------------------------------------------------------------------
> Find and fix application performance issues faster with Applications Manager
> Applications Manager provides deep performance insights into multiple tiers
> of
> your business applications. It resolves application problems quickly and
> reduces your MTTR. Get your free trial!
> https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

[Exist-development] XACML

[Dmitriy S. <sha...@gm...>]

Hi,

Is XACML in use this days? If no I can make PR to cleanup it.

-- 
Dmitriy Shabanov

Re: [Exist-development] Chat room

[Adam R. <ad...@ex...>]

Thanks I handn't seen that :-)

On 4 May 2016 at 09:47, Dmitriy Shabanov <sha...@gm...> wrote:

> There is setting for it
>
> [image: Inline image 1]
>
> Well, no worries if everyone is happy.
>
> On Wed, May 4, 2016 at 4:31 PM, Adam Retter <ad...@ex...> wrote:
>
>> I find that if you are just visiting a gitter room for a one off thing,
>> then you receive emails about that room for ever more
>> On 4 May 2016 8:24 am, "Dannes Wessels" <da...@ex...> wrote:
>>
>>> I found the gitter guys very pushy and almost spammy in their approach;
>>> that made me turn away from that company....
>>>
>>> is it good at all?
>>>
>>> On Sun, May 1, 2016 at 8:52 PM, Wolfgang Meier <wol...@ex...>
>>> wrote:
>>>
>>>> Do anyone use use https://gitter.im/?
>>>>
>>>>
>>>> We tried gitter.im as well as slack before deciding to use hip chat
>>>> for eXistdb and eXistSolutions. I can’t remember which factors finally made
>>>> us to decide for hipchat, but we now use it for all of our team
>>>> coordination and customer chats. So while I’m not against moving to gitter
>>>> in principle, it would cause some overhead.
>>>>
>>>
>
> --
> Dmitriy Shabanov
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

Re: [Exist-development] Chat room

[Dmitriy S. <sha...@gm...>]

There is setting for it

[image: Inline image 1]

Well, no worries if everyone is happy.

On Wed, May 4, 2016 at 4:31 PM, Adam Retter <ad...@ex...> wrote:

> I find that if you are just visiting a gitter room for a one off thing,
> then you receive emails about that room for ever more
> On 4 May 2016 8:24 am, "Dannes Wessels" <da...@ex...> wrote:
>
>> I found the gitter guys very pushy and almost spammy in their approach;
>> that made me turn away from that company....
>>
>> is it good at all?
>>
>> On Sun, May 1, 2016 at 8:52 PM, Wolfgang Meier <wol...@ex...>
>> wrote:
>>
>>> Do anyone use use https://gitter.im/?
>>>
>>>
>>> We tried gitter.im as well as slack before deciding to use hip chat for
>>> eXistdb and eXistSolutions. I can’t remember which factors finally made us
>>> to decide for hipchat, but we now use it for all of our team coordination
>>> and customer chats. So while I’m not against moving to gitter in principle,
>>> it would cause some overhead.
>>>
>>

-- 
Dmitriy Shabanov

Re: [Exist-development] Chat room

[Joe W. <jo...@gm...>]

> Yeap, main reason for me is that it keep chat history. I do not know what do
> you mean by "spammy". Right now it possible to set "notification level".

I just used HipChat to search the chat history; it did a good job.
There's some ability to set notifications; see
https://confluence.atlassian.com/hipchat/get-and-set-notifications-744328124.html.
I find that in order to properly receive notifications on a device I
have to quit the app on all of my other devices.

Joe

Re: [Exist-development] Chat room

[Adam R. <ad...@ex...>]

I find that if you are just visiting a gitter room for a one off thing,
then you receive emails about that room for ever more
On 4 May 2016 8:24 am, "Dannes Wessels" <da...@ex...> wrote:

> I found the gitter guys very pushy and almost spammy in their approach;
> that made me turn away from that company....
>
> is it good at all?
>
> On Sun, May 1, 2016 at 8:52 PM, Wolfgang Meier <wol...@ex...>
> wrote:
>
>> Do anyone use use https://gitter.im/?
>>
>>
>> We tried gitter.im as well as slack before deciding to use hip chat for
>> eXistdb and eXistSolutions. I can’t remember which factors finally made us
>> to decide for hipchat, but we now use it for all of our team coordination
>> and customer chats. So while I’m not against moving to gitter in principle,
>> it would cause some overhead.
>>
>> Wolfgang
>>
>>
>> ------------------------------------------------------------------------------
>> Find and fix application performance issues faster with Applications
>> Manager
>> Applications Manager provides deep performance insights into multiple
>> tiers of
>> your business applications. It resolves application problems quickly and
>> reduces your MTTR. Get your free trial!
>> https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
>> _______________________________________________
>> Exist-development mailing list
>> Exi...@li...
>> https://lists.sourceforge.net/lists/listinfo/exist-development
>>
>>
>
>
> --
> eXist-db Native XML Database - http://exist-db.org
> Join us on linked-in: http://www.linkedin.com/groups?gid=35624
>
>
> ------------------------------------------------------------------------------
> Find and fix application performance issues faster with Applications
> Manager
> Applications Manager provides deep performance insights into multiple
> tiers of
> your business applications. It resolves application problems quickly and
> reduces your MTTR. Get your free trial!
> https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>
>

Re: [Exist-development] Chat room

[Dannes W. <da...@ex...>]

very aggressive marketing,  filing automatically PRs for 1000's of
projects, only reason is to push their (paid) product.......

https://github.com/eXist-db/exist/pull/507

+1 for hipchat :-)

On Wed, May 4, 2016 at 2:52 PM, Dmitriy Shabanov <sha...@gm...>
wrote:

> On Wed, May 4, 2016 at 3:24 PM, Dannes Wessels <da...@ex...>
> wrote:
>
>> I found the gitter guys very pushy and almost spammy in their approach;
>> that made me turn away from that company....
>>
>> is it good at all?
>>
>
> Yeap, main reason for me is that it keep chat history. I do not know what
> do you mean by "spammy". Right now it possible to set "notification level".
>
> --
> Dmitriy Shabanov
>



-- 
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

Re: [Exist-development] Chat room

[Dmitriy S. <sha...@gm...>]

On Wed, May 4, 2016 at 3:24 PM, Dannes Wessels <da...@ex...> wrote:

> I found the gitter guys very pushy and almost spammy in their approach;
> that made me turn away from that company....
>
> is it good at all?
>

Yeap, main reason for me is that it keep chat history. I do not know what
do you mean by "spammy". Right now it possible to set "notification level".

-- 
Dmitriy Shabanov

Re: [Exist-development] Chat room

[Dannes W. <da...@ex...>]

I found the gitter guys very pushy and almost spammy in their approach;
that made me turn away from that company....

is it good at all?

On Sun, May 1, 2016 at 8:52 PM, Wolfgang Meier <wol...@ex...>
wrote:

> Do anyone use use https://gitter.im/?
>
>
> We tried gitter.im as well as slack before deciding to use hip chat for
> eXistdb and eXistSolutions. I can’t remember which factors finally made us
> to decide for hipchat, but we now use it for all of our team coordination
> and customer chats. So while I’m not against moving to gitter in principle,
> it would cause some overhead.
>
> Wolfgang
>
>
> ------------------------------------------------------------------------------
> Find and fix application performance issues faster with Applications
> Manager
> Applications Manager provides deep performance insights into multiple
> tiers of
> your business applications. It resolves application problems quickly and
> reduces your MTTR. Get your free trial!
> https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>
>


-- 
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

Re: [Exist-development] [Exist-open] Backup Error

[Wolfgang M. <wol...@ex...>]

> This would mean the db is corrupted. You best restore from backup into a clean data directory.

Concrete it means the root element for that document could not be loaded, even though the document has an entry in the collection tree. This may not be severe since it seems to reside in /db/system/scheduler. Unfortunately there’s currently no function to retrieve the document’s name from the ID.

Wolfgang

Re: [Exist-development] [Exist-open] Backup Error

[W.S. H. <ws...@gm...>]

This would mean the db is corrupted. You best restore from backup into a
clean data directory.

2016-05-04 8:30 GMT+02:00 Masoud Vakili <ma...@gm...>:

> no idea?
>
> On Tue, May 3, 2016 at 4:36 PM, Masoud Vakili <ma...@gm...> wrote:
>
>> Hi all,
>> I have a schedule for every day backup. I'm found the following error at
>> the end of log file, recently :
>> COLLECTION: /db/system/scheduler
>>   DOCUMENT: 1000 of 10087
>>   DOCUMENT: 2000 of 10087
>>   DOCUMENT: 3000 of 10087
>>   DOCUMENT: 4000 of 10087
>>   DOCUMENT: 5000 of 10087
>>   DOCUMENT: 6000 of 10087
>>   DOCUMENT: 7000 of 10087
>>   DOCUMENT: 8000 of 10087
>>   DOCUMENT: 9000 of 10087
>>   DOCUMENT: 10000 of 10087
>>   DOCUMENT: 10087 of 10087
>> ----------------------------------------------
>> RESOURCE_ACCESS_FAILED:
>> Failed to access document data
>> Document ID: 4357
>>
>> How can I found the mentioned document and resolve it?!
>>
>> thanks
>>
>
>
>
> ------------------------------------------------------------------------------
> Find and fix application performance issues faster with Applications
> Manager
> Applications Manager provides deep performance insights into multiple
> tiers of
> your business applications. It resolves application problems quickly and
> reduces your MTTR. Get your free trial!
> https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>
>


-- 

W.S. Hager
Lagua Web Solutions
http://lagua.nl

Re: [Exist-development] Backup Error

[Masoud V. <ma...@gm...>]

no idea?

On Tue, May 3, 2016 at 4:36 PM, Masoud Vakili <ma...@gm...> wrote:

> Hi all,
> I have a schedule for every day backup. I'm found the following error at
> the end of log file, recently :
> COLLECTION: /db/system/scheduler
>   DOCUMENT: 1000 of 10087
>   DOCUMENT: 2000 of 10087
>   DOCUMENT: 3000 of 10087
>   DOCUMENT: 4000 of 10087
>   DOCUMENT: 5000 of 10087
>   DOCUMENT: 6000 of 10087
>   DOCUMENT: 7000 of 10087
>   DOCUMENT: 8000 of 10087
>   DOCUMENT: 9000 of 10087
>   DOCUMENT: 10000 of 10087
>   DOCUMENT: 10087 of 10087
> ----------------------------------------------
> RESOURCE_ACCESS_FAILED:
> Failed to access document data
> Document ID: 4357
>
> How can I found the mentioned document and resolve it?!
>
> thanks
>

[Exist-development] Backup Error

[Masoud V. <ma...@gm...>]

Hi all,
I have a schedule for every day backup. I'm found the following error at
the end of log file, recently :
COLLECTION: /db/system/scheduler
  DOCUMENT: 1000 of 10087
  DOCUMENT: 2000 of 10087
  DOCUMENT: 3000 of 10087
  DOCUMENT: 4000 of 10087
  DOCUMENT: 5000 of 10087
  DOCUMENT: 6000 of 10087
  DOCUMENT: 7000 of 10087
  DOCUMENT: 8000 of 10087
  DOCUMENT: 9000 of 10087
  DOCUMENT: 10000 of 10087
  DOCUMENT: 10087 of 10087
----------------------------------------------
RESOURCE_ACCESS_FAILED:
Failed to access document data
Document ID: 4357

How can I found the mentioned document and resolve it?!

thanks

Re: [Exist-development] Chat room

[Wolfgang M. <wol...@ex...>]

> Do anyone use use https://gitter.im/? <https://gitter.im/?>
We tried gitter.im as well as slack before deciding to use hip chat for eXistdb and eXistSolutions. I can’t remember which factors finally made us to decide for hipchat, but we now use it for all of our team coordination and customer chats. So while I’m not against moving to gitter in principle, it would cause some overhead.

Wolfgang

[Exist-development] Chat room

[Dmitriy S. <sha...@gm...>]

Hi,

Do anyone use use https://gitter.im/?

I like it because it keeps history (for guests too). It also have good
integration on OS level. Maybe it's good idea to switch there from
hipchat.com?

-- 
Dmitriy Shabanov