You can subscribe to this list here.
2009 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(22) |
Nov
(85) |
Dec
(20) |
---|---|---|---|---|---|---|---|---|---|---|---|---|
2010 |
Jan
(47) |
Feb
(127) |
Mar
(268) |
Apr
(78) |
May
(47) |
Jun
(38) |
Jul
(131) |
Aug
(221) |
Sep
(187) |
Oct
(54) |
Nov
(111) |
Dec
(84) |
2011 |
Jan
(152) |
Feb
(106) |
Mar
(94) |
Apr
(90) |
May
(53) |
Jun
(20) |
Jul
(24) |
Aug
(37) |
Sep
(32) |
Oct
(70) |
Nov
(22) |
Dec
(15) |
2012 |
Jan
(33) |
Feb
(110) |
Mar
(24) |
Apr
(1) |
May
(11) |
Jun
(8) |
Jul
(12) |
Aug
(37) |
Sep
(39) |
Oct
(81) |
Nov
(38) |
Dec
(50) |
2013 |
Jan
(23) |
Feb
(53) |
Mar
(23) |
Apr
(5) |
May
(19) |
Jun
(16) |
Jul
(16) |
Aug
(9) |
Sep
(21) |
Oct
(1) |
Nov
(2) |
Dec
(8) |
2014 |
Jan
(16) |
Feb
(6) |
Mar
(27) |
Apr
(1) |
May
(10) |
Jun
(1) |
Jul
(4) |
Aug
(10) |
Sep
(19) |
Oct
(22) |
Nov
(4) |
Dec
(6) |
2015 |
Jan
(3) |
Feb
(6) |
Mar
(9) |
Apr
|
May
(11) |
Jun
(23) |
Jul
(14) |
Aug
(10) |
Sep
(10) |
Oct
(9) |
Nov
(18) |
Dec
(4) |
2016 |
Jan
(5) |
Feb
(5) |
Mar
|
Apr
(2) |
May
(15) |
Jun
(2) |
Jul
(8) |
Aug
(2) |
Sep
(6) |
Oct
|
Nov
|
Dec
|
2017 |
Jan
(2) |
Feb
(12) |
Mar
(22) |
Apr
(6) |
May
|
Jun
|
Jul
(1) |
Aug
(1) |
Sep
(5) |
Oct
(2) |
Nov
|
Dec
|
2018 |
Jan
(2) |
Feb
|
Mar
|
Apr
|
May
|
Jun
(5) |
Jul
(3) |
Aug
|
Sep
(7) |
Oct
(19) |
Nov
|
Dec
|
2021 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(1) |
Nov
|
Dec
|
2022 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(3) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
From: Stefan M. <ste...@un...> - 2010-10-05 13:50:15
|
Hi peter, dannes, (moved this to exist-dev) On 05/10/10 12:48, Hungerburg wrote: > When I PUT a file onto the server through the webdav servlet, then the > mime-type is different than eg. with the rest servlet or the rpc-client. > I noticed something similar for application/xquery. I have to admit that the WebDAV now behaves so smoothly now that I am really using it! Thanks for that. But, whenever I put some xq or xql it ends up being application/octet-stream in the database. What I found interesting was that it appeared to be logged as the correct mime-type. I tracked it that far that in org.exist.webdav.ExistCollection the contentType that is passed never gets replaced with the value of mime.getName() if that is available. But mime.getName() is used for logging. I tried below 1 loc patch, which works for me, but I would be happy if someone could confirm if this is right or not: Index: ExistCollection.java =================================================================== --- ExistCollection.java (revision 12870) +++ ExistCollection.java (working copy) @@ -360,6 +360,9 @@ if (mime == null) { mime = MimeType.BINARY_TYPE; } + else { + contentType = mime.getName(); + } if (mime.isXMLType()) { Kind regards, Stefan -- | Stefan Majewski | Department of English, University of Vienna | | VOICE Corpus | Spitalgasse 2-4, Universitätscampus AAKH, Hof 8 | | | A-1090 Vienna | | Research Ass.(IT)| Phone: +43 1 4277 424 46 | |
From: Hungerburg <pc...@my...> - 2010-10-02 15:44:10
|
Am 2010-09-30 22:46, schrieb Dannes Wessels: > All, > > A few minutes ago I committed a fix on the renewed webdav application. > Hello Dannes, very good work! I experienced intermittent timeouts for certain webdav operations. Please share my laughter: the problem turned out to be jetty 7.1.5 jars that were still in the eXist-home/tools/jetty/lib/ directory. once I removed those, everything started acting smooth! Even sharing a davfs2 mounted eXist from samba to windows works fast and reliable. Possibly the old davfs2 1.2 needs the option "use_expect100 0". Thank you very much. -- peter |
From: Wolfgang M. <wol...@ex...> - 2010-10-01 15:32:12
|
> Now I was just wondering if that plan from Wolfgang to automatically create some kind of equal-in-size subcollections to optimize performance has been implemented. Or is it still the DB managers responsibility to make these kinds of trade-offs between fast queries and fast deletion. There's ongoing work to decouple collections and resources in all indexes. In SVN trunk, this has been done for the main structural index, so there should be an improvement in update times. The range index will be next. Once we're done with this, the problem should be solved. Wolfgang |
From: Anton K. <ak...@de...> - 2010-10-01 12:08:53
|
Hi Dannes, On 30.09.2010 23:46, Dannes Wessels wrote: > All, > > A few minutes ago I committed a fix on the renewed webdav application. Two items to mention: > All operations from davfs2 performs without problems. (Even with rolled back "implements LockNullResource") Congratulations! Anton |
From: Dannes W. <da...@ex...> - 2010-09-30 20:46:46
|
All, A few minutes ago I committed a fix on the renewed webdav application. Two items to mention: Fixed: Spaces in names of collections and resources were %-encoded after storing in database. Attention: MiltonCollection implements LockNullResource now, with this LOCKing should work better. However I am not sure of this works yet, there was no code change required, so I am a bit suscpicious... Kind regards Dannes -- eXist-db Native XML Database - http://exist-db.org Join us on linked-in: http://www.linkedin.com/groups?gid=35624 |
From: Dannes W. <da...@ex...> - 2010-09-30 20:43:30
|
On 25 Sep 2010, at 18:01 , Anton Kolev wrote: > (1): Names with intervals becomes ...%20... > (2): Lock exception > (3): Wrong Content-Length: x*4k, Old implementation works because of using Transfer-Encoding: chunked, without Content-Length all of these items should be solved now. Kind regards Dannes -- eXist-db Native XML Database - http://exist-db.org Join us on linked-in: http://www.linkedin.com/groups?gid=35624 |
From: Robby P. <rob...@ci...> - 2010-09-30 17:55:23
|
Ok... by browsing the mailarchives I understand that querying will be very fast on large collections but a delete operation is costly due to maintaining the indexes. Now I was just wondering if that plan from Wolfgang to automatically create some kind of equal-in-size subcollections to optimize performance has been implemented. Or is it still the DB managers responsibility to make these kinds of trade-offs between fast queries and fast deletion. Kind regards, Robby Pelssers -----Oorspronkelijk bericht----- Van: Robby Pelssers [mailto:rob...@ci...] Verzonden: do 30-9-2010 18:03 Aan: exi...@li... Onderwerp: [Exist-development] delete operations extremely slow for largecollection Hi all, Is it normal behaviour that a REST delete for 1 xml document in a collection from ~17.000 documents takes several minutes? Below my stacktrace... As you can see it takes about 2 minutes and 17 seconds before i get back a response. Might this be related to misconfiguration? Is this due to the size of the collection? And are there ways to improve performance because this is unacceptable for my needs. Kind regards, Robby Pelssers ---------------------------------------------------- 30 Sep 2010 17:53:29,616 [P1-8] DEBUG (RESTServer.java [doDelete]:1012) - removing document /db/released/ChemicalContent/NZX20A.xml 30 Sep 2010 17:53:29,632 [P1-8] DEBUG (RESTServer.java [doDelete]:1012) - removing document /db/released/ChemicalContent/NZX20A.xml 30 Sep 2010 17:53:29,632 [P1-8] INFO (NativeBroker.java [removeXMLResource]:2222) - Removing document NZX20A.xml (18488) ... 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeTextEngine.java [dropIndex]:1072) - Removing 0 tokens 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeTextEngine.java [dropIndex]:1072) - Removing 0 tokens 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeTextEngine.java [dropIndex]:1072) - Removing 0 tokens 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeBroker.java [removeXMLResource]:2229) - removeDocument() - removing dom 30 Sep 2010 17:55:43,509 [P1-8] DEBUG (NativeBroker.java [removeResourceMetadata]:2326) - Removing resource metadata for 18488 30 Sep 2010 17:55:47,322 [P1-8] DEBUG (NGramIndex.java [sync]:86) - SYNC NGRAM 30 Sep 2010 17:55:47,322 [P1-8] INFO (NativeBroker.java [sync]:3191) - Memory: 126,912K total; 506,816K max; 68,712K free 30 Sep 2010 17:55:47,322 [P1-8] INFO (BTree.java [printStatistics]:2348) - dom.dbx INDEX Buffers occupation : 100% (1639 out of 1639) Cache efficiency : 98% 30 Sep 2010 17:55:47,338 [P1-8] INFO (DOMFile.java [printStatistics]:1434) - dom.dbx DATA Buffers occupation : 98% (252 out of 256) Cache efficiency : 99% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BTree.java [printStatistics]:2348) - collections.dbx INDEX Buffers occupation : 100% (96 out of 96) Cache efficie ncy : 100% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BFile.java [printStatistics]:427) - collections.dbx DATA Buffers occupation : 99% (194 out of 195) Cache efficien cy : 100% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BTree.java [printStatistics]:2348) - elements.dbx INDEX Buffers occupation : 8% (5 out of 64) Cache efficiency : 100% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BFile.java [printStatistics]:427) - elements.dbx DATA Buffers occupation : 100% (736 out of 737) Cache efficiency : 96% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BTree.java [printStatistics]:2348) - values.dbx INDEX Buffers occupation : 100% (64 out of 64) Cache efficiency : 34% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BFile.java [printStatistics]:427) - values.dbx DATA Buffers occupation : 0% (0 out of 64) Cache efficiency : 94% 30 Sep 2010 17:55:47,338 [P1-8] DEBUG (Journal.java [checkpoint]:318) - Checkpoint reached 30 Sep 2010 17:55:47,338 [P1-8] DEBUG (NotificationService.java [debug]:76) - Registered UpdateListeners: 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] DEBUG (NGramIndex.java [sync]:86) - SYNC NGRAM 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (NativeBroker.java [sync]:3191) - Memory: 126,912K total; 506,816K max; 68,083K free 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - dom.dbx INDEX Buffers occupation : 100% (1639 out of 1639) Cache efficiency : 98% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (DOMFile.java [printStatistics]:1434) - dom.dbx DATA Buffers occupation : 98% (252 out o f 256) Cache efficiency : 99% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - collections.dbx INDEX Buffers occupation : 100% (9 6 out of 96) Cache efficiency : 100% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BFile.java [printStatistics]:427) - collections.dbx DATA Buffers occupation : 99% (194 out of 195) Cache efficiency : 100% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - elements.dbx INDEX Buffers occupation : 8% (5 out of 64) Cache efficiency : 100% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BFile.java [printStatistics]:427) - elements.dbx DATA Buffers occupation : 100% (736 ou t of 737) Cache efficiency : 96% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - values.dbx INDEX Buffers occupation : 100% (64 out of 64) Cache efficiency : 34% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BFile.java [printStatistics]:427) - values.dbx DATA Buffers occupation : 0% (0 out of 6 4) Cache efficiency : 94% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] DEBUG (Journal.java [checkpoint]:318) - Checkpoint reached ------------------------------------------------------------------------------ Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev _______________________________________________ Exist-development mailing list Exi...@li... https://lists.sourceforge.net/lists/listinfo/exist-development |
From: Robby P. <rob...@ci...> - 2010-09-30 16:03:31
|
Hi all, Is it normal behaviour that a REST delete for 1 xml document in a collection from ~17.000 documents takes several minutes? Below my stacktrace... As you can see it takes about 2 minutes and 17 seconds before i get back a response. Might this be related to misconfiguration? Is this due to the size of the collection? And are there ways to improve performance because this is unacceptable for my needs. Kind regards, Robby Pelssers ---------------------------------------------------- 30 Sep 2010 17:53:29,616 [P1-8] DEBUG (RESTServer.java [doDelete]:1012) - removing document /db/released/ChemicalContent/NZX20A.xml 30 Sep 2010 17:53:29,632 [P1-8] DEBUG (RESTServer.java [doDelete]:1012) - removing document /db/released/ChemicalContent/NZX20A.xml 30 Sep 2010 17:53:29,632 [P1-8] INFO (NativeBroker.java [removeXMLResource]:2222) - Removing document NZX20A.xml (18488) ... 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeTextEngine.java [dropIndex]:1072) - Removing 0 tokens 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeTextEngine.java [dropIndex]:1072) - Removing 0 tokens 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeTextEngine.java [dropIndex]:1072) - Removing 0 tokens 30 Sep 2010 17:55:43,447 [P1-8] DEBUG (NativeBroker.java [removeXMLResource]:2229) - removeDocument() - removing dom 30 Sep 2010 17:55:43,509 [P1-8] DEBUG (NativeBroker.java [removeResourceMetadata]:2326) - Removing resource metadata for 18488 30 Sep 2010 17:55:47,322 [P1-8] DEBUG (NGramIndex.java [sync]:86) - SYNC NGRAM 30 Sep 2010 17:55:47,322 [P1-8] INFO (NativeBroker.java [sync]:3191) - Memory: 126,912K total; 506,816K max; 68,712K free 30 Sep 2010 17:55:47,322 [P1-8] INFO (BTree.java [printStatistics]:2348) - dom.dbx INDEX Buffers occupation : 100% (1639 out of 1639) Cache efficiency : 98% 30 Sep 2010 17:55:47,338 [P1-8] INFO (DOMFile.java [printStatistics]:1434) - dom.dbx DATA Buffers occupation : 98% (252 out of 256) Cache efficiency : 99% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BTree.java [printStatistics]:2348) - collections.dbx INDEX Buffers occupation : 100% (96 out of 96) Cache efficie ncy : 100% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BFile.java [printStatistics]:427) - collections.dbx DATA Buffers occupation : 99% (194 out of 195) Cache efficien cy : 100% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BTree.java [printStatistics]:2348) - elements.dbx INDEX Buffers occupation : 8% (5 out of 64) Cache efficiency : 100% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BFile.java [printStatistics]:427) - elements.dbx DATA Buffers occupation : 100% (736 out of 737) Cache efficiency : 96% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BTree.java [printStatistics]:2348) - values.dbx INDEX Buffers occupation : 100% (64 out of 64) Cache efficiency : 34% 30 Sep 2010 17:55:47,338 [P1-8] INFO (BFile.java [printStatistics]:427) - values.dbx DATA Buffers occupation : 0% (0 out of 64) Cache efficiency : 94% 30 Sep 2010 17:55:47,338 [P1-8] DEBUG (Journal.java [checkpoint]:318) - Checkpoint reached 30 Sep 2010 17:55:47,338 [P1-8] DEBUG (NotificationService.java [debug]:76) - Registered UpdateListeners: 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] DEBUG (NGramIndex.java [sync]:86) - SYNC NGRAM 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (NativeBroker.java [sync]:3191) - Memory: 126,912K total; 506,816K max; 68,083K free 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - dom.dbx INDEX Buffers occupation : 100% (1639 out of 1639) Cache efficiency : 98% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (DOMFile.java [printStatistics]:1434) - dom.dbx DATA Buffers occupation : 98% (252 out o f 256) Cache efficiency : 99% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - collections.dbx INDEX Buffers occupation : 100% (9 6 out of 96) Cache efficiency : 100% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BFile.java [printStatistics]:427) - collections.dbx DATA Buffers occupation : 99% (194 out of 195) Cache efficiency : 100% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - elements.dbx INDEX Buffers occupation : 8% (5 out of 64) Cache efficiency : 100% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BFile.java [printStatistics]:427) - elements.dbx DATA Buffers occupation : 100% (736 ou t of 737) Cache efficiency : 96% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BTree.java [printStatistics]:2348) - values.dbx INDEX Buffers occupation : 100% (64 out of 64) Cache efficiency : 34% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] INFO (BFile.java [printStatistics]:427) - values.dbx DATA Buffers occupation : 0% (0 out of 6 4) Cache efficiency : 94% 30 Sep 2010 17:55:47,588 [exist_QuartzScheduler_Worker-3] DEBUG (Journal.java [checkpoint]:318) - Checkpoint reached |
From: Peter C. <pet...@me...> - 2010-09-30 13:24:49
|
Can I point readers towards Microsoft's security model for NTFS and Active Directory (which is in turn based on VAX/VMS)? It's simple in concept and extremely flexible. The extended permissions models in modern UNIXes are similar. There are: - Objects that require securing; - Rights that a principal may have over an object (these my be different for each type of object); - One access control list (ACL) for each object, containing a list of tuples of <principal, right, allow/deny>. I think what we're discussing here is what the rights should be, and whether there are any that cannot / should not be taken out of the ACL. From my experience, after writing such a permissions system for a virtual learning system, I'd say that all combinations of things in the ACL should be allowed. Incidentally, the NTFS version of auditing is also extremely flexible and worth a look. Finally, the designers have gone to considerable lengths to ensure that an administrator cannot completely hide that they've taken some underhand action, although they can hide what that action was. - Peter On 28 September 2010 16:04, Dmitriy Shabanov <sha...@gm...> wrote: > > > On Tue, Sep 28, 2010 at 1:47 PM, Adam Retter <ad...@ex...> wrote: > >> On 28 September 2010 09:42, Thomas White <tho...@gm...> wrote: >> > On 27 September 2010 16:12, Adam Retter <ad...@ex...> wrote: >> >> >> >> >>2) Any user can remove themselves from any group they choose - I >> >> >>cannot think of a case where downgrading a users rights prevents a >> >> >>security risk. This is the users right! >> >> > I did mail before, we must agree on terms we going to use. 'owner' is >> >> > quite >> >> > good, but limited. My offer: group's 'manager' >> >> >> >> Owner or manager really makes no difference to me. In English it would >> >> seem to me that 'owner' is the more accurate and succinct term. >> >> >> >> > (can change members list & >> >> > permissions for group, it can be 2 different roles ) & 'member' (use >> >> > group's >> >> > permissions). It simple to see that there can be person that can >> manage, >> >> > but >> >> > have no access for resources. >> >> >> >> >> >> I am not clear on why a group would have 'permissions'? Surely >> >> collections and resources have permissions in terms of owner and >> >> group, but not the group object itself. >> > >> > >> > Adam, I think Dmitriy is proposing a model where there is a clear >> separation >> > between being a member of a group and managing the group itself. I quite >> > like the idea and it takes care of a common case from the practice. >> > >> > Example: An admin who manages the group of CEO users does not need to >> have >> > access to the confidential reports in a collection, available to the >> members >> > of this group. >> >> Dmitriy is that the case? If so you explanation has made this much >> more understandable for me, thanks :-) >> > > Eхplanation is my weakness :-) > > Of course this is what CEO's want, but in my experience the admin can >> always access absolutely anything if he or she wants to ;-) > > > I'm admin, but I don't have time to do all staff after all. So, it's more > of job sharing ... > > >> > When we discuss eXist security matters I think it is high time to start >> > looking at it from a slightly bigger perspective. Imagine a company of >> 1000 >> > employees where to have one admin user that does it all is nor neither >> > possible nor practical . There will be teams of admins dealing with >> variety >> > of jobs across the teams and departments. >> > >> > Thomas >> > >> > >> > >> >> >> >> -- >> >> Adam Retter >> >> >> >> eXist Developer >> >> { United Kingdom } >> >> ad...@ex... >> >> irc://irc.freenode.net/existdb >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> >> Start uncovering the many advantages of virtual appliances >> >> and start using them to simplify application deployment and >> >> accelerate your shift to cloud computing. >> >> http://p.sf.net/sfu/novell-sfdev2dev >> >> _______________________________________________ >> >> Exist-development mailing list >> >> Exi...@li... >> >> https://lists.sourceforge.net/lists/listinfo/exist-development >> > >> > >> >> >> >> -- >> Adam Retter >> >> eXist Developer >> { United Kingdom } >> ad...@ex... >> irc://irc.freenode.net/existdb >> > > > > -- > Dmitriy Shabanov > > > ------------------------------------------------------------------------------ > Start uncovering the many advantages of virtual appliances > and start using them to simplify application deployment and > accelerate your shift to cloud computing. > http://p.sf.net/sfu/novell-sfdev2dev > _______________________________________________ > Exist-development mailing list > Exi...@li... > https://lists.sourceforge.net/lists/listinfo/exist-development > > |
From: James F. <jam...@ex...> - 2010-09-29 07:54:34
|
nice bit of collab debugging on this issue, I am very happy to see integration of milton here and I think it will pay off nice dividends later on. +! J On 29 September 2010 09:44, Stefan Majewski <ste...@un...> wrote: > On request some more details on my configuration, could have included > that in my initial post, I know: > > on ubuntu Karmic I mounted with > > mount -t davfs http://localhost:8080/exist/webdav/db/ test/ > > which results in this mount: > > http://localhost:8080/exist/webdav/db/ on /home/stefan/test.pr type > davfs (rw,nosuid,nodev,_netdev) > > davfs2 version is 1.4.5-1 > > as davfs2 caches and delayes some writes I umounted between some tests > to see if there are some failures. In other cases I just waited some > time until I was positive that the bufferes must (should) have been flushed. > > I tried to put a big xml-only repository there, which apparently works > alright. Therefore, in the mounted directory I did a: > > svn export ~/prog/xmltexts/trunk/xmltexts xmltexts > > a bigger rename operation worked as well: > > for f in *.xml ; do mv -v $f "anon"$f; done > > something more stressful, just to see what happens if we leave XML. > Apparently this works as well: > > find -name "*.xml" -type f -exec shred \{} \; > > cating and editing, updating the xmls (the real, not the shredded), > works as well. > > > Concerning my failed Nautilus tests (which I wouldn't follow any > further. I would suggest that whoever really wants to see webdav in > nautilus working should try to have it fixed it in nautilus, as that > would, I assume, be more efficient than adjusting every server > implementation towards nautilus' needs.) > > Nautilus version: GNOME nautilus 2.30.1 > with gvfs (all related packages, backends etc) version: 1.6.1-0ubuntu1 > > > cheers and thanks, > > Stefan > > > ------------------------------------------------------------------------------ > Start uncovering the many advantages of virtual appliances > and start using them to simplify application deployment and > accelerate your shift to cloud computing. > http://p.sf.net/sfu/novell-sfdev2dev > _______________________________________________ > Exist-development mailing list > Exi...@li... > https://lists.sourceforge.net/lists/listinfo/exist-development > |
From: Stefan M. <ste...@un...> - 2010-09-29 07:44:49
|
On request some more details on my configuration, could have included that in my initial post, I know: on ubuntu Karmic I mounted with mount -t davfs http://localhost:8080/exist/webdav/db/ test/ which results in this mount: http://localhost:8080/exist/webdav/db/ on /home/stefan/test.pr type davfs (rw,nosuid,nodev,_netdev) davfs2 version is 1.4.5-1 as davfs2 caches and delayes some writes I umounted between some tests to see if there are some failures. In other cases I just waited some time until I was positive that the bufferes must (should) have been flushed. I tried to put a big xml-only repository there, which apparently works alright. Therefore, in the mounted directory I did a: svn export ~/prog/xmltexts/trunk/xmltexts xmltexts a bigger rename operation worked as well: for f in *.xml ; do mv -v $f "anon"$f; done something more stressful, just to see what happens if we leave XML. Apparently this works as well: find -name "*.xml" -type f -exec shred \{} \; cating and editing, updating the xmls (the real, not the shredded), works as well. Concerning my failed Nautilus tests (which I wouldn't follow any further. I would suggest that whoever really wants to see webdav in nautilus working should try to have it fixed it in nautilus, as that would, I assume, be more efficient than adjusting every server implementation towards nautilus' needs.) Nautilus version: GNOME nautilus 2.30.1 with gvfs (all related packages, backends etc) version: 1.6.1-0ubuntu1 cheers and thanks, Stefan |
From: Loren C. <lor...@gm...> - 2010-09-28 16:34:30
|
Adam, Here is my original email about a WebDAV client function module. I am going to look into seeing if I can use the Milton library for the WebDAV client function module. Loren On Aug 16, 2010, at 11:30 AM, Loren Cahlander wrote: > Hello folks, > > I am needing to add the HTTP method PROPPATCH to the httpclient function module. That requires adding a WebDAV client jar file. I originally was going to add webdavlib-2.0.jar, but Dannes informed me that it is orphaned. I am looking at adding the jackrabbit-standalone-2.1.1.jar, but am encountering a compilation error. > > In all of these files there appears to be a problem with the org.apache.tools.ant.Task log method: > > src/org/exist/ant/UserTask.java > src/org/exist/ant/AddUserTask.java > src/org/exist/ant/BackupTask.java > src/org/exist/ant/ChmodTask.java > src/org/exist/ant/ChownTask.java > src/org/exist/ant/ListGroupsTask.java > src/org/exist/ant/ListUsersTask.java > src/org/exist/ant/LockResourceTask.java > src/org/exist/ant/RemoveUserTask.java > src/org/exist/ant/RestoreTask.java > src/org/exist/ant/UserPasswordTask.java > src/org/exist/ant/XMLDBCopyTask.java > src/org/exist/ant/XMLDBCreateTask.java > src/org/exist/ant/XMLDBExtractTask.java > src/org/exist/ant/XMLDBListTask.java > src/org/exist/ant/XMLDBMoveTask.java > src/org/exist/ant/XMLDBQueryTask.java > src/org/exist/ant/XMLDBRemoveTask.java > src/org/exist/ant/XMLDBShutdownTask.java > src/org/exist/ant/XMLDBStoreTask.java > src/org/exist/ant/XMLDBXPathTask.java > src/org/exist/ant/XMLDBXQueryTask.java > src/org/exist/ant/XMLDBXUpdateTask.java > > > [javac] symbol : method log(java.lang.String,org.xmldb.api.base.XMLDBException,int) > [javac] location: class org.exist.ant.XMLDBXUpdateTask > [javac] log(msg, e, Project.MSG_ERR); > > > I think that the simplest approach would be to use webdavlib-2.0.jar since we are also using orphaned axis code as well. > > There is also another issue. The commons-httpclient-3.1.jar has been superseded with the HttpComponents project http://hc.apache.org/. > > What should be our plan of attack? > I would like to add the downloading of the webdavlib-2.0.jar in the building of the httpclient extension module so that I can get the PROPPATCH method implemented. > > We can then discuss HttpComponents and Axis2. > > Cheers, > Loren > |
From: Loren C. <lor...@gm...> - 2010-09-28 16:17:59
|
Hello Adam, I am getting back to working on the WebDAV client module. I do like the idea of writing most of this in XQuery. It just makes sense. I do know that I will have to create a Java based function module to communicate with a socket, since the http-client.xqm makes calls to the httpclient Java based function module. I need to make calls to other HTTP methods. I am thinking that the simplest implementation would be: system:socket-comm-xml($uri as xs:anyURI, $port as xs:integer, $body as node()) as node()* Open a socket port for a given URI and then transmit the body and return the results. system:socket-comm-text($uri as xs:anyURI, $port as xs:integer, $body as $xs:string) as node()* Open a socket port for a given URI and then transmit the body and return the results. The socket-comm-xml will allow the creation of XQuery function modules to send any XML that someone might need to a socket on a server and retrieve the XML results back. I can then write the webdav-client.xqm that communicates with the subversion server to send the body of the HTTP PROPPATCH and appropriately interpret the results. What does our community think? Does anyone see any potential problems? If so, then do you have a suggestion on how to mitigate the problem? Loren On Aug 16, 2010, at 02:59 PM, Adam Retter wrote: > Do you need a new module? Could you not build this as a .xqm using the > existing httpclient module? > > On 16 August 2010 20:58, Adam Retter <ad...@ex...> wrote: >> webdavclient would seem appropriate >> >> On 16 August 2010 20:05, Loren Cahlander <lor...@gm...> wrote: >>> Hello Dannes, >>> >>> I will create a new function module in extensions. Should I call it webdav or webdav-client? >>> >>> Loren >>> >>> On Aug 16, 2010, at 01:40 PM, Dannes Wessels wrote: >>> >>>> Hi Loren, >>>> >>>> On 16 Aug 2010, at 19:45 , Loren Cahlander wrote: >>>> >>>>> I could copy the code from the library and implement it myself, but I have a timeframe issue. I can first implement webdav:proppatch() with the jar and then change over to our own code. I just have to get something implemented this week. >>>> >>>> Ok, I was not aware of this constraint. Ok, let's do a phased implementation then. We need to consider, if only proppatch() would be in webdav:, that would not make sense. If we can put more functions (logically) into webdav: then that would have my preference. In the end. >>>> >>>> If we can isolate all webdav-functions into one function library, we can probably come away with adding another 3rd party library..... >>>> >>>> Kind regards >>>> >>>> Dannes >>>> >>>> -- >>>> eXist-db Native XML Database - http://exist-db.org >>>> Join us on linked-in: http://www.linkedin.com/groups?gid=35624 >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>> >>> >>> ------------------------------------------------------------------------------ >>> This SF.net email is sponsored by >>> >>> Make an app they can't live without >>> Enter the BlackBerry Developer Challenge >>> http://p.sf.net/sfu/RIM-dev2dev >>> _______________________________________________ >>> Exist-development mailing list >>> Exi...@li... >>> https://lists.sourceforge.net/lists/listinfo/exist-development >>> >> >> >> >> -- >> Adam Retter >> >> eXist Developer >> { United Kingdom } >> ad...@ex... >> irc://irc.freenode.net/existdb >> > > > > -- > Adam Retter > > eXist Developer > { United Kingdom } > ad...@ex... > irc://irc.freenode.net/existdb |
From: Dmitriy S. <sha...@gm...> - 2010-09-28 15:04:59
|
On Tue, Sep 28, 2010 at 1:47 PM, Adam Retter <ad...@ex...> wrote: > On 28 September 2010 09:42, Thomas White <tho...@gm...> wrote: > > On 27 September 2010 16:12, Adam Retter <ad...@ex...> wrote: > >> > >> >>2) Any user can remove themselves from any group they choose - I > >> >>cannot think of a case where downgrading a users rights prevents a > >> >>security risk. This is the users right! > >> > I did mail before, we must agree on terms we going to use. 'owner' is > >> > quite > >> > good, but limited. My offer: group's 'manager' > >> > >> Owner or manager really makes no difference to me. In English it would > >> seem to me that 'owner' is the more accurate and succinct term. > >> > >> > (can change members list & > >> > permissions for group, it can be 2 different roles ) & 'member' (use > >> > group's > >> > permissions). It simple to see that there can be person that can > manage, > >> > but > >> > have no access for resources. > >> > >> > >> I am not clear on why a group would have 'permissions'? Surely > >> collections and resources have permissions in terms of owner and > >> group, but not the group object itself. > > > > > > Adam, I think Dmitriy is proposing a model where there is a clear > separation > > between being a member of a group and managing the group itself. I quite > > like the idea and it takes care of a common case from the practice. > > > > Example: An admin who manages the group of CEO users does not need to > have > > access to the confidential reports in a collection, available to the > members > > of this group. > > Dmitriy is that the case? If so you explanation has made this much > more understandable for me, thanks :-) > Eхplanation is my weakness :-) Of course this is what CEO's want, but in my experience the admin can > always access absolutely anything if he or she wants to ;-) I'm admin, but I don't have time to do all staff after all. So, it's more of job sharing ... > > When we discuss eXist security matters I think it is high time to start > > looking at it from a slightly bigger perspective. Imagine a company of > 1000 > > employees where to have one admin user that does it all is nor neither > > possible nor practical . There will be teams of admins dealing with > variety > > of jobs across the teams and departments. > > > > Thomas > > > > > > > >> > >> -- > >> Adam Retter > >> > >> eXist Developer > >> { United Kingdom } > >> ad...@ex... > >> irc://irc.freenode.net/existdb > >> > >> > >> > ------------------------------------------------------------------------------ > >> Start uncovering the many advantages of virtual appliances > >> and start using them to simplify application deployment and > >> accelerate your shift to cloud computing. > >> http://p.sf.net/sfu/novell-sfdev2dev > >> _______________________________________________ > >> Exist-development mailing list > >> Exi...@li... > >> https://lists.sourceforge.net/lists/listinfo/exist-development > > > > > > > > -- > Adam Retter > > eXist Developer > { United Kingdom } > ad...@ex... > irc://irc.freenode.net/existdb > -- Dmitriy Shabanov |
From: Dmitriy S. <sha...@gm...> - 2010-09-28 14:54:34
|
On Tue, Sep 28, 2010 at 12:36 AM, Dannes Wessels <da...@ex...>wrote: > Hi, > > On 27 Sep 2010, at 15:43 , Dmitriy Shabanov wrote: > > I did mail before, we must agree on terms we going to use. 'owner' is quite > good, but limited. My offer: group's 'manager' (can change members list & > permissions for group, it can be 2 different roles ) & 'member' (use group's > permissions). It simple to see that there can be person that can manage, but > have no access for resources. > > > by any chance, what happens if a group is removed (having a unique internal > id) and a new group is added? Will the same id be reused internally? > > Current design: unique id to all groups. Example: - add group 'A' (get id 1); - remove group 'A' (move group description file to 'removed' collection, if I remember correct); - add group 'A' (get id 2); -- Dmitriy Shabanov |
From: Hungerburg <pc...@my...> - 2010-09-28 13:55:16
|
Hello Dannes, please excuse, if my silly plea did offend you. I second Stefans assessment of the state of eXist webdav support and linux clients. Thank you again for your efforts. May I report from the compatibility hunt a small problem persisting? It can also be seen in the windows webfolder client; on davfs2 this makes in-place editing very slow, in windows its more academic, I cannot tell about apple mac: A refresh (F5) of the webfolder following a PUT will timeout. The eXist logs last line then reads "DEBUG (PropFindHandler.java...". From looking at the tcp-stream with wireshark, the server response gets sent in a way, that probably both windows and davfs2 clients and also wireshark itself cannot decipher or is in itself incomplete. This with current trunk clean build. linux summa summarum - davfs2 1.4 is OK, except see above. options used: use_locks 0, delay_upload 0 - nautilus/gvfs is broken due to its own limitations, mounting dav:// instead of http:// prevents the not-found error, yet it still seems to be unable to cope without content-length. - davfs2 1.2 is broken too, that caused a false impression with me. -- peter |
From: Stefan M. <ste...@un...> - 2010-09-28 09:46:47
|
Hi Dannes, thanks for your efforts building a working webdav implementation for eXist. As there appears to be some confusion around webdav on linux I did some very limited testing. As for davfs2, I can see no issues there. Synced numerous directories with binary and xml ressources to the server without any problems. I renamed files and modified file contents. I would consider this working. As for Nautilus, this appears to be a rather different thing. When using /exist/db/test for the directory it should mount it claims that it is not a WebDAV enabled share. When using /exist/db/test/ (note the slash) it requires authentication. This shows that it is at least partially working. But as soon as I present the correct credentials it claims that the ressource is not found. I guess (I think as peter previously pointed out) that this is because it tries to look at the parent directory(-y+ies) and gets a 404. The message the gui conveys is "Error: HTTP Error: Not Found". To be honest, I would not put endless effort into getting this working. As Nautilus is having similar issues with other WebDAV servers I would consider this a nautilus problem. I tried the same with apache's WebDAV module with similar results. cheers, Stefan |
From: Adam R. <ad...@ex...> - 2010-09-28 08:47:47
|
On 28 September 2010 09:42, Thomas White <tho...@gm...> wrote: > On 27 September 2010 16:12, Adam Retter <ad...@ex...> wrote: >> >> >>2) Any user can remove themselves from any group they choose - I >> >>cannot think of a case where downgrading a users rights prevents a >> >>security risk. This is the users right! >> > I did mail before, we must agree on terms we going to use. 'owner' is >> > quite >> > good, but limited. My offer: group's 'manager' >> >> Owner or manager really makes no difference to me. In English it would >> seem to me that 'owner' is the more accurate and succinct term. >> >> > (can change members list & >> > permissions for group, it can be 2 different roles ) & 'member' (use >> > group's >> > permissions). It simple to see that there can be person that can manage, >> > but >> > have no access for resources. >> >> >> I am not clear on why a group would have 'permissions'? Surely >> collections and resources have permissions in terms of owner and >> group, but not the group object itself. > > > Adam, I think Dmitriy is proposing a model where there is a clear separation > between being a member of a group and managing the group itself. I quite > like the idea and it takes care of a common case from the practice. > > Example: An admin who manages the group of CEO users does not need to have > access to the confidential reports in a collection, available to the members > of this group. Dmitriy is that the case? If so you explanation has made this much more understandable for me, thanks :-) Of course this is what CEO's want, but in my experience the admin can always access absolutely anything if he or she wants to ;-) > When we discuss eXist security matters I think it is high time to start > looking at it from a slightly bigger perspective. Imagine a company of 1000 > employees where to have one admin user that does it all is nor neither > possible nor practical . There will be teams of admins dealing with variety > of jobs across the teams and departments. > > Thomas > > > >> >> -- >> Adam Retter >> >> eXist Developer >> { United Kingdom } >> ad...@ex... >> irc://irc.freenode.net/existdb >> >> >> ------------------------------------------------------------------------------ >> Start uncovering the many advantages of virtual appliances >> and start using them to simplify application deployment and >> accelerate your shift to cloud computing. >> http://p.sf.net/sfu/novell-sfdev2dev >> _______________________________________________ >> Exist-development mailing list >> Exi...@li... >> https://lists.sourceforge.net/lists/listinfo/exist-development > > -- Adam Retter eXist Developer { United Kingdom } ad...@ex... irc://irc.freenode.net/existdb |
From: Thomas W. <tho...@gm...> - 2010-09-28 08:42:30
|
On 27 September 2010 16:12, Adam Retter <ad...@ex...> wrote: > >>2) Any user can remove themselves from any group they choose - I > >>cannot think of a case where downgrading a users rights prevents a > >>security risk. This is the users right! > > I did mail before, we must agree on terms we going to use. 'owner' is > quite > > good, but limited. My offer: group's 'manager' > > Owner or manager really makes no difference to me. In English it would > seem to me that 'owner' is the more accurate and succinct term. > > > (can change members list & > > permissions for group, it can be 2 different roles ) & 'member' (use > group's > > permissions). It simple to see that there can be person that can manage, > but > > have no access for resources. > > > I am not clear on why a group would have 'permissions'? Surely > collections and resources have permissions in terms of owner and > group, but not the group object itself. Adam, I think Dmitriy is proposing a model where there is a clear separation between being a member of a group and managing the group itself. I quite like the idea and it takes care of a common case from the practice. Example: An admin who manages the group of CEO users does not need to have access to the confidential reports in a collection, available to the members of this group. When we discuss eXist security matters I think it is high time to start looking at it from a slightly bigger perspective. Imagine a company of 1000 employees where to have one admin user that does it all is nor neither possible nor practical . There will be teams of admins dealing with variety of jobs across the teams and departments. Thomas > > -- > Adam Retter > > eXist Developer > { United Kingdom } > ad...@ex... > irc://irc.freenode.net/existdb > > > ------------------------------------------------------------------------------ > Start uncovering the many advantages of virtual appliances > and start using them to simplify application deployment and > accelerate your shift to cloud computing. > http://p.sf.net/sfu/novell-sfdev2dev > _______________________________________________ > Exist-development mailing list > Exi...@li... > https://lists.sourceforge.net/lists/listinfo/exist-development > |
From: Dannes W. <da...@ex...> - 2010-09-28 07:25:15
|
Hi, On Mon, Sep 27, 2010 at 11:58 PM, Hungerburg <pc...@my...> wrote: > now it fails with: Not a WebDAV enabled share. Then I learned that pure > gvfs (the engine behind nautilus webdav?) > actually ignores the 404 on /exist (without /db), ... > with this webdav implementation files cannot be created and xml documents > are empty. Does Nautilus work with the old implementation of the webdav interface? Probably not, if the client is that sensitive to unexpected server responses. > its a mess. Please keep going. > Que????????? I'll continue to try to get things working under Linux, but things regarding WebDAV just seem to be not that mature in Linux it. That is a pity. This is an interesting page to read: http://milton.ettrema.com/compat/index.html ; it shows some basic requirements that need to be fulfilled to have WebDAV working for all platforms. Brad did some good research on this. A few items I can change, sure. D. -- eXist-db Native XML Database - http://exist-db.org Join us on linked-in: http://www.linkedin.com/groups?gid=35624 |
From: Hungerburg <pc...@my...> - 2010-09-27 21:58:17
|
Am 2010-09-27 14:29, schrieb Hungerburg: > So, clients are allowed to test, if the parent is a webdav resource. > Maybe they are wrong to interpret a 404 on the parent to imply that the > full url isnt valid too. BUT maybe if the GET or OPTIONS returned 204 > instead of 404 in that case, they would just start to work? Would you > give it a try? I made a proxy to test my own case: $ mknod response p $ nc -4 -l localhost 8081 0<response | tee client.log | nc -4 server 8080 | sed -u -e 's:HTTP/1.1 404 Not Found:HTTP/1.1 204 No Content:' | tee server.log 1>response $ mount -t davfs http://localhost:8081/exist/webdav/db/ SOME_DIR now it fails with: Not a WebDAV enabled share. Then I learned that pure gvfs (the engine behind nautilus webdav?) actually ignores the 404 on /exist (without /db), and can also be configured to display rich debugging output: $ GVFS_HTTP_DEBUG=all /usr/lib/gvfs/gvfsd -r $ gvfs-mount dav://server:8080/exist/webdav/db $ ls ~/.gvfs/WebDAV on server/ with this webdav implementation files cannot be created and xml documents are empty. its a mess. Please keep going. -- peter |
From: Dannes W. <da...@ex...> - 2010-09-27 19:36:56
|
Hi, On 27 Sep 2010, at 15:43 , Dmitriy Shabanov wrote: > I did mail before, we must agree on terms we going to use. 'owner' is quite good, but limited. My offer: group's 'manager' (can change members list & permissions for group, it can be 2 different roles ) & 'member' (use group's permissions). It simple to see that there can be person that can manage, but have no access for resources. by any chance, what happens if a group is removed (having a unique internal id) and a new group is added? Will the same id be reused internally? Kind regards Dannes -- eXist-db Native XML Database - http://exist-db.org Join us on linked-in: http://www.linkedin.com/groups?gid=35624 |
From: José M. F. G. <jm...@us...> - 2010-09-27 17:55:51
|
Maybe this can be interesting for you, because it describes UNIX group management when a UNIX group has an administrator. http://linux.about.com/library/cmd/blcmdl1_gpasswd.htm On 27/09/10 19:33, Dannes Wessels wrote: > I guess in the unix model, it is impossible for a normal user to assign other groups to a resource. > > On 27 Sep 2010, at 18:22 , Adam Retter wrote: > >>> Probably we want to have a look at the unix permissions model..... >> >> Why? I am still not clear on why a group would have permissions itself? > > Kind regards > > Dannes > > -- > eXist-db Native XML Database - http://exist-db.org > Join us on linked-in: http://www.linkedin.com/groups?gid=35624 > > > > > > > > > > > ------------------------------------------------------------------------------ > Start uncovering the many advantages of virtual appliances > and start using them to simplify application deployment and > accelerate your shift to cloud computing. > http://p.sf.net/sfu/novell-sfdev2dev > > > > _______________________________________________ > Exist-development mailing list > Exi...@li... > https://lists.sourceforge.net/lists/listinfo/exist-development -- "La violencia es el último recurso del incompetente" - Salvor Hardin en "La Fundación" de Isaac Asimov "Premature optimization is the root of all evil." - Donald Knuth José María Fernández González e-mail: jos...@gm... |
From: Dannes W. <da...@ex...> - 2010-09-27 17:33:59
|
I guess in the unix model, it is impossible for a normal user to assign other groups to a resource. On 27 Sep 2010, at 18:22 , Adam Retter wrote: >> Probably we want to have a look at the unix permissions model..... > > Why? I am still not clear on why a group would have permissions itself? Kind regards Dannes -- eXist-db Native XML Database - http://exist-db.org Join us on linked-in: http://www.linkedin.com/groups?gid=35624 |
From: Adam R. <ad...@ex...> - 2010-09-27 16:41:24
|
> I did try to contact you today, but ... So, tomorrow 20:00 my time? Cant do that as its the W3C XQuery/XSL WG teleconf, which I think your involved in as well arent you? I can do anytime in the day before that though... -- Adam Retter eXist Developer { United Kingdom } ad...@ex... irc://irc.freenode.net/existdb |