exist-development — eXist Developer's List

Re: [Exist-development] looks like

[Dmitriy S. <sha...@gm...>]

Details?

On Thu, Sep 23, 2010 at 3:56 PM, James Fuller <jam...@ex...>wrote:

> latest trunk makes expath packaging broken ...
>
> J
>
>
> ------------------------------------------------------------------------------
> Start uncovering the many advantages of virtual appliances
> and start using them to simplify application deployment and
> accelerate your shift to cloud computing.
> http://p.sf.net/sfu/novell-sfdev2dev
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>



-- 
Dmitriy Shabanov

Re: [Exist-development] [Exist-commits] security refactoring

[Dmitriy S. <sha...@gm...>]

On Thu, Sep 23, 2010 at 9:57 PM, Andrzej Jan Taramina
<an...@ch...>wrote:

>
> > You can open&save users.xml, that will trigger the convertor.
>
> Wouldn't it be useful for the convertor to detect if you a running an old
> db that hasn't yet been converted and have it
> automatically do the conversion at startup?


I didn't have clear understanding how to do it. For now, the only idea is to
check existing of collection, should be ok ... but I don't want to delete
file, so it going to stay.


> > Same time,
> > I don't think that trunk ready for production site, some more tests
> > require first.
>
> Are we there yet? ;-)


It should be stable. The digest authentication is last todo to reach "before
refactoring features". That will be ready in parallel with ssl certificate
authentication, because this two mechanisms are equal and I want to be sure
API support all possible authentication methods.

-- 
Dmitriy Shabanov

Re: [Exist-development] [Exist-commits] security refactoring

[Andrzej J. T. <an...@ch...>]

> You can open&save users.xml, that will trigger the convertor. 

Wouldn't it be useful for the convertor to detect if you a running an old db that hasn't yet been converted and have it
automatically do the conversion at startup?

> Same time,
> I don't think that trunk ready for production site, some more tests
> require first.

Are we there yet? ;-)


-- 
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

[Exist-development] looks like

[James F. <jam...@ex...>]

latest trunk makes expath packaging broken ...

J

Re: [Exist-development] [Exist-open] The Trigger Promise

[Dan M. <dan...@gm...>]

Peter,

Nice work on the Wikibook article!  You are a very good writer.  Is English
your native language?

I also think this would be VERY useful for doing things like adding
MS-documents and PDF documents to a collection or subcollection.
Unfortunately I am not qualified to debug the lower-level Java code but I am
happy to help out in testing.

- Dan

On Wed, Sep 22, 2010 at 8:27 AM, Hungerburg <pc...@my...> wrote:

> I have been trying to get triggers working in eXist. As promised, I
> documented my findings in the xquery wiki. There is moderate success,
> the wiki entry shows working code.
>
> http://en.wikibooks.org/wiki/XQuery/Using_Triggers_to_assign_identifiers
>
> But, as Dan already said, eXist xquery triggers cannot be relied on. I
> found, that triggers may cause the thread they run in to hang, with
> further changes to the affected resource going through without
> triggering the script anymore. That makes them not suitable for critical
> operations in a database.
>
> Also, the xquery syntax useable in triggers seems to me reduced to the
> prolog, a severe limitation. As I am only a newbee, maybe I missed
> something. From the looks of it, the script must not return (anything).
>
> The Trigger Promise:
>
> I would like eXist to act like a filesystem: windows explorer, mac
> finder, fuse-dav or any other webdav client being the frontend. That
> rules out Dan's suggestion of passing uploads through an xquery. For the
> use case of mine, where there is lots of mostly binary documents and
> only little structure (one xml that glues stuff together), I consider
> drag and drop superior to filling forms.
>
> In a way, I would like the eXist framework to act as the controller.
> Offering many great advantages over, say Samba: eg. schema validation,
> lucene search or processing pipelines to name some. Am I unreasonable?
>
> Thank you, as always!
>
> --
> peter
>
>
> ------------------------------------------------------------------------------
> Start uncovering the many advantages of virtual appliances
> and start using them to simplify application deployment and
> accelerate your shift to cloud computing.
> http://p.sf.net/sfu/novell-sfdev2dev
> _______________________________________________
> Exist-open mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-open
>



-- 
Dan McCreary
Semantic Solutions Architect
office: (952) 931-9198
cell: (612) 986-1552

[Exist-development] Test issues in trunk

[Dannes W. <da...@ex...>]

All,

since a week or so, the test suite report shows 14-to-15 issues, these were introduced quite recently (build 1271):

http://serengeti.friprogramvarusyndikatet.se:8111/viewType.html?buildTypeId=bt2&page=2&tab=buildTypeHistoryList

please can this be fixed? Why is this committed and not repaired immediately?
 
Kind regards

Dannes

--
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

[Exist-development] ANN: upgrade of webdav interface in Trunk

[Dannes W. <da...@ex...>]

(from the SVN commit message)

[upgrade] Upgrade of WebDAV interface with "Milton Webdav Server
Library" (http://milton.ettrema.com/index.html). In all, testing shows
that the new implementation is more reliable than the original
implementation.

!!!!!!!
This is a 'early commit-early feedback' commit: please provide me
feedback (via developer mailinglist) of your experiences. Note that I
consider the change 'stable'
!!!!!!!

The following client implementations are confirmed to work:

Windows
-- XP: Webfolders
-- 7:  Functional for non SSL connections, registry setting is
required (will be documented)
-- AnyClient
MacOsX
-- Finder
-- Transmit
Misc
-- OxygenXML

Notes:
- HTTPS is now enabled by default.
- The original interface can be restored by editing the
controller-config.xml file:
 <forward pattern="/webdav/" servlet="WebDAVServlet"/>

Known issues:
- quite a lot of logging, that needs to be muted
- macosx-finder has a problem to create a collection with a space in the name
- Windows7 requires registry changes (not an issue for exist-db)
- missing tests and update of documentation


--
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

Re: [Exist-development] atomic wiki down?

[Leif-Jöran O. <lj...@ex...>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Den 2010-09-22 15:29, Joe Wicentowski skrev:
> This page works: http://atomic.exist-db.org/HowTo/XSLT2/XSLT2
> 
> But most of the links in the left sidebar don't.


Yes, sorry, we have a db corruption. :( So a restore from backup will
resolve it.

Leif-Jöran
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/

iD8DBQFMmgejhcIn5aVXOPIRApT/AKCL8eJ52WdFsYv1rJIJ4n0LhPGqYACgo1Nm
yhRKBGB+nyKe1B/Ydl80I4I=
=Sduu
-----END PGP SIGNATURE-----

Re: [Exist-development] atomic wiki down?

[Joe W. <jo...@gm...>]

This page works: http://atomic.exist-db.org/HowTo/XSLT2/XSLT2

But most of the links in the left sidebar don't.

On Tue, Sep 21, 2010 at 10:31 PM, Joe Wicentowski <jo...@gm...> wrote:
> http://atomic.exist-db.org/blogs/eXist
>
> =>
>
> HTTP ERROR: 500
>
> An error occurred while executing the urlrewrite query: error found
> while loading module atom: IO exception while loading module
> 'http://www.w3.org/2005/Atom' from
> 'file:/home/existdb/atomic.exist-db.org/AtomicWiki/xquery/src/org/exist/atomic/atom.xql'
> RequestURI=/blogs/
>
> Powered by Jetty://
>

Re: [Exist-development] eXist-db with Calabash and Saxon again

[Adam R. <ad...@ex...>]

Sorry Michael, I am a little snowed under - I would hope by the end of
this week. Thanks for the patch it is much appreciated...

On 22 September 2010 10:44, Michael Kay <mi...@sa...> wrote:
>  Any idea when you'll be able to give me feedback on the patch?
>
> Michael Kay
> Saxonica
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

Re: [Exist-development] eXist-db with Calabash and Saxon again

[Michael K. <mi...@sa...>]

  Any idea when you'll be able to give me feedback on the patch?

Michael Kay
Saxonica

[Exist-development] atomic wiki down?

[Joe W. <jo...@gm...>]

http://atomic.exist-db.org/blogs/eXist

=>

HTTP ERROR: 500

An error occurred while executing the urlrewrite query: error found
while loading module atom: IO exception while loading module
'http://www.w3.org/2005/Atom' from
'file:/home/existdb/atomic.exist-db.org/AtomicWiki/xquery/src/org/exist/atomic/atom.xql'
RequestURI=/blogs/

Powered by Jetty://

[Exist-development] Fwd: [Exist-open] Looking for case studies on "structured search"

[Dan M. <dan...@gm...>]

Hello eXist developers,

I just got the following very nice note from Rebecca Koeser at Emory
University in Atlanta USA.

This quote rocks:

*most relevant results are now showing up in the first few hits rather than
in the first few pages*

- Dan


---------- Forwarded message ----------
From: Rebecca Sutton Koeser <reb...@em...>
Date: Mon, Sep 20, 2010 at 10:10 AM
Subject: Re: [Exist-open] Looking for case studies on "structured search"
To: "da...@da..." <da...@da...>


Dan, you've been helpful to me with my work on eXist and answered
questions on the mailing list, so it's nice to have an opportunity to
give a little bit back.  Hope the info is helpful for your
presentation tomorrow.



Organization Name/Location:  Woodruff Library, Emory University, Atlanta GA
Contact Name/E-mail: Rebecca Sutton Koeser, reb...@em... (Tech
Lead)
Project Name: Emory University Finding Aids

Brief Project Description: Search + browse web interface to a
collection of ~970 Encoded Archival Description (EAD) XML documents or
Finding Aids for archival and manuscript collections.  In many cases,
there are multiple archival collections related to a particular author
or person; we were able to use the eXist/Lucene index boosting to
ensure that the primary collection shows up first when you search for
these names.  (The new eXist-based Finding Aids site is not yet in
production.)

On a scale of 1 (no impact) to 5 (large impact), how has structured search
improved findability in this project?:

Answer from the stakeholder who helped select fields to boost and test
the index tuning: 4 - We're not finding results that weren't there
before, but the most relevant results are now showing up in the first
few hits rather than in the first few pages.

Would you recommend using  eXist/and structured search to others with
similar
challenges?:

Yes; for documents like EAD, the structure and organization of the
document is very significant and affects how we present and search the
content.  Having the ability to combine the power of Lucene searching
in with XQuery and eXist's native XML handling makes for a potent
combination.


--
Rebecca Sutton Koeser, Ph.D.
reb...@em...
Digital Programs & Systems - Woodruff Library, Emory University


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)

iEYEARECAAYFAkyXeXoACgkQ2wP7Byh4FYuIZQCgpMpbkfH/dDkI/3CADDD8E94C
lJoAnipoi3aYoLNxyTAWYZgcv8BGvyN1
=vR9/
-----END PGP SIGNATURE-----




-- 
Dan McCreary
Semantic Solutions Architect
office: (952) 931-9198
cell: (612) 986-1552

Re: [Exist-development] Is it OK to ask for case studies on structured search

[Adam R. <ad...@ex...>]

> Is this acceptable use of the list?

Sounds fine to me...


> - Dan
>
> --
> Dan McCreary
> Semantic Solutions Architect
> office: (952) 931-9198
> cell: (612) 986-1552
>
> ------------------------------------------------------------------------------
> Start uncovering the many advantages of virtual appliances
> and start using them to simplify application deployment and
> accelerate your shift to cloud computing.
> http://p.sf.net/sfu/novell-sfdev2dev
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

[Exist-development] Is it OK to ask for case studies on structured search

[Dan M. <dan...@gm...>]

Hello eXist developers,

I am speaking at a conference next week and I would like to ask the eXist
open list if anyone would like to contribute case studies on the use of
eXist and Lucene to perform "structured search".  I wrote a blog about it
here:

http://datadictionary.blogspot.com

I will share my presentation and all data collected with whoever requests
it.

Is this acceptable use of the list?

- Dan

-- 
Dan McCreary
Semantic Solutions Architect
office: (952) 931-9198
cell: (612) 986-1552

[Exist-development] XAR Packaging / Indexes

[Stefan M. <ste...@un...>]

I just tried the XAR Packaging that has made its way into trunk.

I have to say, I am really impressed by the packaging in exist.
I especially like the fact that it is not only possible to put XQuery
modules into the packages, but also data, is really great. This way we
have an option to effectively bundle data and XQuery files. Up to now we
used ant tasks for this, but packaging would really make life so much
easier.

For now I managed to create archives with data and xquery files, that
appears to work fine.

I have one question concerning indices. When bundling data and query
files, it would be interesting to have a mechanism to bundle indexes. If
there would be a way to achieve this, it would be marvellous. For now I
tried to add a ./system/config/db/myapp/collection.xconf to the ZIP, but
failed.

I think adding some <index> element to the expath package format, where
the index definition file and collection would be defined, could do the
trick. Or is there already some mechanism in place for this purpose?

Something else. How do you handle really large xars where one risks
connection breakdowns, timeouts...?

Well, I have to emphasise it once more. The packaging is just great!

cheers and thanks,
Stefan

Re: [Exist-development] Restoring accounts

[Dmitriy S. <sha...@gm...>]

On Tue, 2010-09-14 at 19:28 +0400, Evgeny Gazdovsky wrote:
> current trunk
> 

Это может быть связано с тригерами, это механизм используется для
отслеживания изменений.

-- 
Cheers,

Dmitriy Shabanov

Re: [Exist-development] Restoring accounts

[Evgeny G. <gaz...@gm...>]

current trunk

Re: [Exist-development] Restoring accounts

[Dmitriy S. <sha...@gm...>]

On Tue, 2010-09-14 at 11:51 +0400, Evgeny Gazdovsky wrote:
> Hello, Dmitry!
> 
> 
> After restoring the new secure accounts
> they are not available, during restart.

What rev?

-- 
Cheers,

Dmitriy Shabanov

Re: [Exist-development] Moving towards a new API

[Jason S. <js...@in...>]

> Adam Retter wrote:
> I was never really a fan of XMLDB-API.

I found it to have severe limitations and be generally cumbersome to use.  However, some aspects I liked, particularly the ability to use it remotely.

I think XMLDB was hampered by trying to adhere to a standard.  Standards always *seem* like a good idea...  A good solid flexible API would be more useful though.

I'd rather have a non-standard API that works than a standard API that does not work across multiple databases.  ;-)

> Whatever you decide you should certainly consider the aspect of
> streaming in any API that you enhance or develop. This is important
> when you have large datasets or long running queries.

Not really my decision.  :-)  But yes, that is one of the detractors from XMLDB API.  They didn't get streaming right, but close.

If Fluent is far enough along, and it's a good abstraction, then maybe that's a better solution.  I'll do some reading/searching on it when I get the chance.  Super busy right now, so it will be a few days.  :-)  

Re: [Exist-development] Thanks for the birthday wish!

[Wolfgang M. <wol...@ex...>]

> I just wanted to let everyone know that I got nice birthday wishes from
> Wolfgang and I want to all know how wonderful it is to work with you guys.

I wasn't sure if it really is your birthday (I normally use wrong
birthday dates on public sites), but I thought I'd just send a short
message. Anyway, we wish you all the best for the next decades to
come!

Wolfgang

Re: [Exist-development] Thanks for the birthday wish!

[Adam R. <ad...@ex...>]

Have a great day Dan :-)

On 14 September 2010 04:25, Dan McCreary <dan...@gm...> wrote:
>> [9/12/2010 10:30:08 AM] Wolfgang Meier: Happy birthday!!! From me an the
>> entire eXist dev team.
>
> I just wanted to let everyone know that I got nice birthday wishes from
> Wolfgang and I want to all know how wonderful it is to work with you guys.
> I feel honored to just be associated with you.
>
> You are the best!
>
> Thanks! - Dan
>
>
> ------------------------------------------------------------------------------
> Start uncovering the many advantages of virtual appliances
> and start using them to simplify application deployment and
> accelerate your shift to cloud computing.
> http://p.sf.net/sfu/novell-sfdev2dev
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb

[Exist-development] Restoring accounts

[Evgeny G. <gaz...@gm...>]

Hello, Dmitry!

After restoring the new secure accounts
they are not available, during restart.

--
Evgeny

[Exist-development] Thanks for the birthday wish!

[Dan M. <dan...@gm...>]

*> [9/12/2010 10:30:08 AM] Wolfgang Meier: Happy birthday!!! From me an the
entire eXist dev team.*

I just wanted to let everyone know that I got nice birthday wishes from
Wolfgang and I want to all know how wonderful it is to work with you guys.
I feel honored to just be associated with you.

You are the best!

Thanks! - Dan

Re: [Exist-development] Moving towards a new API

[Adam R. <ad...@ex...>]

On 7 September 2010 17:00, Jason Smith <js...@in...> wrote:
> I was thinking about remote/local too.  That is certainly something that could be done with just a little planning.
>
> Where is the best documentation on the Fluent API?  I guess I should take a look.  I didn't use it originally because when I started this, Fluent was in its infancy...  :-)
>
>
> -----Original Message-----
> From: Eugene Marcotte [mailto:eu...@em...]
> Sent: Tuesday, September 07, 2010 4:17 AM
> To: Jason Smith
> Subject: Re: [Exist-development] Moving towards a new API
>
> Hi,
>
> JSR 225 was the "XQuery API for Java (XQJ)" project.
> http://www.jcp.org/en/jsr/detail?id=225
>
> I looked at it a couple months ago and thought it was mostly too much
> like JDBC to be a useful XMLDB-API replacement.

Likewise I agree that it is heavily JDBC influenced, however there is
someone I am aware of working on an implementation of this for
eXist-db.

> I really do like the XMLDB-API's approach, especially because it works
> both remote and local. If it was a tad more up-to-date -- e.g. more like
> the fluent API it'd be even better!

I was never really a fan of XMLDB-API.

I do really like the Fluent API, but it is local only so you would
need to abstract and add a remote implementation. If you are
interested in Fluent API then you should contact Piotr Kaminski the
original author - pi...@id....

Whatever you decide you should certainly consider the aspect of
streaming in any API that you enhance or develop. This is important
when you have large datasets or long running queries.

> Eugene (an exist-devel lurker)
>
>
> On 9/3/2010 10:38 PM, Jason Smith wrote:
>> We talked on Thursday about a new API that would be more powerful than existing APIs and provide a wrapper for the internal API.
>>
>> After thinking about this some more, I'd like to consider the XMLDB-API model.  There is a lot that is right about the XMLDB wrapper.  It has pretty good collection and resource facilities, and it can be used to access large data sets in a "sequence"-like manner.
>>
>> I think where XMLDB falls down is around standardization.  The XMLDB standard was designed in the days when an XML database could do XPath 1.0.  It can't fully support the XQuery standard without significant changes.  It can't be extended to do some of the things that eXist does specifically.  XMLDB as a standard seems kind of dead at this point anyway.
>>
>> Just one example - this email is getting too long...  I can't use XMLDB to return a Sequence of xs:dateTime, which I then pass as a parameter to another XQuery.  XMLDB only deals with string output, and the set of input types is very limited.
>>
>>
>>
>> So right now, I am thinking about an API that would aspire to replace the XMLDB API in Exist.  I think it should also hide (wrap) the current locking and transaction mechanisms (since these are bound to change in the next year or two).
>>
>> It would not be based on any standard, but would be designed to provide maximally simple and powerful access to as much of the internal API as possible, and to be easy to extend as new features become available.
>>
>> If we do it right, we could also make this a cross-platform API (supporting languages other than Java), kind of like the REST API today, but targeted to language APIs.
>>
>> Does this sound like a good path to start down?  Different ideas?
>>
>> BTW, I know there is a JSR that covers an XML database API somewhere out there, or one was in work...  I looked at it a long time ago, and it did not seem all that applicable.  Is there any interest in that API, and if so, can someone point me to a link?  I seem to be having trouble finding it again.
>>
>> Thanks!
>>
>> -Jason S.
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net Dev2Dev email is sponsored by:
>>
>> Show off your parallel programming skills.
>> Enter the Intel(R) Threading Challenge 2010.
>> http://p.sf.net/sfu/intel-thread-sfd
>> _______________________________________________
>> Exist-development mailing list
>> Exi...@li...
>> https://lists.sourceforge.net/lists/listinfo/exist-development
>
>
> ------------------------------------------------------------------------------
> This SF.net Dev2Dev email is sponsored by:
>
> Show off your parallel programming skills.
> Enter the Intel(R) Threading Challenge 2010.
> http://p.sf.net/sfu/intel-thread-sfd
> _______________________________________________
> Exist-development mailing list
> Exi...@li...
> https://lists.sourceforge.net/lists/listinfo/exist-development
>



-- 
Adam Retter

eXist Developer
{ United Kingdom }
ad...@ex...
irc://irc.freenode.net/existdb