[PyCS-devel] New in CVS: many changes for mirroring to the pycs search engine

[Georg B. <gb...@mu...>]

Hi!

I now made a bigger bunch of patches so that the pycs search engine is
filled with weblog postings. To get it up and going, I needed to do
several patches to the search.py and the xmlStorageSystem.py modules. I
added the deleteMirroredPosts method to the xmlStorageSystem and I made
search.py to allways use utf-8 encoding (this is because there might be
mixed charsets at work - users mirroring stuff in unicode and storing in
utf-8 encoding, but the pycs server itself using iso-8859-1). I commited
those changes to the pycs repository, as soon as Phil updates his server
you can play with the search stuff there. For now I upgraded my own
community server.

You can search my german weblog like this:

http://muensterland.org/system/search.py?u=3D0000006&q=3D%C3%B6

This query is for the german umlaut "=F6", so you get a bunch of posts
that use this character :-)

The implementation in PyDS is as follows:

- there is a MirrorTool that allows switching on/off mirroring to
several mirror drivers
_ there is a MirrorRegistry that manages the mirror objects and contains
the base class for all mirror classes
- there is currently only one mirror module: PyCSSearchMirror.py

To enable the mirroring, you need to go to the MirrorTool index_html and
switch on the PyCS mirror. Then you need to do a resync (link on the
same page). This is to fill the search database with your old postings.

Currently _only_ WeblogTool is hooked into the MirrorTool! This will be
expanded, but for now you can only search in postings.

To hook up a tool to the MirrorTool, you need to call the mirror stuff
as in WeblogTool.py and you need to implement a _resync method like in
WeblogTool.py. It's quite simple to hook something up with MirrorTool,
so I expect to get more tools into mirroring soon.

For now all this stuff is highly alpha stuff - you should consider CVS
as broken, if it does work, be happy, but don't depend on it ;-)

I will do some more on this in the next time. If I think it's stable
enough, I will make a new release. Before that don't consider anything
in CVS as production style, it's even not beta sometimes.

The next release of PyDS will be 0.7.0. I assume there will be some
subreleases to fix bugs introduced with all the new stuff and do flesh
out the mirroring a bit more (for example still missing is a way to
configure mirrors!). After the 0.7 series I think another 0.8 series
will follow where I do some refactorings to allow FTP or LFS users to
make use of community server features.

Plans might change without prior notice, of course ;-)

bye, Georg