Got it - if it'll speed up the process, that'll be great. Currently SMW on top of MW runs significantly slower then just MW which is not very good because it means that SMW+MW can't scale as good as MW alone.

Can you describe in a couple of paragraphs how SMW data and queries are getting cached and how that cache is being invalidated, what works on the fly and what is served from parser cache.

I understand it's a lot to describe, but projects with massive amount of data and traffic, performance can be a big show-stopper - we picked MW for one of our projects because of Wikipedia performance example and predictability and I hope that it's not too distant for SMW to inherit these qualities, but I'd like to understand the overall picture.

Thank you,

              Sergey.


On Dec 14, 2007 1:12 PM, Markus Krötzsch < mak@aifb.uni-karlsruhe.de> wrote:
On Freitag, 14. Dezember 2007, Sergey Chernyshev wrote:
> Markus, can you elaborate on three values - what's the difference between
> SOME and FULL?

FULL is what used to be "true" in 1.0 (default)
NONE is what used to be "false" in all versions
SOME is new, but does basically what 0.7 did earlier.

So SOME only considers redirects for pages that appear directly in the query.
For example, assume "r1" and "r2" are redirects to "p". Then asking
for "[[property::r1]]" yields the same results as asking
for "[[property::p]]" or "[[property::r1]]".

This is not too hard to do. Now FULL evaluates redirects even when joining
subqueries or asking for categories. As an example, assume that in addition
to the above there is a page "q" with annotation "[[property::r1]]", and
assume further that r2 is in Category2 and that p is in Category3. Then each
of the following queries contains "q" in its result list:

* <ask>[[property::<q>[[Category:Category3]]</q>]]</ask>
* <ask>[[property::<q>[[Category:Category2]]</q>]]</ask>

Neither would work with SOME only. But as you can imagine, doing these
additional considerations about redirects at query time consumes a lot of
additional time (in particular since we use MW's redirect table that is not
even optimised for these kind of games).

If you make sure that properties do not point to redirects, and that redirects
have no categories or properties, then SOME should always suffice (I think it
was discussed earlier to have a Special page for that kind of maintenance).

-- Markus

>
>            Sergey
>
> On Dec 14, 2007 7:27 AM, Markus Krötzsch < mak@aifb.uni-karlsruhe.de> wrote:
> > On Freitag, 14. Dezember 2007, cnit wrote:
> > > > Indeed. This was fixed now in SVN.
> > >
> > > Thank you! It works!!
> > > And with #ask SMW has become much more powerful!
> > >
> > > One tought - I wonder if $smwgQEqualitySupport should be true by
> > > default.. It seems to speeds up a little when set false. But of course
> > > that's the matter of tuning and can be done by the users. Maybe just a
> > > notice in INSTALL file would be helpful. But anyway - not much of
> > > problem even if leave it "as is".
> >
> > I agree, it should not be "true". I think I will make it three-valued,
> > since
> > only part of the feature really slows down the querying. So the values
> > would
> > be something like NONE, SOME, and FULL. This should happen before 1.0.
> >
> > Markus
> >
> >
> > --
> > Markus Krötzsch
> > Institut AIFB, Universät Karlsruhe (TH), 76128 Karlsruhe
> > phone +49 (0)721 608 7362        fax +49 (0)721 608 5998
> > mak@aifb.uni-karlsruhe.de        www  http://korrekt.org
> >
> > -------------------------------------------------------------------------
> > SF.Net email is sponsored by:
> > Check out the new SourceForge.net Marketplace.
> > It's the best place to buy or sell services
> > for just about anything Open Source.
> >
> > http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketpl
> >ace _______________________________________________
> > Semediawiki-devel mailing list
> > Semediawiki-devel@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel



--
Markus Krötzsch
Institut AIFB, Universät Karlsruhe (TH), 76128 Karlsruhe
phone +49 (0)721 608 7362        fax +49 (0)721 608 5998
mak@aifb.uni-karlsruhe.de        www  http://korrekt.org

-------------------------------------------------------------------------

SF.Net email is sponsored by:
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services
for just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
Semediawiki-devel mailing list
Semediawiki-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/semediawiki-devel




--