From: Markus K. <ma...@se...> - 2012-11-22 07:41:53
|
Dear all, SMW 1.8 is close to its first stable release. We have now packaged a Release Candidate for download [1]. If all goes well, this will become SMW 1.8.0 in about a week. As usual, the package includes the required version of Validator. Major new features include: * New data storage: more efficient, less database activity * Interface improvements in Special:Ask * New atom and RSS printer * SMW now provides information about #ask queries used on the wiki [2] * Support for #subobjects without a name * Ask API now stable, with added continuation support Moreover, a large number of bugs have been fixed, compatibility to all recent MW versions has been ensured, a lot of internal improvements have been made, and translations have been added. A record number of people have contributed to this work. For those of you who download versions from git, there is also an according tag there for this RC. The master branch itself will remain in a stable state until 1.8 is released. Feedback is most welcome. Cheers, Markus [1] http://sourceforge.net/projects/semediawiki/files/semediawiki/Semantic%20MediaWiki%201.8%20RC1/ [2] You can now query for queries. Examples: * The 10 largest queries used on the wiki with their size and query string: {{#ask:[[query string::+]] |?query size |?query string |sort=query size |order=DESC |limit=10 }} * The number of queries that use the format "list": {{#ask:[[query format::list]] |format=count }} * The number of pages that use queries that use the format "list": {{#ask:[[has query.query format::list]] |format=count }} * The total number of queries: {{#ask:[[query size::+]] |format=count }} * Pages that have a query with format list and one with format table: {{#ask: [[has query.query format::list]] [[has query.query format::table]] }} |
From: Neill M. <ne...@nl...> - 2012-11-22 10:00:26
|
Hi Markus. This is great news. Thanks to all involved! I'll run it through my regression test suite over the next couple of days. Best regards Neill. On 22/11/12 07:41, Markus Krötzsch wrote: > Dear all, > > SMW 1.8 is close to its first stable release. We have now packaged a > Release Candidate for download [1]. If all goes well, this will become > SMW 1.8.0 in about a week. As usual, the package includes the required > version of Validator. > > Major new features include: > > * New data storage: more efficient, less database activity > * Interface improvements in Special:Ask > * New atom and RSS printer > * SMW now provides information about #ask queries used on the wiki [2] > * Support for #subobjects without a name > * Ask API now stable, with added continuation support > > Moreover, a large number of bugs have been fixed, compatibility to all > recent MW versions has been ensured, a lot of internal improvements have > been made, and translations have been added. A record number of people > have contributed to this work. > > For those of you who download versions from git, there is also an > according tag there for this RC. The master branch itself will remain in > a stable state until 1.8 is released. > > Feedback is most welcome. > > Cheers, > > Markus > > > [1] > http://sourceforge.net/projects/semediawiki/files/semediawiki/Semantic%20MediaWiki%201.8%20RC1/ > [2] You can now query for queries. Examples: > > * The 10 largest queries used on the wiki with their size and query string: > > {{#ask:[[query string::+]] > |?query size > |?query string > |sort=query size > |order=DESC > |limit=10 > }} > > * The number of queries that use the format "list": > > {{#ask:[[query format::list]] |format=count }} > > * The number of pages that use queries that use the format "list": > > {{#ask:[[has query.query format::list]] |format=count }} > > * The total number of queries: > > {{#ask:[[query size::+]] |format=count }} > > * Pages that have a query with format list and one with format table: > > {{#ask: [[has query.query format::list]] [[has query.query > format::table]] }} > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > Semediawiki-devel mailing list > Sem...@li... > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > |
From: Neill M. <ne...@nl...> - 2012-11-22 10:19:37
|
Hi all. One thing to note. You must run the SMW_refreshData maintenance script after upgrading. I had a brief moment of panic as all my property values were empty! Cheers Neill. On 22/11/12 10:00, Neill Mitchell wrote: > Hi Markus. > > This is great news. Thanks to all involved! > > I'll run it through my regression test suite over the next couple of days. > > Best regards > Neill. > On 22/11/12 07:41, Markus Krötzsch wrote: >> Dear all, >> >> SMW 1.8 is close to its first stable release. We have now packaged a >> Release Candidate for download [1]. If all goes well, this will become >> SMW 1.8.0 in about a week. As usual, the package includes the required >> version of Validator. >> >> Major new features include: >> >> * New data storage: more efficient, less database activity >> * Interface improvements in Special:Ask >> * New atom and RSS printer >> * SMW now provides information about #ask queries used on the wiki [2] >> * Support for #subobjects without a name >> * Ask API now stable, with added continuation support >> >> Moreover, a large number of bugs have been fixed, compatibility to all >> recent MW versions has been ensured, a lot of internal improvements have >> been made, and translations have been added. A record number of people >> have contributed to this work. >> >> For those of you who download versions from git, there is also an >> according tag there for this RC. The master branch itself will remain in >> a stable state until 1.8 is released. >> >> Feedback is most welcome. >> >> Cheers, >> >> Markus >> >> >> [1] >> http://sourceforge.net/projects/semediawiki/files/semediawiki/Semantic%20MediaWiki%201.8%20RC1/ >> [2] You can now query for queries. Examples: >> >> * The 10 largest queries used on the wiki with their size and query string: >> >> {{#ask:[[query string::+]] >> |?query size >> |?query string >> |sort=query size >> |order=DESC >> |limit=10 >> }} >> >> * The number of queries that use the format "list": >> >> {{#ask:[[query format::list]] |format=count }} >> >> * The number of pages that use queries that use the format "list": >> >> {{#ask:[[has query.query format::list]] |format=count }} >> >> * The total number of queries: >> >> {{#ask:[[query size::+]] |format=count }} >> >> * Pages that have a query with format list and one with format table: >> >> {{#ask: [[has query.query format::list]] [[has query.query >> format::table]] }} >> >> ------------------------------------------------------------------------------ >> Monitor your physical, virtual and cloud infrastructure from a single >> web console. Get in-depth insight into apps, servers, databases, vmware, >> SAP, cloud infrastructure, etc. Download 30-day Free Trial. >> Pricing starts from $795 for 25 servers or applications! >> http://p.sf.net/sfu/zoho_dev2dev_nov >> _______________________________________________ >> Semediawiki-devel mailing list >> Sem...@li... >> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel >> > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > Semediawiki-devel mailing list > Sem...@li... > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > |
From: Markus K. <ma...@se...> - 2012-11-22 11:22:17
|
On 22/11/12 10:19, Neill Mitchell wrote: > Hi all. > > One thing to note. You must run the SMW_refreshData maintenance script > after upgrading. I had a brief moment of panic as all my property values > were empty! Yes, please *do* read the section about upgrading in INSTALL. I paste the main part of its text below, just in case you cannot find INSTALL ;-) Also, please do not try to delete your old SQLStore2 yet (a bug has been discovered there today; the script won't accept the parameter that specifies the store, so it only let's you delete the store you currently use). This will be re-enabled before the release. Markus === SMW 1.8 introduces a new default database layout (SMWSQLStore3). You can continue to use the old layout (SMWSQLStore2) for transition purposes, but it is strongly recommended to migrate to the new layout for future compatibility. To use the old layout at first, add $smwgDefaultStore = 'SMWSQLStore2'; to your LocalSettings.php. If you are using $smwgDefaultStore = 'SMWSparqlStore'; already, then you should keep this line and add the following: SMWSparqlStore::$baseStoreClass = 'SMWSQLStore2'; (after enableSemantics). After setting these, run SMW_setup.php or Special:SMWAdmin upgrade as usual. The wiki should now work as normal, but using the old storage structures. To migrate to the new store, you can do a normal "full refresh" for the new store. Run the following two commands (both will run a while). php SMW_refreshData.php -v -b SMWSQLStore3 -fp php SMW_refreshData.php -v -b SMWSQLStore3 The running wiki will not be affected by this, but the operation could affect server speed. See http://semantic-mediawiki.org/wiki/Help:Repairing_SMW%27s_data for details. After successful migration, remove the lines with 'SMWSQLStore2' from your LocalSettings.php to use the new store. You can always return to the old store in case of problems. If the old store is no longer needed, it can be deleted (and its memory freed) by running ... (this does not work, as mentioned above; don't try it yet) > > Cheers > Neill. > > On 22/11/12 10:00, Neill Mitchell wrote: >> Hi Markus. >> >> This is great news. Thanks to all involved! >> >> I'll run it through my regression test suite over the next couple of days. >> >> Best regards >> Neill. >> On 22/11/12 07:41, Markus Krötzsch wrote: >>> Dear all, >>> >>> SMW 1.8 is close to its first stable release. We have now packaged a >>> Release Candidate for download [1]. If all goes well, this will become >>> SMW 1.8.0 in about a week. As usual, the package includes the required >>> version of Validator. >>> >>> Major new features include: >>> >>> * New data storage: more efficient, less database activity >>> * Interface improvements in Special:Ask >>> * New atom and RSS printer >>> * SMW now provides information about #ask queries used on the wiki [2] >>> * Support for #subobjects without a name >>> * Ask API now stable, with added continuation support >>> >>> Moreover, a large number of bugs have been fixed, compatibility to all >>> recent MW versions has been ensured, a lot of internal improvements have >>> been made, and translations have been added. A record number of people >>> have contributed to this work. >>> >>> For those of you who download versions from git, there is also an >>> according tag there for this RC. The master branch itself will remain in >>> a stable state until 1.8 is released. >>> >>> Feedback is most welcome. >>> >>> Cheers, >>> >>> Markus >>> >>> >>> [1] >>> http://sourceforge.net/projects/semediawiki/files/semediawiki/Semantic%20MediaWiki%201.8%20RC1/ >>> [2] You can now query for queries. Examples: >>> >>> * The 10 largest queries used on the wiki with their size and query string: >>> >>> {{#ask:[[query string::+]] >>> |?query size >>> |?query string >>> |sort=query size >>> |order=DESC >>> |limit=10 >>> }} >>> >>> * The number of queries that use the format "list": >>> >>> {{#ask:[[query format::list]] |format=count }} >>> >>> * The number of pages that use queries that use the format "list": >>> >>> {{#ask:[[has query.query format::list]] |format=count }} >>> >>> * The total number of queries: >>> >>> {{#ask:[[query size::+]] |format=count }} >>> >>> * Pages that have a query with format list and one with format table: >>> >>> {{#ask: [[has query.query format::list]] [[has query.query >>> format::table]] }} >>> >>> ------------------------------------------------------------------------------ >>> Monitor your physical, virtual and cloud infrastructure from a single >>> web console. Get in-depth insight into apps, servers, databases, vmware, >>> SAP, cloud infrastructure, etc. Download 30-day Free Trial. >>> Pricing starts from $795 for 25 servers or applications! >>> http://p.sf.net/sfu/zoho_dev2dev_nov >>> _______________________________________________ >>> Semediawiki-devel mailing list >>> Sem...@li... >>> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel >>> >> >> ------------------------------------------------------------------------------ >> Monitor your physical, virtual and cloud infrastructure from a single >> web console. Get in-depth insight into apps, servers, databases, vmware, >> SAP, cloud infrastructure, etc. Download 30-day Free Trial. >> Pricing starts from $795 for 25 servers or applications! >> http://p.sf.net/sfu/zoho_dev2dev_nov >> _______________________________________________ >> Semediawiki-devel mailing list >> Sem...@li... >> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel >> > > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > Semediawiki-devel mailing list > Sem...@li... > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > |
From: Luka F. <lu...@lj...> - 2012-11-28 01:38:59
|
Hello! We stumbled on two issues with 1.8rc. Both were puzzling and scary at first, and each took its own debugging session to tame, now both resolved. ;) First we saw hex-encoded outputs of all textual objects (strings,blobs) larger than 72 characters. Our site runs postgresql - it turned out to be an incompatible default configuration setting on the role (user). The fix is simple and only needs to be run once against the database: ALTER ROLE {your_db_username_here} SET bytea_output = 'escape'; The other and it seems default option is 'hex' and SMW is not able to recognize or deal with it properly. So this configurations seems to be necessary. It would be great if this can somehow get set automatically upon creating the datastore, when running maintenance/SMWsetup.php. The other issue manifests when queries return wikipagedataitems containing + in their title. This triggers the "Somebody tried to use spaces in a cache title!" exception, crashing the page. Fixing it is simple in the Exporter function findDataItemForExpElement: use rawurldecode instead of 'plain' urldecode, which converts the + to space. diff --git a/includes/export/SMW_Exporter.php b/includes/export/SMW_Exporter.php index 9da3f1a..b56f5b3 100644 --- a/includes/export/SMW_Exporter.php +++ b/includes/export/SMW_Exporter.php @@ -326,7 +326,7 @@ class SMWExporter { $wikiNamespace = self::getNamespaceUri( 'wiki' ); if ( strpos( $uri, $wikiNamespace ) === 0 ) { $localName = substr( $uri, strlen( $wikiNamespace ) ); - $dbKey = urldecode( self::decodeURI( $localName ) ); + $dbKey = rawurldecode( self::decodeURI( $localName ) ); $parts = explode( '-23', $dbKey, 2 ); if ( count( $parts ) == 2 ) { Now that bugs are fixed, am looking forward to finally try out subobjects and what else the new SMW has to offer! :) The site: http://www.culture.si/ - powered by SMW, perhaps not a bad usecase. best, LF Dne 22. 11. 2012 08:41, piše Markus Krötzsch: > Dear all, > > SMW 1.8 is close to its first stable release. We have now packaged a > Release Candidate for download [1]. If all goes well, this will become > SMW 1.8.0 in about a week. As usual, the package includes the required > version of Validator. > > Major new features include: > > * New data storage: more efficient, less database activity > * Interface improvements in Special:Ask > * New atom and RSS printer > * SMW now provides information about #ask queries used on the wiki [2] > * Support for #subobjects without a name > * Ask API now stable, with added continuation support > > Moreover, a large number of bugs have been fixed, compatibility to all > recent MW versions has been ensured, a lot of internal improvements have > been made, and translations have been added. A record number of people > have contributed to this work. > > For those of you who download versions from git, there is also an > according tag there for this RC. The master branch itself will remain in > a stable state until 1.8 is released. > > Feedback is most welcome. > > Cheers, > > Markus > > > [1] > http://sourceforge.net/projects/semediawiki/files/semediawiki/Semantic%20MediaWiki%201.8%20RC1/ > [2] You can now query for queries. Examples: > > * The 10 largest queries used on the wiki with their size and query string: > > {{#ask:[[query string::+]] > |?query size > |?query string > |sort=query size > |order=DESC > |limit=10 > }} > > * The number of queries that use the format "list": > > {{#ask:[[query format::list]] |format=count }} > > * The number of pages that use queries that use the format "list": > > {{#ask:[[has query.query format::list]] |format=count }} > > * The total number of queries: > > {{#ask:[[query size::+]] |format=count }} > > * Pages that have a query with format list and one with format table: > > {{#ask: [[has query.query format::list]] [[has query.query > format::table]] }} > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > Semediawiki-devel mailing list > Sem...@li... > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel |
From: Markus K. <ma...@se...> - 2012-11-30 11:34:54
|
Dear Luka, thanks for the reports. The second issue has now been fixed in master [1] and will thus appear in SMW 1.8. For the PostgreSQL initialisation, I would like to have more information. It seems odd that this should be needed in general to create a working PostgreSQL DB. It seems to me that such encoding/decoding issues (hex strings) should be handled by the database access layer (or by the database), so that it works with any configuration. Changing the configuration instead seems like a workaround. Maybe this should actually be a bug against the MediaWiki PostgreSQL access layer? Very nice site you have indeed. Would be great to have this as a Wiki of the Month at some point. See [2]. Cheers, Markus [1] https://gerrit.wikimedia.org/r/36163 [2] http://semantic-mediawiki.org/wiki/Wiki_of_the_Month On 28/11/12 01:23, Luka Frelih wrote: > Hello! > > We stumbled on two issues with 1.8rc. Both were puzzling and scary at > first, and each took its own debugging session to tame, now both > resolved. ;) > > First we saw hex-encoded outputs of all textual objects (strings,blobs) > larger than 72 characters. > Our site runs postgresql - it turned out to be an incompatible default > configuration setting on the role (user). The fix is simple and only > needs to be run once against the database: > > ALTER ROLE {your_db_username_here} SET bytea_output = 'escape'; > > The other and it seems default option is 'hex' and SMW is not able to > recognize or deal with it properly. So this configurations seems to be > necessary. It would be great if this can somehow get set automatically > upon creating the datastore, when running maintenance/SMWsetup.php. > > The other issue manifests when queries return wikipagedataitems > containing + in their title. This triggers the "Somebody tried to use > spaces in a cache title!" exception, crashing the page. Fixing it is > simple in the Exporter function findDataItemForExpElement: use > rawurldecode instead of 'plain' urldecode, which converts the + to space. > > diff --git a/includes/export/SMW_Exporter.php > b/includes/export/SMW_Exporter.php > index 9da3f1a..b56f5b3 100644 > --- a/includes/export/SMW_Exporter.php > +++ b/includes/export/SMW_Exporter.php > @@ -326,7 +326,7 @@ class SMWExporter { > $wikiNamespace = self::getNamespaceUri( 'wiki' ); > if ( strpos( $uri, $wikiNamespace ) === 0 ) { > $localName = substr( $uri, strlen( $wikiNamespace ) ); > - $dbKey = urldecode( self::decodeURI( $localName ) ); > + $dbKey = rawurldecode( self::decodeURI( $localName ) ); > > $parts = explode( '-23', $dbKey, 2 ); > if ( count( $parts ) == 2 ) { > > Now that bugs are fixed, am looking forward to finally try out > subobjects and what else the new SMW has to offer! :) > > The site: http://www.culture.si/ - powered by SMW, perhaps not a bad > usecase. > > best, > LF > > > Dne 22. 11. 2012 08:41, piše Markus Krötzsch: >> Dear all, >> >> SMW 1.8 is close to its first stable release. We have now packaged a >> Release Candidate for download [1]. If all goes well, this will become >> SMW 1.8.0 in about a week. As usual, the package includes the required >> version of Validator. >> >> Major new features include: >> >> * New data storage: more efficient, less database activity >> * Interface improvements in Special:Ask >> * New atom and RSS printer >> * SMW now provides information about #ask queries used on the wiki [2] >> * Support for #subobjects without a name >> * Ask API now stable, with added continuation support >> >> Moreover, a large number of bugs have been fixed, compatibility to all >> recent MW versions has been ensured, a lot of internal improvements have >> been made, and translations have been added. A record number of people >> have contributed to this work. >> >> For those of you who download versions from git, there is also an >> according tag there for this RC. The master branch itself will remain in >> a stable state until 1.8 is released. >> >> Feedback is most welcome. >> >> Cheers, >> >> Markus >> >> >> [1] >> http://sourceforge.net/projects/semediawiki/files/semediawiki/Semantic%20MediaWiki%201.8%20RC1/ >> [2] You can now query for queries. Examples: >> >> * The 10 largest queries used on the wiki with their size and query string: >> >> {{#ask:[[query string::+]] >> |?query size >> |?query string >> |sort=query size >> |order=DESC >> |limit=10 >> }} >> >> * The number of queries that use the format "list": >> >> {{#ask:[[query format::list]] |format=count }} >> >> * The number of pages that use queries that use the format "list": >> >> {{#ask:[[has query.query format::list]] |format=count }} >> >> * The total number of queries: >> >> {{#ask:[[query size::+]] |format=count }} >> >> * Pages that have a query with format list and one with format table: >> >> {{#ask: [[has query.query format::list]] [[has query.query >> format::table]] }} >> >> ------------------------------------------------------------------------------ >> Monitor your physical, virtual and cloud infrastructure from a single >> web console. Get in-depth insight into apps, servers, databases, vmware, >> SAP, cloud infrastructure, etc. Download 30-day Free Trial. >> Pricing starts from $795 for 25 servers or applications! >> http://p.sf.net/sfu/zoho_dev2dev_nov >> _______________________________________________ >> Semediawiki-devel mailing list >> Sem...@li... >> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > > > ------------------------------------------------------------------------------ > Keep yourself connected to Go Parallel: > INSIGHTS What's next for parallel hardware, programming and related areas? > Interviews and blogs by thought leaders keep you ahead of the curve. > http://goparallel.sourceforge.net > _______________________________________________ > Semediawiki-devel mailing list > Sem...@li... > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > |