From: Laurent A. <la...@al...> - 2010-06-24 23:31:59
|
Hi all Has anyone experienced poor performance on RDF exports since the upgrade to 1.5.1 ? Most of my pages flat out time out on the Special:ExportRDF page, even after bumping up PHP timeouts to 240 seconds. On pages that do come out (pages with only a handful of properties declared... as in less than 5) the RDF file seems to contain more details than I remember. In particular, I don't remember seeing that many details about pages linked to from the current page. Can someone familiar with the internals of the RDF export double check that things are ok ? I don't have a very high number of properties or properties values compared to some other SMW instances I know of. I didn't notice any slow down in SMW queries either, and Special:Browse is very responsive. The problem seems to be contained to ExportRDF so far. -- - Laurent Alquier http://www.linfa.net |
From: Laurent A. <la...@al...> - 2010-06-26 23:53:04
|
I set my PHP timeout limit to a very high value and let the RDF export run its course. The file was eventually generated, apparently without error. The RDF export contains what I expected to see - a list of properties for that one page. It also contains things I did not expect in that file - every pages that this page links to is also included in the file, along with their own properties. Is that how the RDF export is supposed to be ? - Laurent On Jun 24, 2010, at 7:31 PM, Laurent Alquier wrote: > Hi all > > Has anyone experienced poor performance on RDF exports since the upgrade to 1.5.1 ? > > Most of my pages flat out time out on the Special:ExportRDF page, even after bumping up PHP timeouts to 240 seconds. > > On pages that do come out (pages with only a handful of properties declared... as in less than 5) the RDF file seems to contain more details than I remember. In particular, I don't remember seeing that many details about pages linked to from the current page. > > Can someone familiar with the internals of the RDF export double check that things are ok ? > > I don't have a very high number of properties or properties values compared to some other SMW instances I know of. > I didn't notice any slow down in SMW queries either, and Special:Browse is very responsive. > > The problem seems to be contained to ExportRDF so far. > > -- > - Laurent Alquier > http://www.linfa.net |
From: Markus K. <ma...@se...> - 2010-06-27 13:54:45
|
On Sonntag, 27. Juni 2010, Laurent Alquier wrote: > I set my PHP timeout limit to a very high value and let the RDF export run > its course. > > The file was eventually generated, apparently without error. > > The RDF export contains what I expected to see - a list of properties for > that one page. > > It also contains things I did not expect in that file - every pages that > this page links to is also included in the file, along with their own > properties. > > Is that how the RDF export is supposed to be ? This behaviour should normally be configurable and be disabled by default. Maybe some change in SMW 1.5.1 affected the according setting or the place where it is taken into account. Maybe you can check if the settings at [1] need to be changed on your site. -- Markus [1] http://semantic-mediawiki.org/wiki/Help:Configuration#OWL.2FRDF_export > > On Jun 24, 2010, at 7:31 PM, Laurent Alquier wrote: > > Hi all > > > > Has anyone experienced poor performance on RDF exports since the upgrade > > to 1.5.1 ? > > > > Most of my pages flat out time out on the Special:ExportRDF page, even > > after bumping up PHP timeouts to 240 seconds. > > > > On pages that do come out (pages with only a handful of properties > > declared... as in less than 5) the RDF file seems to contain more details > > than I remember. In particular, I don't remember seeing that many details > > about pages linked to from the current page. > > > > Can someone familiar with the internals of the RDF export double check > > that things are ok ? > > > > I don't have a very high number of properties or properties values > > compared to some other SMW instances I know of. I didn't notice any slow > > down in SMW queries either, and Special:Browse is very responsive. > > > > The problem seems to be contained to ExportRDF so far. > -- Markus Krötzsch <ma...@se...> * Personal page: http://korrekt.org * Semantic MediaWiki: http://semantic-mediawiki.org * Semantic Web textbook: http://semantic-web-book.org -- |
From: Laurent A. <la...@al...> - 2010-06-27 16:59:00
|
I turned off recursive export and backlink export at the end of my LocalSettings.php file and the RDF export remains just as big. - Laurent On Jun 27, 2010, at 9:34 AM, Markus Krötzsch wrote: > On Sonntag, 27. Juni 2010, Laurent Alquier wrote: >> I set my PHP timeout limit to a very high value and let the RDF export run >> its course. >> >> The file was eventually generated, apparently without error. >> >> The RDF export contains what I expected to see - a list of properties for >> that one page. >> >> It also contains things I did not expect in that file - every pages that >> this page links to is also included in the file, along with their own >> properties. >> >> Is that how the RDF export is supposed to be ? > > This behaviour should normally be configurable and be disabled by default. > Maybe some change in SMW 1.5.1 affected the according setting or the place > where it is taken into account. Maybe you can check if the settings at [1] > need to be changed on your site. > > -- Markus > > [1] http://semantic-mediawiki.org/wiki/Help:Configuration#OWL.2FRDF_export > > >> >> On Jun 24, 2010, at 7:31 PM, Laurent Alquier wrote: >>> Hi all >>> >>> Has anyone experienced poor performance on RDF exports since the upgrade >>> to 1.5.1 ? >>> >>> Most of my pages flat out time out on the Special:ExportRDF page, even >>> after bumping up PHP timeouts to 240 seconds. >>> >>> On pages that do come out (pages with only a handful of properties >>> declared... as in less than 5) the RDF file seems to contain more details >>> than I remember. In particular, I don't remember seeing that many details >>> about pages linked to from the current page. >>> >>> Can someone familiar with the internals of the RDF export double check >>> that things are ok ? >>> >>> I don't have a very high number of properties or properties values >>> compared to some other SMW instances I know of. I didn't notice any slow >>> down in SMW queries either, and Special:Browse is very responsive. >>> >>> The problem seems to be contained to ExportRDF so far. >> > > > -- > Markus Krötzsch <ma...@se...> > * Personal page: http://korrekt.org > * Semantic MediaWiki: http://semantic-mediawiki.org > * Semantic Web textbook: http://semantic-web-book.org > -- |
From: Jeroen De D. <jer...@gm...> - 2010-06-27 17:01:30
|
Hey, Just a guess, but this might be caused by the changes Yaron made for allowing SIO to hook into the RDF export. Cheers -- Jeroen De Dauw * http://blog.bn2vs.com * http://wiki.bn2vs.com Don't panic. Don't be evil. 50 72 6F 67 72 61 6D 6D 69 6E 67 20 34 20 6C 69 66 65! -- On 27 June 2010 18:58, Laurent Alquier <la...@al...> wrote: > I turned off recursive export and backlink export at the end of my > LocalSettings.php file and the RDF export remains just as big. > > - Laurent > > On Jun 27, 2010, at 9:34 AM, Markus Krötzsch wrote: > > > On Sonntag, 27. Juni 2010, Laurent Alquier wrote: > >> I set my PHP timeout limit to a very high value and let the RDF export > run > >> its course. > >> > >> The file was eventually generated, apparently without error. > >> > >> The RDF export contains what I expected to see - a list of properties > for > >> that one page. > >> > >> It also contains things I did not expect in that file - every pages that > >> this page links to is also included in the file, along with their own > >> properties. > >> > >> Is that how the RDF export is supposed to be ? > > > > This behaviour should normally be configurable and be disabled by > default. > > Maybe some change in SMW 1.5.1 affected the according setting or the > place > > where it is taken into account. Maybe you can check if the settings at > [1] > > need to be changed on your site. > > > > -- Markus > > > > [1] > http://semantic-mediawiki.org/wiki/Help:Configuration#OWL.2FRDF_export > > > > > >> > >> On Jun 24, 2010, at 7:31 PM, Laurent Alquier wrote: > >>> Hi all > >>> > >>> Has anyone experienced poor performance on RDF exports since the > upgrade > >>> to 1.5.1 ? > >>> > >>> Most of my pages flat out time out on the Special:ExportRDF page, even > >>> after bumping up PHP timeouts to 240 seconds. > >>> > >>> On pages that do come out (pages with only a handful of properties > >>> declared... as in less than 5) the RDF file seems to contain more > details > >>> than I remember. In particular, I don't remember seeing that many > details > >>> about pages linked to from the current page. > >>> > >>> Can someone familiar with the internals of the RDF export double check > >>> that things are ok ? > >>> > >>> I don't have a very high number of properties or properties values > >>> compared to some other SMW instances I know of. I didn't notice any > slow > >>> down in SMW queries either, and Special:Browse is very responsive. > >>> > >>> The problem seems to be contained to ExportRDF so far. > >> > > > > > > -- > > Markus Krötzsch <ma...@se...> > > * Personal page: http://korrekt.org > > * Semantic MediaWiki: http://semantic-mediawiki.org > > * Semantic Web textbook: http://semantic-web-book.org > > -- > > > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Sprint > What will you do first with EVO, the first 4G phone? > Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first > _______________________________________________ > Semediawiki-devel mailing list > Sem...@li... > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > |
From: Markus K. <ma...@se...> - 2010-06-28 07:55:46
|
On Sonntag, 27. Juni 2010, Jeroen De Dauw wrote: > Hey, > > Just a guess, but this might be caused by the changes Yaron made for > allowing SIO to hook into the RDF export. That might be an explanation; at least I do not recall any other changes that were made to the export besides some internal renaming. Yaron, would it be possible that your changes have such a huge negative effect on SMW performance? Also, I checked and could not find a problem with the recursive export settings. I also observe the problem on other sites now: PHP resource consumption is much higher than usual, and often the RDF export just fails. As a quick fix, I note that it is possible to return to SMW 1.5.0 at any time. Of course, one has to be sure that extensions are also happy with this (especially Semantic Maps has some dependencies on SMW 1.5.1). Markus > > On 27 June 2010 18:58, Laurent Alquier <la...@al...> wrote: > > I turned off recursive export and backlink export at the end of my > > LocalSettings.php file and the RDF export remains just as big. > > > > - Laurent > > > > On Jun 27, 2010, at 9:34 AM, Markus Krötzsch wrote: > > > On Sonntag, 27. Juni 2010, Laurent Alquier wrote: > > >> I set my PHP timeout limit to a very high value and let the RDF export > > > > run > > > > >> its course. > > >> > > >> The file was eventually generated, apparently without error. > > >> > > >> The RDF export contains what I expected to see - a list of properties > > > > for > > > > >> that one page. > > >> > > >> It also contains things I did not expect in that file - every pages > > >> that this page links to is also included in the file, along with their > > >> own properties. > > >> > > >> Is that how the RDF export is supposed to be ? > > > > > > This behaviour should normally be configurable and be disabled by > > > > default. > > > > > Maybe some change in SMW 1.5.1 affected the according setting or the > > > > place > > > > > where it is taken into account. Maybe you can check if the settings at > > > > [1] > > > > > need to be changed on your site. > > > > > > -- Markus > > > > > > [1] > > > > http://semantic-mediawiki.org/wiki/Help:Configuration#OWL.2FRDF_export > > > > >> On Jun 24, 2010, at 7:31 PM, Laurent Alquier wrote: > > >>> Hi all > > >>> > > >>> Has anyone experienced poor performance on RDF exports since the > > > > upgrade > > > > >>> to 1.5.1 ? > > >>> > > >>> Most of my pages flat out time out on the Special:ExportRDF page, > > >>> even after bumping up PHP timeouts to 240 seconds. > > >>> > > >>> On pages that do come out (pages with only a handful of properties > > >>> declared... as in less than 5) the RDF file seems to contain more > > > > details > > > > >>> than I remember. In particular, I don't remember seeing that many > > > > details > > > > >>> about pages linked to from the current page. > > >>> > > >>> Can someone familiar with the internals of the RDF export double > > >>> check that things are ok ? > > >>> > > >>> I don't have a very high number of properties or properties values > > >>> compared to some other SMW instances I know of. I didn't notice any > > > > slow > > > > >>> down in SMW queries either, and Special:Browse is very responsive. > > >>> > > >>> The problem seems to be contained to ExportRDF so far. > > > > > > -- > > > Markus Krötzsch <ma...@se...> > > > * Personal page: http://korrekt.org > > > * Semantic MediaWiki: http://semantic-mediawiki.org > > > * Semantic Web textbook: http://semantic-web-book.org > > > -- > > > > ------------------------------------------------------------------------- > >----- This SF.net email is sponsored by Sprint > > What will you do first with EVO, the first 4G phone? > > Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first > > _______________________________________________ > > Semediawiki-devel mailing list > > Sem...@li... > > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > -- Markus Krötzsch <ma...@se...> * Personal page: http://korrekt.org * Semantic MediaWiki: http://semantic-mediawiki.org * Semantic Web textbook: http://semantic-web-book.org -- |
From: Yaron K. <ya...@gm...> - 2010-06-29 01:56:55
|
Hi Markus, I doubt that that's the issue - I just ran Special:RDFExport on discoursedb.org and saw the same issue, of RDF being generated for pages that the relevant page points to; and the same problem happened even when I commented out the hook that SMW uses. Laurent or Markus - feel free to try it out yourselves: the relevant line is the wfRunHooks() call on line 635 of /includes/export/SMW_OWLExport.php. -Yaron On Mon, Jun 28, 2010 at 3:55 AM, Markus Krötzsch < ma...@se...> wrote: > On Sonntag, 27. Juni 2010, Jeroen De Dauw wrote: > > Hey, > > > > Just a guess, but this might be caused by the changes Yaron made for > > allowing SIO to hook into the RDF export. > > That might be an explanation; at least I do not recall any other changes > that > were made to the export besides some internal renaming. Yaron, would it be > possible that your changes have such a huge negative effect on SMW > performance? > > Also, I checked and could not find a problem with the recursive export > settings. I also observe the problem on other sites now: PHP resource > consumption is much higher than usual, and often the RDF export just fails. > > As a quick fix, I note that it is possible to return to SMW 1.5.0 at any > time. > Of course, one has to be sure that extensions are also happy with this > (especially Semantic Maps has some dependencies on SMW 1.5.1). > > Markus > > > > > On 27 June 2010 18:58, Laurent Alquier <la...@al...> wrote: > > > I turned off recursive export and backlink export at the end of my > > > LocalSettings.php file and the RDF export remains just as big. > > > > > > - Laurent > > > > > > On Jun 27, 2010, at 9:34 AM, Markus Krötzsch wrote: > > > > On Sonntag, 27. Juni 2010, Laurent Alquier wrote: > > > >> I set my PHP timeout limit to a very high value and let the RDF > export > > > > > > run > > > > > > >> its course. > > > >> > > > >> The file was eventually generated, apparently without error. > > > >> > > > >> The RDF export contains what I expected to see - a list of > properties > > > > > > for > > > > > > >> that one page. > > > >> > > > >> It also contains things I did not expect in that file - every pages > > > >> that this page links to is also included in the file, along with > their > > > >> own properties. > > > >> > > > >> Is that how the RDF export is supposed to be ? > > > > > > > > This behaviour should normally be configurable and be disabled by > > > > > > default. > > > > > > > Maybe some change in SMW 1.5.1 affected the according setting or the > > > > > > place > > > > > > > where it is taken into account. Maybe you can check if the settings > at > > > > > > [1] > > > > > > > need to be changed on your site. > > > > > > > > -- Markus > > > > > > > > [1] > > > > > > http://semantic-mediawiki.org/wiki/Help:Configuration#OWL.2FRDF_export > > > > > > >> On Jun 24, 2010, at 7:31 PM, Laurent Alquier wrote: > > > >>> Hi all > > > >>> > > > >>> Has anyone experienced poor performance on RDF exports since the > > > > > > upgrade > > > > > > >>> to 1.5.1 ? > > > >>> > > > >>> Most of my pages flat out time out on the Special:ExportRDF page, > > > >>> even after bumping up PHP timeouts to 240 seconds. > > > >>> > > > >>> On pages that do come out (pages with only a handful of properties > > > >>> declared... as in less than 5) the RDF file seems to contain more > > > > > > details > > > > > > >>> than I remember. In particular, I don't remember seeing that many > > > > > > details > > > > > > >>> about pages linked to from the current page. > > > >>> > > > >>> Can someone familiar with the internals of the RDF export double > > > >>> check that things are ok ? > > > >>> > > > >>> I don't have a very high number of properties or properties values > > > >>> compared to some other SMW instances I know of. I didn't notice any > > > > > > slow > > > > > > >>> down in SMW queries either, and Special:Browse is very responsive. > > > >>> > > > >>> The problem seems to be contained to ExportRDF so far. > > > > > > > > -- > > > > Markus Krötzsch <ma...@se...> > > > > * Personal page: http://korrekt.org > > > > * Semantic MediaWiki: http://semantic-mediawiki.org > > > > * Semantic Web textbook: http://semantic-web-book.org > > > > -- > > > > > > > ------------------------------------------------------------------------- > > >----- This SF.net email is sponsored by Sprint > > > What will you do first with EVO, the first 4G phone? > > > Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first > > > _______________________________________________ > > > Semediawiki-devel mailing list > > > Sem...@li... > > > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > > > > > -- > Markus Krötzsch <ma...@se...> > * Personal page: http://korrekt.org > * Semantic MediaWiki: http://semantic-mediawiki.org > * Semantic Web textbook: http://semantic-web-book.org > -- > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Sprint > What will you do first with EVO, the first 4G phone? > Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first > _______________________________________________ > Semediawiki-devel mailing list > Sem...@li... > https://lists.sourceforge.net/lists/listinfo/semediawiki-devel > > -- WikiWorks · MediaWiki Consulting · http://wikiworks.com |