From: kevin s. <as...@gm...> - 2011-04-25 15:47:20
|
Hi there, I recently saw a couple of presentations about VuFind, and I got very excited about the possibilities for our library system. I have installed it on Vmware, uploaded our records and have it talking to our Horizon system. At this point, I am very interested to know if there are any consultants out there that would be able to help my team tweak things and give me some best practices for getting things going live and running smoothly. WCPL has 20 locations in North Carolina and we have something over 1.5 million items. At this point, I am just trying to get a ballpark figure for planning purposes. If interested, or if you know someone who might be interested, please let me know. Thanks so much, Kevin -- Kevin Smith Digital Library Manager Wake County Public Libraries 919-250-1108 |
From: waynelam <way...@ln...> - 2011-04-26 09:14:58
|
Hi, I have recently freshly installed latest version of VuFind. I've imported some of the records (around 1000 records). I experienced slow response while accessing by opening record only but not searching. For instance, http://my.vufind.address/vufind/Record/37046205 I tried to access solr directly to the specific record (id=37046205), it response fast without problem. I suspect the slow may come from the plugins. I tried to disable them by commenting out "OpenURL", "OAI", "Catalog", etc but still no luck. Someone know how to track this? The log wouldn't show me anything. my config.ini: [System] available = true debug = true [Site] path = /vufind url = http://vufind.my.edu/vufind local = /var/www/vufind/web email = ad...@vu... title = "vufind.my.edu" theme = default mobile_theme = mobile language = en ; default -- more options available in [Languages] below. locale = en_US timezone = "Asia/Hong_Kong" defaultModule = Search defaultRecordTab= Holdings [Session] type = MySQLSession lifetime = 3600 ; Session lasts for 1 hour file_save_path = /tmp/vufind_sessions [Catalog] driver = Innovative [Authentication] method = ILS [Statistics] enabled = false solr = http://localhost:8080/solr [Index] engine = Solr url = http://localhost:8080/solr local = /var/www/vufind/solr default_core = biblio [Mail] host = mail.my.edu port = 25 [Database] database = mysql://user:pass@localhost/catalog schema_location = /var/www/vufind/web/conf class_location = /var/www/vufind/web/services/MyResearch/lib require_prefix = class_prefix = debug = 0 [Content] authors = Wikipedia [Proxy] [Spelling] enabled = true limit = 3 phrase = false expand = true simple = false skip_numeric = true [Logging] file = /var/log/vufind/messages.log:alert,error,notice,debug [Extra_Config] facets = facets.ini ; settings affecting faceting in UI searches = searches.ini ; search definitions and preferences [Languages] en = "English" de = "German" es = "Spanish" fr = "French" it = "Italian" ja = "Japanese" nl = "Dutch" pt-br = "Brazilian Portugese" zh-cn = "Simplified Chinese" zh = "Chinese" tr = "Turkish" he = "Hebrew" ga = "Irish" [Browse] result_limit = 100 dewey = false ; allow browsing of Dewey Decimal call numbers lcc = true ; allow browsing of LC call numbers [Export] RefWorks = true EndNote = false MARC = true RDF = true [Item_Status] multiple_call_nos = first multiple_locations = msg [Record] next_prev_navigation = false |
From: Eoghan Ó C. <eog...@gm...> - 2011-04-26 10:10:17
|
Hi, I think this could be to do with your proxy settings. Line 148 ($editions = $this->recordDriver->getEditions();) in /web/services/Record/Record.php attempts to access OCLC/Worldcat to get other editions of the same book (via /web/RecordDrivers/IndexRecord.php and /web/sys/WorldCatUtils.php). Normally this is very quick, but if you are behind a proxy and it isn't configured under [Proxy] in config.ini, I've noticed that this can really slow down the record page, presumably because it is waiting on a timeout for the service. If you can't configure the proxy, try commenting out the following lines in /web/services/Record/Record.php as a test: // Find Other Editions //$editions = $this->recordDriver->getEditions(); //if (!PEAR::isError($editions)) { // $interface->assign('editions', $editions); //} All the best, Eoghan On 26 April 2011 09:46, waynelam <way...@ln...> wrote: > Hi, > > I have recently freshly installed latest version of VuFind. I've imported > some of the records (around 1000 records). I experienced slow response > while accessing by opening record only but not searching. For instance, > > http://my.vufind.address/vufind/Record/37046205 > > I tried to access solr directly to the specific record (id=37046205), it > response fast without problem. > I suspect the slow may come from the plugins. I tried to disable > them by commenting out "OpenURL", "OAI", "Catalog", etc but still no luck. > > Someone know how to track this? The log wouldn't show me anything. > > > > my config.ini: > > [System] > available = true > debug = true > [Site] > path = /vufind > url = http://vufind.my.edu/vufind > local = /var/www/vufind/web > email = ad...@vu... > title = "vufind.my.edu" > theme = default > mobile_theme = mobile > language = en ; default -- more options available in > [Languages] below. > locale = en_US > timezone = "Asia/Hong_Kong" > defaultModule = Search > defaultRecordTab= Holdings > [Session] > type = MySQLSession > lifetime = 3600 ; Session lasts for 1 hour > file_save_path = /tmp/vufind_sessions > [Catalog] > driver = Innovative > [Authentication] > method = ILS > [Statistics] > enabled = false > solr = http://localhost:8080/solr > [Index] > engine = Solr > url = http://localhost:8080/solr > local = /var/www/vufind/solr > default_core = biblio > [Mail] > host = mail.my.edu > port = 25 > [Database] > database = mysql://user:pass@localhost/catalog > schema_location = /var/www/vufind/web/conf > class_location = /var/www/vufind/web/services/MyResearch/lib > require_prefix = > class_prefix = > debug = 0 > > [Content] > authors = Wikipedia > > [Proxy] > [Spelling] > enabled = true > limit = 3 > phrase = false > expand = true > simple = false > skip_numeric = true > [Logging] > file = /var/log/vufind/messages.log:alert,error,notice,debug > [Extra_Config] > facets = facets.ini ; settings affecting faceting in UI > searches = searches.ini ; search definitions and preferences > [Languages] > en = "English" > de = "German" > es = "Spanish" > fr = "French" > it = "Italian" > ja = "Japanese" > nl = "Dutch" > pt-br = "Brazilian Portugese" > zh-cn = "Simplified Chinese" > zh = "Chinese" > tr = "Turkish" > he = "Hebrew" > ga = "Irish" > > [Browse] > result_limit = 100 > dewey = false ; allow browsing of Dewey Decimal call numbers > lcc = true ; allow browsing of LC call numbers > > [Export] > RefWorks = true > EndNote = false > MARC = true > RDF = true > > > [Item_Status] > multiple_call_nos = first > multiple_locations = msg > > [Record] > next_prev_navigation = false > > > > > ------------------------------------------------------------------------------ > WhatsUp Gold - Download Free Network Management Software > The most intuitive, comprehensive, and cost-effective network > management toolset available today. Delivers lowest initial > acquisition cost and overall TCO of any competing solution. > http://p.sf.net/sfu/whatsupgold-sd > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > |
From: Demian K. <dem...@vi...> - 2011-04-26 12:48:47
|
OCLC does seem like the most significant likely bottleneck... but if that doesn't help, another thing to look at is the ILS driver. Does it get faster if you switch your driver from "Innovative" to "Sample"? (Obviously, that's not a long-term fix - but if the Innovative driver is causing a slowdown, switching temporarily to the do-nothing Sample driver should prove the theory). - Demian From: Eoghan Ó Carragáin [mailto:eog...@gm...] Sent: Tuesday, April 26, 2011 6:10 AM To: waynelam Cc: vuf...@li... Subject: Re: [VuFind-General] VuFind performance? Hi, I think this could be to do with your proxy settings. Line 148 ($editions = $this->recordDriver->getEditions();) in /web/services/Record/Record.php attempts to access OCLC/Worldcat to get other editions of the same book (via /web/RecordDrivers/IndexRecord.php and /web/sys/WorldCatUtils.php). Normally this is very quick, but if you are behind a proxy and it isn't configured under [Proxy] in config.ini, I've noticed that this can really slow down the record page, presumably because it is waiting on a timeout for the service. If you can't configure the proxy, try commenting out the following lines in /web/services/Record/Record.php as a test: // Find Other Editions //$editions = $this->recordDriver->getEditions(); //if (!PEAR::isError($editions)) { // $interface->assign('editions', $editions); //} All the best, Eoghan On 26 April 2011 09:46, waynelam <way...@ln...<mailto:way...@ln...>> wrote: Hi, I have recently freshly installed latest version of VuFind. I've imported some of the records (around 1000 records). I experienced slow response while accessing by opening record only but not searching. For instance, http://my.vufind.address/vufind/Record/37046205 I tried to access solr directly to the specific record (id=37046205), it response fast without problem. I suspect the slow may come from the plugins. I tried to disable them by commenting out "OpenURL", "OAI", "Catalog", etc but still no luck. Someone know how to track this? The log wouldn't show me anything. my config.ini: [System] available = true debug = true [Site] path = /vufind url = http://vufind.my.edu/vufind local = /var/www/vufind/web email = ad...@vu...<mailto:ad...@vu...> title = "vufind.my.edu<http://vufind.my.edu>" theme = default mobile_theme = mobile language = en ; default -- more options available in [Languages] below. locale = en_US timezone = "Asia/Hong_Kong" defaultModule = Search defaultRecordTab= Holdings [Session] type = MySQLSession lifetime = 3600 ; Session lasts for 1 hour file_save_path = /tmp/vufind_sessions [Catalog] driver = Innovative [Authentication] method = ILS [Statistics] enabled = false solr = http://localhost:8080/solr [Index] engine = Solr url = http://localhost:8080/solr local = /var/www/vufind/solr default_core = biblio [Mail] host = mail.my.edu<http://mail.my.edu> port = 25 [Database] database = mysql://user:pass@localhost/catalog schema_location = /var/www/vufind/web/conf class_location = /var/www/vufind/web/services/MyResearch/lib require_prefix = class_prefix = debug = 0 [Content] authors = Wikipedia [Proxy] [Spelling] enabled = true limit = 3 phrase = false expand = true simple = false skip_numeric = true [Logging] file = /var/log/vufind/messages.log:alert,error,notice,debug [Extra_Config] facets = facets.ini ; settings affecting faceting in UI searches = searches.ini ; search definitions and preferences [Languages] en = "English" de = "German" es = "Spanish" fr = "French" it = "Italian" ja = "Japanese" nl = "Dutch" pt-br = "Brazilian Portugese" zh-cn = "Simplified Chinese" zh = "Chinese" tr = "Turkish" he = "Hebrew" ga = "Irish" [Browse] result_limit = 100 dewey = false ; allow browsing of Dewey Decimal call numbers lcc = true ; allow browsing of LC call numbers [Export] RefWorks = true EndNote = false MARC = true RDF = true [Item_Status] multiple_call_nos = first multiple_locations = msg [Record] next_prev_navigation = false ------------------------------------------------------------------------------ WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd _______________________________________________ VuFind-General mailing list VuF...@li...<mailto:VuF...@li...> https://lists.sourceforge.net/lists/listinfo/vufind-general |
From: waynelam <way...@ln...> - 2011-04-26 13:16:30
|
I followed Eoghan's method and tried comment it and it did the trick. But the problem is i am not behind any proxy. The server is using true IP and behind firewall. I 've tried accessing WorldCat directly using lynx. It doesn't seems so slow and response pretty fast. e.g. http://xisbn.worldcat.org/webservices/xid/isbn/0071736751?method=getEditions&format=csv I have experienced similar problem in some other case in using php function file_get_contents to access other webpages. Last time i fix this kind of issues is switching to cURL php functions. Could this issue be a similar case? Regards, Wayne On 4/26/2011 8:48 PM, Demian Katz wrote: > > OCLC does seem like the most significant likely bottleneck... but if > that doesn't help, another thing to look at is the ILS driver. Does > it get faster if you switch your driver from "Innovative" to > "Sample"? (Obviously, that's not a long-term fix -- but if the > Innovative driver is causing a slowdown, switching temporarily to the > do-nothing Sample driver should prove the theory). > > - Demian > > *From:*Eoghan Ó Carragáin [mailto:eog...@gm...] > *Sent:* Tuesday, April 26, 2011 6:10 AM > *To:* waynelam > *Cc:* vuf...@li... > *Subject:* Re: [VuFind-General] VuFind performance? > > Hi, > I think this could be to do with your proxy settings. Line 148 > ($editions = $this->recordDriver->getEditions();) in > /web/services/Record/Record.php attempts to access OCLC/Worldcat to > get other editions of the same book (via > /web/RecordDrivers/IndexRecord.php and /web/sys/WorldCatUtils.php). > Normally this is very quick, but if you are behind a proxy and it > isn't configured under [Proxy] in config.ini, I've noticed that this > can really slow down the record page, presumably because it is waiting > on a timeout for the service. If you can't configure the proxy, try > commenting out the following lines in /web/services/Record/Record.php > as a test: > // Find Other Editions > //$editions = $this->recordDriver->getEditions(); > //if (!PEAR::isError($editions)) { > // $interface->assign('editions', $editions); > //} > All the best, > Eoghan > > On 26 April 2011 09:46, waynelam <way...@ln... > <mailto:way...@ln...>> wrote: > > Hi, > > I have recently freshly installed latest version of VuFind. I've imported > some of the records (around 1000 records). I experienced slow response > while accessing by opening record only but not searching. For instance, > > http://my.vufind.address/vufind/Record/37046205 > > I tried to access solr directly to the specific record (id=37046205), it > response fast without problem. > I suspect the slow may come from the plugins. I tried to disable > them by commenting out "OpenURL", "OAI", "Catalog", etc but still no luck. > > Someone know how to track this? The log wouldn't show me anything. > > > > my config.ini: > > [System] > available = true > debug = true > [Site] > path = /vufind > url = http://vufind.my.edu/vufind > local = /var/www/vufind/web > email = ad...@vu... <mailto:ad...@vu...> > title = "vufind.my.edu <http://vufind.my.edu>" > theme = default > mobile_theme = mobile > language = en ; default -- more options available in > [Languages] below. > locale = en_US > timezone = "Asia/Hong_Kong" > defaultModule = Search > defaultRecordTab= Holdings > [Session] > type = MySQLSession > lifetime = 3600 ; Session lasts for 1 hour > file_save_path = /tmp/vufind_sessions > [Catalog] > driver = Innovative > [Authentication] > method = ILS > [Statistics] > enabled = false > solr = http://localhost:8080/solr > [Index] > engine = Solr > url = http://localhost:8080/solr > local = /var/www/vufind/solr > default_core = biblio > [Mail] > host = mail.my.edu <http://mail.my.edu> > port = 25 > [Database] > database = mysql://user:pass@localhost/catalog > schema_location = /var/www/vufind/web/conf > class_location = /var/www/vufind/web/services/MyResearch/lib > require_prefix = > class_prefix = > debug = 0 > > [Content] > authors = Wikipedia > > [Proxy] > [Spelling] > enabled = true > limit = 3 > phrase = false > expand = true > simple = false > skip_numeric = true > [Logging] > file = /var/log/vufind/messages.log:alert,error,notice,debug > [Extra_Config] > facets = facets.ini ; settings affecting faceting in UI > searches = searches.ini ; search definitions and preferences > [Languages] > en = "English" > de = "German" > es = "Spanish" > fr = "French" > it = "Italian" > ja = "Japanese" > nl = "Dutch" > pt-br = "Brazilian Portugese" > zh-cn = "Simplified Chinese" > zh = "Chinese" > tr = "Turkish" > he = "Hebrew" > ga = "Irish" > > [Browse] > result_limit = 100 > dewey = false ; allow browsing of Dewey Decimal call numbers > lcc = true ; allow browsing of LC call numbers > > [Export] > RefWorks = true > EndNote = false > MARC = true > RDF = true > > > [Item_Status] > multiple_call_nos = first > multiple_locations = msg > > [Record] > next_prev_navigation = false > > > > ------------------------------------------------------------------------------ > WhatsUp Gold - Download Free Network Management Software > The most intuitive, comprehensive, and cost-effective network > management toolset available today. Delivers lowest initial > acquisition cost and overall TCO of any competing solution. > http://p.sf.net/sfu/whatsupgold-sd > _______________________________________________ > VuFind-General mailing list > VuF...@li... > <mailto:VuF...@li...> > https://lists.sourceforge.net/lists/listinfo/vufind-general > -- ----------------------------------------- Wayne Lam Assistant Library Officer I Systems Development& Support Fong Sum Wood Library Lingnan University 8 Castle Peak Road Tuen Mun, New Territories Hong Kong SAR China Phone: +852 26168585 Email: way...@ln... Website: http://www.library.ln.edu.hk |
From: Demian K. <dem...@vi...> - 2011-04-26 13:18:52
|
It's possible that file_get_contents is to blame. Really, for consistency with the rest of the code, it would be better if the OCLC functions used the Proxy_Request class (a child of the standard PEAR HTTP_Request) for data retrieval. If you have time to switch the code over and would be willing to share a patch showing the fix, I'd be happy to include that in the trunk for future convenience. - Demian From: waynelam [mailto:way...@ln...] Sent: Tuesday, April 26, 2011 9:16 AM To: Demian Katz Cc: Eoghan Ó Carragáin; vuf...@li... Subject: Re: [VuFind-General] VuFind performance? I followed Eoghan's method and tried comment it and it did the trick. But the problem is i am not behind any proxy. The server is using true IP and behind firewall. I 've tried accessing WorldCat directly using lynx. It doesn't seems so slow and response pretty fast. e.g. http://xisbn.worldcat.org/webservices/xid/isbn/0071736751?method=getEditions&format=csv I have experienced similar problem in some other case in using php function file_get_contents to access other webpages. Last time i fix this kind of issues is switching to cURL php functions. Could this issue be a similar case? Regards, Wayne On 4/26/2011 8:48 PM, Demian Katz wrote: OCLC does seem like the most significant likely bottleneck... but if that doesn't help, another thing to look at is the ILS driver. Does it get faster if you switch your driver from "Innovative" to "Sample"? (Obviously, that's not a long-term fix - but if the Innovative driver is causing a slowdown, switching temporarily to the do-nothing Sample driver should prove the theory). - Demian From: Eoghan Ó Carragáin [mailto:eog...@gm...] Sent: Tuesday, April 26, 2011 6:10 AM To: waynelam Cc: vuf...@li...<mailto:vuf...@li...> Subject: Re: [VuFind-General] VuFind performance? Hi, I think this could be to do with your proxy settings. Line 148 ($editions = $this->recordDriver->getEditions();) in /web/services/Record/Record.php attempts to access OCLC/Worldcat to get other editions of the same book (via /web/RecordDrivers/IndexRecord.php and /web/sys/WorldCatUtils.php). Normally this is very quick, but if you are behind a proxy and it isn't configured under [Proxy] in config.ini, I've noticed that this can really slow down the record page, presumably because it is waiting on a timeout for the service. If you can't configure the proxy, try commenting out the following lines in /web/services/Record/Record.php as a test: // Find Other Editions //$editions = $this->recordDriver->getEditions(); //if (!PEAR::isError($editions)) { // $interface->assign('editions', $editions); //} All the best, Eoghan On 26 April 2011 09:46, waynelam <way...@ln...<mailto:way...@ln...>> wrote: Hi, I have recently freshly installed latest version of VuFind. I've imported some of the records (around 1000 records). I experienced slow response while accessing by opening record only but not searching. For instance, http://my.vufind.address/vufind/Record/37046205 I tried to access solr directly to the specific record (id=37046205), it response fast without problem. I suspect the slow may come from the plugins. I tried to disable them by commenting out "OpenURL", "OAI", "Catalog", etc but still no luck. Someone know how to track this? The log wouldn't show me anything. my config.ini: [System] available = true debug = true [Site] path = /vufind url = http://vufind.my.edu/vufind local = /var/www/vufind/web email = ad...@vu...<mailto:ad...@vu...> title = "vufind.my.edu<http://vufind.my.edu>" theme = default mobile_theme = mobile language = en ; default -- more options available in [Languages] below. locale = en_US timezone = "Asia/Hong_Kong" defaultModule = Search defaultRecordTab= Holdings [Session] type = MySQLSession lifetime = 3600 ; Session lasts for 1 hour file_save_path = /tmp/vufind_sessions [Catalog] driver = Innovative [Authentication] method = ILS [Statistics] enabled = false solr = http://localhost:8080/solr [Index] engine = Solr url = http://localhost:8080/solr local = /var/www/vufind/solr default_core = biblio [Mail] host = mail.my.edu<http://mail.my.edu> port = 25 [Database] database = mysql://user:pass@localhost/catalog schema_location = /var/www/vufind/web/conf class_location = /var/www/vufind/web/services/MyResearch/lib require_prefix = class_prefix = debug = 0 [Content] authors = Wikipedia [Proxy] [Spelling] enabled = true limit = 3 phrase = false expand = true simple = false skip_numeric = true [Logging] file = /var/log/vufind/messages.log:alert,error,notice,debug [Extra_Config] facets = facets.ini ; settings affecting faceting in UI searches = searches.ini ; search definitions and preferences [Languages] en = "English" de = "German" es = "Spanish" fr = "French" it = "Italian" ja = "Japanese" nl = "Dutch" pt-br = "Brazilian Portugese" zh-cn = "Simplified Chinese" zh = "Chinese" tr = "Turkish" he = "Hebrew" ga = "Irish" [Browse] result_limit = 100 dewey = false ; allow browsing of Dewey Decimal call numbers lcc = true ; allow browsing of LC call numbers [Export] RefWorks = true EndNote = false MARC = true RDF = true [Item_Status] multiple_call_nos = first multiple_locations = msg [Record] next_prev_navigation = false ------------------------------------------------------------------------------ WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd _______________________________________________ VuFind-General mailing list VuF...@li...<mailto:VuF...@li...> https://lists.sourceforge.net/lists/listinfo/vufind-general -- ----------------------------------------- Wayne Lam Assistant Library Officer I Systems Development & Support Fong Sum Wood Library Lingnan University 8 Castle Peak Road Tuen Mun, New Territories Hong Kong SAR China Phone: +852 26168585 Email: way...@ln...<mailto:way...@ln...> Website: http://www.library.ln.edu.hk |
From: waynelam <way...@ln...> - 2011-04-27 10:17:05
|
After some testing, the problem comes from WorldCatUtils.php on the line $fp = @fopen($url, "r") Somehow it just stuck in here and wait until timeout, i don't know why. But i don't think it is kind of a "bug" because i am sure the code works fine in other machines / network. I tried switch the code using Proxy_Request class and it works now. I am not sure i should change this because i can see "file_get_contents" and "fopen" at some other place too. I think i need some more investigation on this coz this issues had haunting me for a long time Wayne On 4/26/2011 9:18 PM, Demian Katz wrote: > > It's possible that file_get_contents is to blame. Really, for > consistency with the rest of the code, it would be better if the OCLC > functions used the Proxy_Request class (a child of the standard PEAR > HTTP_Request) for data retrieval. If you have time to switch the code > over and would be willing to share a patch showing the fix, I'd be > happy to include that in the trunk for future convenience. > > - Demian > > *From:*waynelam [mailto:way...@ln...] > *Sent:* Tuesday, April 26, 2011 9:16 AM > *To:* Demian Katz > *Cc:* Eoghan Ó Carragáin; vuf...@li... > *Subject:* Re: [VuFind-General] VuFind performance? > > I followed Eoghan's method and tried comment it and it did the trick. > But the problem is i am not behind any proxy. The server is using true > IP and behind firewall. > I 've tried accessing WorldCat directly using lynx. It doesn't seems > so slow and response pretty fast. > > e.g. > http://xisbn.worldcat.org/webservices/xid/isbn/0071736751?method=getEditions&format=csv > <http://xisbn.worldcat.org/webservices/xid/isbn/0071736751?method=getEditions&format=csv> > > I have experienced similar problem in some other case in using php function file_get_contents to > access other webpages. Last time i fix this kind of issues is switching to cURL php functions. > Could this issue be a similar case? > > Regards, > Wayne > > > On 4/26/2011 8:48 PM, Demian Katz wrote: > > OCLC does seem like the most significant likely bottleneck... but if > that doesn't help, another thing to look at is the ILS driver. Does > it get faster if you switch your driver from "Innovative" to > "Sample"? (Obviously, that's not a long-term fix -- but if the > Innovative driver is causing a slowdown, switching temporarily to the > do-nothing Sample driver should prove the theory). > > - Demian > > *From:*Eoghan Ó Carragáin [mailto:eog...@gm...] > *Sent:* Tuesday, April 26, 2011 6:10 AM > *To:* waynelam > *Cc:* vuf...@li... > <mailto:vuf...@li...> > *Subject:* Re: [VuFind-General] VuFind performance? > > Hi, > I think this could be to do with your proxy settings. Line 148 > ($editions = $this->recordDriver->getEditions();) in > /web/services/Record/Record.php attempts to access OCLC/Worldcat to > get other editions of the same book (via > /web/RecordDrivers/IndexRecord.php and /web/sys/WorldCatUtils.php). > Normally this is very quick, but if you are behind a proxy and it > isn't configured under [Proxy] in config.ini, I've noticed that this > can really slow down the record page, presumably because it is waiting > on a timeout for the service. If you can't configure the proxy, try > commenting out the following lines in /web/services/Record/Record.php > as a test: > // Find Other Editions > //$editions = $this->recordDriver->getEditions(); > //if (!PEAR::isError($editions)) { > // $interface->assign('editions', $editions); > //} > All the best, > Eoghan > > On 26 April 2011 09:46, waynelam <way...@ln... > <mailto:way...@ln...>> wrote: > > Hi, > > I have recently freshly installed latest version of VuFind. I've imported > some of the records (around 1000 records). I experienced slow response > while accessing by opening record only but not searching. For instance, > > http://my.vufind.address/vufind/Record/37046205 > > I tried to access solr directly to the specific record (id=37046205), it > response fast without problem. > I suspect the slow may come from the plugins. I tried to disable > them by commenting out "OpenURL", "OAI", "Catalog", etc but still no luck. > > Someone know how to track this? The log wouldn't show me anything. > > > > my config.ini: > > [System] > available = true > debug = true > [Site] > path = /vufind > url = http://vufind.my.edu/vufind > local = /var/www/vufind/web > email = ad...@vu... <mailto:ad...@vu...> > title = "vufind.my.edu <http://vufind.my.edu>" > theme = default > mobile_theme = mobile > language = en ; default -- more options available in > [Languages] below. > locale = en_US > timezone = "Asia/Hong_Kong" > defaultModule = Search > defaultRecordTab= Holdings > [Session] > type = MySQLSession > lifetime = 3600 ; Session lasts for 1 hour > file_save_path = /tmp/vufind_sessions > [Catalog] > driver = Innovative > [Authentication] > method = ILS > [Statistics] > enabled = false > solr = http://localhost:8080/solr > [Index] > engine = Solr > url = http://localhost:8080/solr > local = /var/www/vufind/solr > default_core = biblio > [Mail] > host = mail.my.edu <http://mail.my.edu> > port = 25 > [Database] > database = mysql://user:pass@localhost/catalog > schema_location = /var/www/vufind/web/conf > class_location = /var/www/vufind/web/services/MyResearch/lib > require_prefix = > class_prefix = > debug = 0 > > [Content] > authors = Wikipedia > > [Proxy] > [Spelling] > enabled = true > limit = 3 > phrase = false > expand = true > simple = false > skip_numeric = true > [Logging] > file = /var/log/vufind/messages.log:alert,error,notice,debug > [Extra_Config] > facets = facets.ini ; settings affecting faceting in UI > searches = searches.ini ; search definitions and preferences > [Languages] > en = "English" > de = "German" > es = "Spanish" > fr = "French" > it = "Italian" > ja = "Japanese" > nl = "Dutch" > pt-br = "Brazilian Portugese" > zh-cn = "Simplified Chinese" > zh = "Chinese" > tr = "Turkish" > he = "Hebrew" > ga = "Irish" > > [Browse] > result_limit = 100 > dewey = false ; allow browsing of Dewey Decimal call numbers > lcc = true ; allow browsing of LC call numbers > > [Export] > RefWorks = true > EndNote = false > MARC = true > RDF = true > > > [Item_Status] > multiple_call_nos = first > multiple_locations = msg > > [Record] > next_prev_navigation = false > > > > ------------------------------------------------------------------------------ > WhatsUp Gold - Download Free Network Management Software > The most intuitive, comprehensive, and cost-effective network > management toolset available today. Delivers lowest initial > acquisition cost and overall TCO of any competing solution. > http://p.sf.net/sfu/whatsupgold-sd > _______________________________________________ > VuFind-General mailing list > VuF...@li... > <mailto:VuF...@li...> > https://lists.sourceforge.net/lists/listinfo/vufind-general > > > > > -- > ----------------------------------------- > Wayne Lam > Assistant Library Officer I > Systems Development& Support > Fong Sum Wood Library > Lingnan University > 8 Castle Peak Road > Tuen Mun, New Territories > Hong Kong SAR > China > Phone: +852 26168585 > Email:way...@ln... <mailto:way...@ln...> > Website:http://www.library.ln.edu.hk -- ----------------------------------------- Wayne Lam Assistant Library Officer I Systems Development& Support Fong Sum Wood Library Lingnan University 8 Castle Peak Road Tuen Mun, New Territories Hong Kong SAR China Phone: +852 26168585 Email: way...@ln... Website: http://www.library.ln.edu.hk |
From: Demian K. <dem...@vi...> - 2011-04-27 12:57:03
|
If you take away the error suppressing @ on fopen, does it give you any helpful error/warning messages? That might be helpful for diagnosing the problem... but it's good to hear that switching to Proxy_Request helped! I definitely don't see a disadvantage to moving away from the fopen-based code; in fact, by changing the API request to use a JSON response instead of CSV, you could also eliminate the CSV-parsing code in favor of a json_decode and further simplify everything. - Demian From: waynelam [mailto:way...@ln...] Sent: Wednesday, April 27, 2011 6:17 AM Cc: vuf...@li... Subject: Re: [VuFind-General] VuFind performance? After some testing, the problem comes from WorldCatUtils.php on the line $fp = @fopen($url, "r") Somehow it just stuck in here and wait until timeout, i don't know why. But i don't think it is kind of a "bug" because i am sure the code works fine in other machines / network. I tried switch the code using Proxy_Request class and it works now. I am not sure i should change this because i can see "file_get_contents" and "fopen" at some other place too. I think i need some more investigation on this coz this issues had haunting me for a long time Wayne On 4/26/2011 9:18 PM, Demian Katz wrote: It's possible that file_get_contents is to blame. Really, for consistency with the rest of the code, it would be better if the OCLC functions used the Proxy_Request class (a child of the standard PEAR HTTP_Request) for data retrieval. If you have time to switch the code over and would be willing to share a patch showing the fix, I'd be happy to include that in the trunk for future convenience. - Demian From: waynelam [mailto:way...@ln...] Sent: Tuesday, April 26, 2011 9:16 AM To: Demian Katz Cc: Eoghan Ó Carragáin; vuf...@li...<mailto:vuf...@li...> Subject: Re: [VuFind-General] VuFind performance? I followed Eoghan's method and tried comment it and it did the trick. But the problem is i am not behind any proxy. The server is using true IP and behind firewall. I 've tried accessing WorldCat directly using lynx. It doesn't seems so slow and response pretty fast. e.g. http://xisbn.worldcat.org/webservices/xid/isbn/0071736751?method=getEditions&format=csv I have experienced similar problem in some other case in using php function file_get_contents to access other webpages. Last time i fix this kind of issues is switching to cURL php functions. Could this issue be a similar case? Regards, Wayne On 4/26/2011 8:48 PM, Demian Katz wrote: OCLC does seem like the most significant likely bottleneck... but if that doesn't help, another thing to look at is the ILS driver. Does it get faster if you switch your driver from "Innovative" to "Sample"? (Obviously, that's not a long-term fix - but if the Innovative driver is causing a slowdown, switching temporarily to the do-nothing Sample driver should prove the theory). - Demian From: Eoghan Ó Carragáin [mailto:eog...@gm...] Sent: Tuesday, April 26, 2011 6:10 AM To: waynelam Cc: vuf...@li...<mailto:vuf...@li...> Subject: Re: [VuFind-General] VuFind performance? Hi, I think this could be to do with your proxy settings. Line 148 ($editions = $this->recordDriver->getEditions();) in /web/services/Record/Record.php attempts to access OCLC/Worldcat to get other editions of the same book (via /web/RecordDrivers/IndexRecord.php and /web/sys/WorldCatUtils.php). Normally this is very quick, but if you are behind a proxy and it isn't configured under [Proxy] in config.ini, I've noticed that this can really slow down the record page, presumably because it is waiting on a timeout for the service. If you can't configure the proxy, try commenting out the following lines in /web/services/Record/Record.php as a test: // Find Other Editions //$editions = $this->recordDriver->getEditions(); //if (!PEAR::isError($editions)) { // $interface->assign('editions', $editions); //} All the best, Eoghan On 26 April 2011 09:46, waynelam <way...@ln...<mailto:way...@ln...>> wrote: Hi, I have recently freshly installed latest version of VuFind. I've imported some of the records (around 1000 records). I experienced slow response while accessing by opening record only but not searching. For instance, http://my.vufind.address/vufind/Record/37046205 I tried to access solr directly to the specific record (id=37046205), it response fast without problem. I suspect the slow may come from the plugins. I tried to disable them by commenting out "OpenURL", "OAI", "Catalog", etc but still no luck. Someone know how to track this? The log wouldn't show me anything. my config.ini: [System] available = true debug = true [Site] path = /vufind url = http://vufind.my.edu/vufind local = /var/www/vufind/web email = ad...@vu...<mailto:ad...@vu...> title = "vufind.my.edu<http://vufind.my.edu>" theme = default mobile_theme = mobile language = en ; default -- more options available in [Languages] below. locale = en_US timezone = "Asia/Hong_Kong" defaultModule = Search defaultRecordTab= Holdings [Session] type = MySQLSession lifetime = 3600 ; Session lasts for 1 hour file_save_path = /tmp/vufind_sessions [Catalog] driver = Innovative [Authentication] method = ILS [Statistics] enabled = false solr = http://localhost:8080/solr [Index] engine = Solr url = http://localhost:8080/solr local = /var/www/vufind/solr default_core = biblio [Mail] host = mail.my.edu<http://mail.my.edu> port = 25 [Database] database = mysql://user:pass@localhost/catalog schema_location = /var/www/vufind/web/conf class_location = /var/www/vufind/web/services/MyResearch/lib require_prefix = class_prefix = debug = 0 [Content] authors = Wikipedia [Proxy] [Spelling] enabled = true limit = 3 phrase = false expand = true simple = false skip_numeric = true [Logging] file = /var/log/vufind/messages.log:alert,error,notice,debug [Extra_Config] facets = facets.ini ; settings affecting faceting in UI searches = searches.ini ; search definitions and preferences [Languages] en = "English" de = "German" es = "Spanish" fr = "French" it = "Italian" ja = "Japanese" nl = "Dutch" pt-br = "Brazilian Portugese" zh-cn = "Simplified Chinese" zh = "Chinese" tr = "Turkish" he = "Hebrew" ga = "Irish" [Browse] result_limit = 100 dewey = false ; allow browsing of Dewey Decimal call numbers lcc = true ; allow browsing of LC call numbers [Export] RefWorks = true EndNote = false MARC = true RDF = true [Item_Status] multiple_call_nos = first multiple_locations = msg [Record] next_prev_navigation = false ------------------------------------------------------------------------------ WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd _______________________________________________ VuFind-General mailing list VuF...@li...<mailto:VuF...@li...> https://lists.sourceforge.net/lists/listinfo/vufind-general -- ----------------------------------------- Wayne Lam Assistant Library Officer I Systems Development & Support Fong Sum Wood Library Lingnan University 8 Castle Peak Road Tuen Mun, New Territories Hong Kong SAR China Phone: +852 26168585 Email: way...@ln...<mailto:way...@ln...> Website: http://www.library.ln.edu.hk -- ----------------------------------------- Wayne Lam Assistant Library Officer I Systems Development & Support Fong Sum Wood Library Lingnan University 8 Castle Peak Road Tuen Mun, New Territories Hong Kong SAR China Phone: +852 26168585 Email: way...@ln...<mailto:way...@ln...> Website: http://www.library.ln.edu.hk |