From: Sean C. <sea...@gm...> - 2010-10-28 06:36:22
|
I'm afraid I need yet more help. Sorry. Everything seemed to work as advertised: php harvest_oai.php DUT_IR Processing DUT_IR... Autodetecting date granularity... found YYYY-MM-DDThh:mm:ssZ. Processing 100 records... Processing 100 records... Processing 100 records... Processing 100 records... Processing 52 records... Completed without errors -- 1 source(s) processed. Then I tried to imort the records: ./batch-import-marc.sh DUT_IR Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_100.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_101.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_102.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_103.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_104.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_105.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_107.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_108.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_109.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_110.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_112.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_113.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_114.xml ... Processing /usr/local/vufind/harvest/DUT_IR/1288187318_oai_ir_dut_ac_za_10321_115.xml ... ... Processing /usr/local/vufind/harvest/DUT_IR/1288187320_oai_ir_dut_ac_za_10321_549.xml ... But I don't see any records in VuFind. The XML files are in the processed directory: ls harvest/DUT_IR/processed/ 1288187318_oai_ir_dut_ac_za_10321_100.xml 1288187319_oai_ir_dut_ac_za_10321_311.xml 1288187318_oai_ir_dut_ac_za_10321_101.xml 1288187319_oai_ir_dut_ac_za_10321_312.xml 1288187318_oai_ir_dut_ac_za_10321_102.xml 1288187319_oai_ir_dut_ac_za_10321_313.xml 1288187318_oai_ir_dut_ac_za_10321_103.xml 1288187319_oai_ir_dut_ac_za_10321_314.xml ... Looking at the solrmarc.log, there are a lot of these: 2010-10-27 16:21:26,996 [main] INFO main org.solrmarc.tools.Utils - Opening file: /usr/local/vufind/import/import.properties 2010-10-27 16:21:27,010 [main] INFO main org.solrmarc.marc.MarcImporter - Updating to Solr index at /usr/local/vufind_svn/solr 2010-10-27 16:21:27,012 [main] INFO main org.solrmarc.marc.MarcImporter - Using Solr core biblio 2010-10-27 16:21:27,054 [main] INFO main org.solrmarc.marc.MarcImporter - Using the data directory of: /usr/local/vufind_svn/solr/biblio 2010-10-27 16:21:27,054 [main] INFO main org.solrmarc.marc.MarcImporter - Using the multicore schema file at : /usr/local/vufind_svn/solr/solr.xml 2010-10-27 16:21:27,055 [main] INFO main org.solrmarc.marc.MarcImporter - Using the biblio core 2010-10-27 16:21:29,464 [main] INFO main org.solrmarc.marc.MarcHandler - Attempting to open data file: /usr/local/vufind/harvest/DUT_IR/1288187320_oai_ir_dut_ac_za_10321_549.xml 2010-10-27 16:21:29,575 [main] INFO main org.solrmarc.marc.MarcImporter - Adding 0 of 0 documents to index 2010-10-27 16:21:29,576 [main] INFO main org.solrmarc.marc.MarcImporter - Deleting 0 documents from index 2010-10-27 16:21:29,577 [main] INFO main org.solrmarc.marc.MarcImporter - Calling commit 2010-10-27 16:21:29,603 [main] INFO main org.solrmarc.marc.MarcImporter - Done with the commit, closing Solr 2010-10-27 16:21:29,608 [main] INFO main org.solrmarc.marc.MarcImporter - Setting Solr closed flag 2010-10-27 16:21:29,609 [main] INFO main org.solrmarc.marc.MarcImporter - Connecting to solr server at URL: http://localhost:8080/solr/biblio/update 2010-10-27 16:21:29,891 [main] INFO main org.solrmarc.tools.SolrUpdate - <?xml version="1.0" encoding="UTF-8"?> 2010-10-27 16:21:29,892 [main] INFO main org.solrmarc.tools.SolrUpdate - <response> 2010-10-27 16:21:29,892 [main] INFO main org.solrmarc.tools.SolrUpdate - <lst name="responseHeader"><int name="status">0</int><int name="QTime">231</int></lst> 2010-10-27 16:21:29,893 [main] INFO main org.solrmarc.tools.SolrUpdate - </response> 2010-10-27 16:21:29,895 [main] INFO main org.solrmarc.marc.MarcImporter - Finished indexing in 0:00.00 2010-10-27 16:21:29,896 [main] INFO main org.solrmarc.marc.MarcImporter - Indexed 0 at a rate of about 0.0 per sec 2010-10-27 16:21:29,896 [main] INFO main org.solrmarc.marc.MarcImporter - Deleted 0 records 2010-10-27 16:21:29,898 [Thread-2] INFO Thread-2 org.solrmarc.marc.MarcImporter - Starting Shutdown hook 2010-10-27 16:21:29,898 [Thread-2] INFO Thread-2 org.solrmarc.marc.MarcImporter - Finished Shutdown hook Does this mean there's something wrong with the format of my records? Sean -- Sean Carte esAL Library Systems Manager +27 72 898 8775 +27 31 373 2490 fax: 0866741254 http://esal.dut.ac.za/ |