From: Sean C. <sea...@gm...> - 2009-10-30 13:54:34
|
I had RC1 working, but decided to upgrade to the SVN version. It all seems to run, but I can't import records. Does the error below mean anything to anyone? The cause seems to be: Problem invoking addField in SolrCoreProxy Should I be exporting my MARC records differently for this version of VuFind? Sean Error: Problem invoking addField in SolrCoreProxy java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:271) at org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117) at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) at org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) at org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at com.simontuffs.onejar.Boot.run(Boot.java:314) at com.simontuffs.onejar.Boot.main(Boot.java:159) Caused by: org.apache.solr.common.SolrException: ERROR: multiple values encountered for non multiValued field auth_author: first='Watson, A. H.' second='Munby, D L.' at org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.java:68) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:119) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:102) ... 16 more ERROR [main] (MarcImporter.java:258) - Error indexing record: u124834 -- Error: Problem invoking addField in SolrCoreProxy org.solrmarc.solr.SolrRuntimeException: Error: Problem invoking addField in SolrCoreProxy at org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:278) at org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117) at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) at org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) at org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at com.simontuffs.onejar.Boot.run(Boot.java:314) at com.simontuffs.onejar.Boot.main(Boot.java:159) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:271) ... 12 more Caused by: org.apache.solr.common.SolrException: ERROR: multiple values encountered for non multiValued field auth_author: first='Watson, A. H.' second='Munby, D L.' at org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.java:68) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:119) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:102) ... 16 more INFO [main] (MarcImporter.java:450) - Exception occurred while Indexing: Error: Problem invoking addField in SolrCoreProxy INFO [main] (MarcImporter.java:451) - Setting Solr closed flag INFO [main] (MarcImporter.java:455) - Adding 3061 of 3062 documents to index INFO [main] (MarcImporter.java:456) - Deleting 0 documents from index INFO [main] (SolrUpdate.java:119) - <?xml version="1.0" encoding="UTF-8"?> INFO [main] (SolrUpdate.java:119) - <response> INFO [main] (SolrUpdate.java:119) - <lst name="responseHeader"><int name="status">0</int><int name="QTime">55</int></lst> INFO [main] (SolrUpdate.java:119) - </response> INFO [main] (MarcImporter.java:465) - Finished indexing in 0:06.00 INFO [main] (MarcImporter.java:474) - Indexed 0 at a rate of about 0.0 per sec INFO [main] (MarcImporter.java:475) - Deleted 0 records INFO [Thread-1] (MarcImporter.java:404) - Starting Shutdown hook INFO [Thread-1] (MarcImporter.java:423) - Finished Shutdown hook -- Sean Carte esAL Library Systems Manager +27 72 898 8775 +27 31 373 2490 fax: 0866741254 http://esal.dut.ac.za/ |
From: Demian K. <dem...@vi...> - 2009-10-30 14:20:02
|
I think the key to this error is: ERROR: multiple values encountered for non multiValued field auth_author (You have to dig pretty deep in the error message to see that). The auth_author field in the Solr index is not configured to allow multiple values, but you must have a MARC record where the value is repeated. The auth_author field isn't actually used for anything yet, so the easiest solution to your problem is simply to comment out the auth_author line in import/marc.properties. If you actually want to populate the index for some reason, you could also just add "multiValued='true'" to the appropriate line in solr/biblio/conf/schema.xml. Hopefully this helps -- please let me know if you run into any further problems! - Demian > -----Original Message----- > From: Sean Carte [mailto:sea...@gm...] > Sent: Friday, October 30, 2009 9:54 AM > To: vuf...@li... > Subject: [VuFind-General] Importing MARC Records Using the SVN VuFind > > I had RC1 working, but decided to upgrade to the SVN version. It all > seems to run, but I can't import records. > > Does the error below mean anything to anyone? The cause seems to be: > > Problem invoking addField in SolrCoreProxy > > Should I be exporting my MARC records differently for this version of > VuFind? > > Sean > > > Error: Problem invoking addField in SolrCoreProxy > java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > rImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy. > java:271) > at > org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117) > at > org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) > at > org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) > at > org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) > at > org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) > at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja > va:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > rImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at com.simontuffs.onejar.Boot.run(Boot.java:314) > at com.simontuffs.onejar.Boot.main(Boot.java:159) > Caused by: org.apache.solr.common.SolrException: ERROR: multiple > values encountered for non multiValued field auth_author: > first='Watson, A. H.' second='Munby, D L.' > at > org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.j > ava:68) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89 > ) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:11 > 9) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:10 > 2) > ... 16 more > ERROR [main] (MarcImporter.java:258) - Error indexing record: u124834 > -- Error: Problem invoking addField in SolrCoreProxy > org.solrmarc.solr.SolrRuntimeException: Error: Problem invoking > addField in SolrCoreProxy > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy. > java:278) > at > org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117) > at > org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) > at > org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) > at > org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) > at > org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) > at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja > va:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > rImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at com.simontuffs.onejar.Boot.run(Boot.java:314) > at com.simontuffs.onejar.Boot.main(Boot.java:159) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > rImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy. > java:271) > ... 12 more > Caused by: org.apache.solr.common.SolrException: ERROR: multiple > values encountered for non multiValued field auth_author: > first='Watson, A. H.' second='Munby, D L.' > at > org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.j > ava:68) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89 > ) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:11 > 9) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:10 > 2) > ... 16 more > INFO [main] (MarcImporter.java:450) - Exception occurred while > Indexing: Error: Problem invoking addField in SolrCoreProxy > INFO [main] (MarcImporter.java:451) - Setting Solr closed flag > INFO [main] (MarcImporter.java:455) - Adding 3061 of 3062 documents > to index > INFO [main] (MarcImporter.java:456) - Deleting 0 documents from index > INFO [main] (SolrUpdate.java:119) - <?xml version="1.0" encoding="UTF- > 8"?> > INFO [main] (SolrUpdate.java:119) - <response> > INFO [main] (SolrUpdate.java:119) - <lst name="responseHeader"><int > name="status">0</int><int name="QTime">55</int></lst> > INFO [main] (SolrUpdate.java:119) - </response> > INFO [main] (MarcImporter.java:465) - Finished indexing in 0:06.00 > INFO [main] (MarcImporter.java:474) - Indexed 0 at a rate of about 0.0 > per sec > INFO [main] (MarcImporter.java:475) - Deleted 0 records > INFO [Thread-1] (MarcImporter.java:404) - Starting Shutdown hook > INFO [Thread-1] (MarcImporter.java:423) - Finished Shutdown hook > > > -- > Sean Carte > esAL Library Systems Manager > +27 72 898 8775 > +27 31 373 2490 > fax: 0866741254 > http://esal.dut.ac.za/ > > ----------------------------------------------------------------------- > ------- > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart > your > developing skills, take BlackBerry mobile applications to market and > stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general |
From: Eoghan Ó C. <eog...@gm...> - 2009-10-30 14:21:20
|
Hi Sean "ERROR: multiple values encountered for non multiValued field auth_author" means that SolrMarc encountered two Marc fields for the auth_author mapping specified in /import/marc.properties (100abcd by default), which conflicts with how that field is defined in solr/biblio/conf/schema.xml (repeatable/multi-valued fields have the attribute multiValued="true"). If you're using the trunk version of /import/marc.properties this means that some of your MARC records have multipe 100 fields, which shouldn't be the case. As it happens, the auth_author Solr field isn't currently used by VuFind, but you're going to run into the same issue with author Solr field which is. I'm not sure what has changed since RC1 that meant this worked previously for you. Are they the exact same MARC records? How are they being generated? Eoghan 2009/10/30 Sean Carte <sea...@gm...> > I had RC1 working, but decided to upgrade to the SVN version. It all > seems to run, but I can't import records. > > Does the error below mean anything to anyone? The cause seems to be: > > Problem invoking addField in SolrCoreProxy > > Should I be exporting my MARC records differently for this version of > VuFind? > > Sean > > > Error: Problem invoking addField in SolrCoreProxy > java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:271) > at org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117) > at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) > at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) > at > org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) > at org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) > at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at com.simontuffs.onejar.Boot.run(Boot.java:314) > at com.simontuffs.onejar.Boot.main(Boot.java:159) > Caused by: org.apache.solr.common.SolrException: ERROR: multiple > values encountered for non multiValued field auth_author: > first='Watson, A. H.' second='Munby, D L.' > at > org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.java:68) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:119) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:102) > ... 16 more > ERROR [main] (MarcImporter.java:258) - Error indexing record: u124834 > -- Error: Problem invoking addField in SolrCoreProxy > org.solrmarc.solr.SolrRuntimeException: Error: Problem invoking > addField in SolrCoreProxy > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:278) > at org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117) > at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) > at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) > at > org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) > at org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) > at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at com.simontuffs.onejar.Boot.run(Boot.java:314) > at com.simontuffs.onejar.Boot.main(Boot.java:159) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:271) > ... 12 more > Caused by: org.apache.solr.common.SolrException: ERROR: multiple > values encountered for non multiValued field auth_author: > first='Watson, A. H.' second='Munby, D L.' > at > org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.java:68) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:119) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:102) > ... 16 more > INFO [main] (MarcImporter.java:450) - Exception occurred while > Indexing: Error: Problem invoking addField in SolrCoreProxy > INFO [main] (MarcImporter.java:451) - Setting Solr closed flag > INFO [main] (MarcImporter.java:455) - Adding 3061 of 3062 documents to > index > INFO [main] (MarcImporter.java:456) - Deleting 0 documents from index > INFO [main] (SolrUpdate.java:119) - <?xml version="1.0" encoding="UTF-8"?> > INFO [main] (SolrUpdate.java:119) - <response> > INFO [main] (SolrUpdate.java:119) - <lst name="responseHeader"><int > name="status">0</int><int name="QTime">55</int></lst> > INFO [main] (SolrUpdate.java:119) - </response> > INFO [main] (MarcImporter.java:465) - Finished indexing in 0:06.00 > INFO [main] (MarcImporter.java:474) - Indexed 0 at a rate of about 0.0 per > sec > INFO [main] (MarcImporter.java:475) - Deleted 0 records > INFO [Thread-1] (MarcImporter.java:404) - Starting Shutdown hook > INFO [Thread-1] (MarcImporter.java:423) - Finished Shutdown hook > > > -- > Sean Carte > esAL Library Systems Manager > +27 72 898 8775 > +27 31 373 2490 > fax: 0866741254 > http://esal.dut.ac.za/ > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > |
From: Sean C. <sea...@gm...> - 2009-11-03 09:40:04
|
2009/10/30 Eoghan Ó Carragáin <eog...@gm...>: > Hi Sean > > "ERROR: multiple values encountered for non multiValued field auth_author" > means that SolrMarc encountered two Marc fields for the auth_author mapping > specified in /import/marc.properties (100abcd by default), which conflicts > with how that field is defined in solr/biblio/conf/schema.xml > (repeatable/multi-valued fields have the attribute multiValued="true"). > > If you're using the trunk version of /import/marc.properties this means that > some of your MARC records have multipe 100 fields, which shouldn't be the > case. > > As it happens, the auth_author Solr field isn't currently used by VuFind, > but you're going to run into the same issue with author Solr field which is. So commenting out auth_author in import/marc.properties doesn't help. > I'm not sure what has changed since RC1 that meant this worked previously > for you. Are they the exact same MARC records? How are they being generated? I re-installed RC1 and exported 100 records from Unicorn using the standard export keys report followed by export marc records. I was able to import these into vufind: INFO [main] (MarcImporter.java:629) - Finished indexing in 0:01.00 INFO [main] (MarcImporter.java:638) - Indexed 100 at a rate of about 77.0 per sec INFO [main] (MarcImporter.java:639) - Deleted 0 records INFO [Thread-1] (MarcImporter.java:553) - Starting Shutdown hook INFO [Thread-1] (MarcImporter.java:571) - Finished Shutdown hook Though every record did have errors: ERROR [main] (MarcImporter.java:342) - Document [id=null] missing required fields: id at record count = 100 ERROR [main] (MarcImporter.java:343) - Control Number null org.apache.solr.common.SolrException: Document [id=null] missing required fields: id at org.apache.solr.update.DocumentBuilder.getDoc(DocumentBuilder.java:175) at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:399) at org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:334) at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:615) Then I stopped vufind and deleted the MySQL database and installed the svn version of vufind, started it, then tried to import the same records: root@uzspace:/usr/local/vufind# ./import-marc.sh /home/seanc/20091102_02.mrc /usr/local/vufind/solr /usr/local/vufind Now Importing /home/seanc/20091102_02.mrc ... /usr/lib/jvm/java-6-sun/bin/java -Xms512m -Xmx512m -Done-jar.class.path=/usr/local/vufind/solr/jetty/webapps/solr.war -Dsolr.core.name=biblio -Dsolrmarc.path=/usr/local/vufind/import -Dsolr.path=/usr/local/vufind/solr -jar /usr/local/vufind/import/bin/Generic_VuFind_SolrMarc.jar /usr/local/vufind/import/import.properties /home/seanc/20091102_02.mrc INFO [main] (MarcImporter.java:516) - Starting SolrMarc indexing. INFO [main] (SolrCoreLoader.java:98) - Using the data directory of: /usr/local/vufind/solr/biblio INFO [main] (SolrCoreLoader.java:100) - Using the multicore schema file at : /usr/local/vufind/solr/solr.xml INFO [main] (SolrCoreLoader.java:101) - Using the biblio core 03 Nov 2009 11:16:03 AM org.apache.solr.core.SolrCore initIndex WARNING: [authority] Solr index directory './solr/authority/index' doesn't exist. Creating new index... 03 Nov 2009 11:16:03 AM org.apache.solr.update.SolrIndexWriter getDirectory WARNING: No lockType configured for ./solr/authority/index/ assuming 'simple' 03 Nov 2009 11:16:03 AM org.apache.solr.core.SolrCore initIndex WARNING: [stats] Solr index directory './solr/stats/index' doesn't exist. Creating new index... 03 Nov 2009 11:16:03 AM org.apache.solr.update.SolrIndexWriter getDirectory WARNING: No lockType configured for ./solr/stats/index/ assuming 'simple' Error: Problem invoking getDoc in SolrCoreProxy ERROR [main] (MarcImporter.java:258) - Error indexing record: null -- Error: Problem invoking getDoc in SolrCoreProxy org.solrmarc.solr.SolrRuntimeException: Error: Problem invoking getDoc in SolrCoreProxy at org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderMethodNoArgs(SolrCoreProxy.java:257) at org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:125) at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) at org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) at org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at com.simontuffs.onejar.Boot.run(Boot.java:314) at com.simontuffs.onejar.Boot.main(Boot.java:159) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderMethodNoArgs(SolrCoreProxy.java:251) ... 12 more Caused by: org.apache.solr.common.SolrException: Document [id=null] missing required fields: id at org.apache.solr.update.DocumentBuilder.getDoc(DocumentBuilder.java:176) ... 17 more INFO [main] (MarcImporter.java:450) - Exception occurred while Indexing: Error: Problem invoking getDoc in SolrCoreProxy INFO [main] (MarcImporter.java:451) - Setting Solr closed flag INFO [main] (MarcImporter.java:455) - Adding 0 of 1 documents to index INFO [main] (MarcImporter.java:456) - Deleting 0 documents from index INFO [main] (SolrUpdate.java:119) - <?xml version="1.0" encoding="UTF-8"?> INFO [main] (SolrUpdate.java:119) - <response> INFO [main] (SolrUpdate.java:119) - <lst name="responseHeader"><int name="status">0</int><int name="QTime">52</int></lst> INFO [main] (SolrUpdate.java:119) - </response> INFO [main] (MarcImporter.java:465) - Finished indexing in 0:00.00 INFO [main] (MarcImporter.java:474) - Indexed 0 at a rate of about 0.0 per sec INFO [main] (MarcImporter.java:475) - Deleted 0 records INFO [Thread-1] (MarcImporter.java:404) - Starting Shutdown hook INFO [Thread-1] (MarcImporter.java:423) - Finished Shutdown hook Well that's odd. Now I can't index at all. Somehow I don't think that's an improvement. Any idea where I've gone wrong? Sean -- Sean Carte esAL Library Systems Manager +27 72 898 8775 +27 31 373 2490 fax: 0866741254 http://esal.dut.ac.za/ |
From: Eoghan Ó C. <eog...@gm...> - 2009-11-03 10:09:45
|
Hi Sean, It seems SolrMarc can't find anything in the MARC record to map to the Solr id field (every solr "document" must have a unique id). In the trunk/SVN version (probably RC1 too), SolrMarc looks at the 001 field in MARC for this information (see import/marc.properties). Again, the problem appears to be with the MARC record rather than any configuration in VuFind/Solr (unless you've changed these). It might be worth posting a message on the VuFind-Unicorn mailing list ( https://lists.lehigh.edu/mailman/listinfo/vufind-unicorn-l) to compare notes on exporting. If you send a few sample MARC files here, we can have a look too. All the best, Eoghan 2009/11/3 Sean Carte <sea...@gm...> > 2009/10/30 Eoghan Ó Carragáin <eog...@gm...>: > > Hi Sean > > > > "ERROR: multiple values encountered for non multiValued field > auth_author" > > means that SolrMarc encountered two Marc fields for the auth_author > mapping > > specified in /import/marc.properties (100abcd by default), which > conflicts > > with how that field is defined in solr/biblio/conf/schema.xml > > (repeatable/multi-valued fields have the attribute multiValued="true"). > > > > If you're using the trunk version of /import/marc.properties this means > that > > some of your MARC records have multipe 100 fields, which shouldn't be the > > case. > > > > As it happens, the auth_author Solr field isn't currently used by VuFind, > > but you're going to run into the same issue with author Solr field which > is. > > So commenting out auth_author in import/marc.properties doesn't help. > > > I'm not sure what has changed since RC1 that meant this worked previously > > for you. Are they the exact same MARC records? How are they being > generated? > > I re-installed RC1 and exported 100 records from Unicorn using the > standard export keys report followed by export marc records. I was > able to import these into vufind: > > INFO [main] (MarcImporter.java:629) - Finished indexing in 0:01.00 > INFO [main] (MarcImporter.java:638) - Indexed 100 at a rate of about > 77.0 per sec > INFO [main] (MarcImporter.java:639) - Deleted 0 records > INFO [Thread-1] (MarcImporter.java:553) - Starting Shutdown hook > INFO [Thread-1] (MarcImporter.java:571) - Finished Shutdown hook > > Though every record did have errors: > > ERROR [main] (MarcImporter.java:342) - Document [id=null] missing > required fields: id at record count = 100 > ERROR [main] (MarcImporter.java:343) - Control Number null > org.apache.solr.common.SolrException: Document [id=null] missing > required fields: id > at > org.apache.solr.update.DocumentBuilder.getDoc(DocumentBuilder.java:175) > at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:399) > at > org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:334) > at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:615) > > Then I stopped vufind and deleted the MySQL database and installed the > svn version of vufind, started it, then tried to import the same > records: > > root@uzspace:/usr/local/vufind# ./import-marc.sh > /home/seanc/20091102_02.mrc > /usr/local/vufind/solr /usr/local/vufind > Now Importing /home/seanc/20091102_02.mrc ... > /usr/lib/jvm/java-6-sun/bin/java -Xms512m -Xmx512m > -Done-jar.class.path=/usr/local/vufind/solr/jetty/webapps/solr.war > -Dsolr.core.name=biblio -Dsolrmarc.path=/usr/local/vufind/import > -Dsolr.path=/usr/local/vufind/solr -jar > /usr/local/vufind/import/bin/Generic_VuFind_SolrMarc.jar > /usr/local/vufind/import/import.properties /home/seanc/20091102_02.mrc > INFO [main] (MarcImporter.java:516) - Starting SolrMarc indexing. > INFO [main] (SolrCoreLoader.java:98) - Using the data directory of: > /usr/local/vufind/solr/biblio > INFO [main] (SolrCoreLoader.java:100) - Using the multicore schema > file at : /usr/local/vufind/solr/solr.xml > INFO [main] (SolrCoreLoader.java:101) - Using the biblio core > 03 Nov 2009 11:16:03 AM org.apache.solr.core.SolrCore initIndex > WARNING: [authority] Solr index directory './solr/authority/index' > doesn't exist. Creating new index... > 03 Nov 2009 11:16:03 AM org.apache.solr.update.SolrIndexWriter getDirectory > WARNING: No lockType configured for ./solr/authority/index/ assuming > 'simple' > 03 Nov 2009 11:16:03 AM org.apache.solr.core.SolrCore initIndex > WARNING: [stats] Solr index directory './solr/stats/index' doesn't > exist. Creating new index... > 03 Nov 2009 11:16:03 AM org.apache.solr.update.SolrIndexWriter getDirectory > WARNING: No lockType configured for ./solr/stats/index/ assuming 'simple' > Error: Problem invoking getDoc in SolrCoreProxy > ERROR [main] (MarcImporter.java:258) - Error indexing record: null -- > Error: Problem invoking getDoc in SolrCoreProxy > org.solrmarc.solr.SolrRuntimeException: Error: Problem invoking getDoc > in SolrCoreProxy > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderMethodNoArgs(SolrCoreProxy.java:257) > at org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:125) > at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) > at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) > at > org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) > at org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) > at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at com.simontuffs.onejar.Boot.run(Boot.java:314) > at com.simontuffs.onejar.Boot.main(Boot.java:159) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderMethodNoArgs(SolrCoreProxy.java:251) > ... 12 more > Caused by: org.apache.solr.common.SolrException: Document [id=null] > missing required fields: id > at > org.apache.solr.update.DocumentBuilder.getDoc(DocumentBuilder.java:176) > ... 17 more > INFO [main] (MarcImporter.java:450) - Exception occurred while > Indexing: Error: Problem invoking getDoc in SolrCoreProxy > INFO [main] (MarcImporter.java:451) - Setting Solr closed flag > INFO [main] (MarcImporter.java:455) - Adding 0 of 1 documents to index > INFO [main] (MarcImporter.java:456) - Deleting 0 documents from index > INFO [main] (SolrUpdate.java:119) - <?xml version="1.0" encoding="UTF-8"?> > INFO [main] (SolrUpdate.java:119) - <response> > INFO [main] (SolrUpdate.java:119) - <lst name="responseHeader"><int > name="status">0</int><int name="QTime">52</int></lst> > INFO [main] (SolrUpdate.java:119) - </response> > INFO [main] (MarcImporter.java:465) - Finished indexing in 0:00.00 > INFO [main] (MarcImporter.java:474) - Indexed 0 at a rate of about 0.0 per > sec > INFO [main] (MarcImporter.java:475) - Deleted 0 records > INFO [Thread-1] (MarcImporter.java:404) - Starting Shutdown hook > INFO [Thread-1] (MarcImporter.java:423) - Finished Shutdown hook > > > Well that's odd. Now I can't index at all. Somehow I don't think > that's an improvement. Any idea where I've gone wrong? > > Sean > -- > Sean Carte > esAL Library Systems Manager > +27 72 898 8775 > +27 31 373 2490 > fax: 0866741254 > http://esal.dut.ac.za/ > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > |
From: Till K. <kin...@gm...> - 2009-11-03 10:08:09
|
Sean Carte schrieb: > Well that's odd. Now I can't index at all. Somehow I don't think > that's an improvement. Any idea where I've gone wrong? There is definitely a problem with your records. It seems they have no identifier in MARC field 001 ("Control Number"). solrmarc takes the record identifier from that MARC field and puts it into index field "id". There is no 001 (or no value in it), so you get those errors: > Caused by: org.apache.solr.common.SolrException: Document [id=null] > missing required fields: id If you have an valid record identifier in an other MARC field, you may tell solrmarc by changing the entry "id = 001, first" in file imprt/marc.properties. Just replace 001 by the field number containing the record identifier. If there is no identifier in your exported MARC records, try to find a way to get an identifier into them (there is surely one in the library system), either by adjusting the export function yourself or by bugging your vendor (if they provide this MARC export function, tell them to fix it!). Without a valid identifier, Solr refuses to index a record (for good reasons)... If you like, you may post some example records here on the list, so we can look at them. Till |
From: Sean C. <sea...@gm...> - 2009-11-03 11:58:17
|
2009/11/3 Till Kinstler <kin...@gm...>: > There is definitely a problem with your records. It seems they have no > identifier in MARC field 001 ("Control Number"). solrmarc takes the record > identifier from that MARC field and puts it into index field "id". There is > no 001 (or no value in it), so you get those errors: Ah, yes, well that's embarrassing. Exporting a 001 field definitely does make a difference. The previous problem is gone too. Sorry for the noise, and thank you for all the responses. Sean -- Sean Carte esAL Library Systems Manager +27 72 898 8775 +27 31 373 2490 fax: 0866741254 http://esal.dut.ac.za/ |