Re: [VuFind-Tech] multiple tags abort in NR fields abort import-marc.sh

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

Marc-error is defined as follows:

<field name="marc_error" type="string" indexed="false" stored="true" multiValued="true" />

And the console error log says:

ERROR [main] (MarcImporter.java:258) - Error indexing record: 8963399 -- Error: Problem in
voking addField in SolrCoreProxy
org.solrmarc.solr.SolrRuntimeException: Error: Problem invoking addField in SolrCoreProxy
        at org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:278
)
        at org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117)
        at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321)
        at org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287)
        at org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236)
        at org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445)
        at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja
va:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.simontuffs.onejar.Boot.run(Boot.java:314)
        at com.simontuffs.onejar.Boot.main(Boot.java:159)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja
va:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy.java:271
)
        ... 12 more
Caused by: org.apache.solr.common.SolrException: ERROR: multiple values encountered for no
n multiValued field title_full: first='50 dikter : ett urval ur tre versbo?cker / Med inle
dning av Carl Fehrman' second='Femtio dikter : ett urval ur tre versbo?cker'
        at org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.java:68)
        at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89)
        at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:119)
        at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:102)
        ... 16 more
 INFO [main] (MarcImporter.java:450) - Exception occurred while Indexing: Error: Problem i
nvoking addField in SolrCoreProxy
 INFO [main] (MarcImporter.java:451) - Setting Solr closed flag
 INFO [main] (MarcImporter.java:455) -  Adding 303946 of 303947 documents to index
 INFO [main] (MarcImporter.java:456) -  Deleting 0 documents from index
 INFO [main] (MarcImporter.java:465) - Finished indexing in 25:33.00
 INFO [main] (MarcImporter.java:474) - Indexed 0 at a rate of about 0.0 per sec
 INFO [main] (MarcImporter.java:475) - Deleted 0 records
 INFO [Thread-1] (MarcImporter.java:404) - Starting Shutdown hook
 INFO [Thread-1] (MarcImporter.java:423) - Finished Shutdown hook

And immediately ends, with index unoptimized. (146 segments).

-----Original Message-----
From: Demian Katz [mailto:dem...@vi...] 
Sent: Monday, November 09, 2009 8:50 AM
To: Barnett, Jeffrey; vuf...@li...
Subject: RE: [VuFind-Tech] multiple tags abort in NR fields abort import-marc.sh

What versions of VuFind and SolrMarc are you working with?  I'm going to be merging the latest version of SolrMarc into the trunk later today -- it will be interesting to see if that makes a difference.

Would you be willing to share a sample record and your marc.properties file?  I'd be happy to try to reproduce the issue on my end if that might yield any useful information.

Is there any possibility that your Solr schema is missing the "marc_error" field and that your fatal error is related to an inability to write a warning message to the index?  I think this is a problem we've seen before, though admittedly it doesn't seem like the most likely explanation in your case.

It certainly sounds like a SolrMarc bug if it's truly ignoring the "first" setting and blowing up.  If that is the case, it might be worth posting on solrmarc-tech to see if the problem can be fixed on that side.

- Demian

> -----Original Message-----
> From: Barnett, Jeffrey [mailto:jef...@ya...]
> Sent: Sunday, November 08, 2009 8:16 PM
> To: Barnett, Jeffrey; vuf...@li...
> Subject: Re: [VuFind-Tech] multiple tags abort in NR fields abort
> import-marc.sh
> 
> PS: I bypassed the 100a errors by making the schema fields for
> author_xxx multiValued="true", but the values for title are already
> "first", so I don't understand why the second value is even being
> processed.
> 
> ________________________________________
> From: Barnett, Jeffrey [jef...@ya...]
> Sent: Sunday, November 08, 2009 8:06 PM
> To: vuf...@li...
> Subject: [VuFind-Tech] multiple tags abort in NR fields abort import-
> marc.sh
> 
> I realize this is ultimately a solrmarc issue, but vufind should also
> do something to deal with this situation.  I have (at least) two marc
> records that contain multiple values in techically non-repeatable
> fields ( 100a and 245a).  When I run import-marc.sh against the files
> containing these records the script aborts ungracefully when these
> records are encountered (no more records are processed, the index is
> not optimized).  Is there a parameter I can set to bypass these records
> (apparently earlier versions did)?
> 
> -----------------------------------------------------------------------
> -------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008
> 30-Day
> trial. Simplify your report design, integration and deployment - and
> focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> Vufind-tech mailing list
> Vuf...@li...
> https://lists.sourceforge.net/lists/listinfo/vufind-tech
> -----------------------------------------------------------------------
> -------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008
> 30-Day
> trial. Simplify your report design, integration and deployment - and
> focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> Vufind-tech mailing list
> Vuf...@li...
> https://lists.sourceforge.net/lists/listinfo/vufind-tech