From: Demian K. <dem...@vi...> - 2009-11-09 14:52:22
|
Okay, so it's the title_full index that's causing the problem. I don't see title_full included in the marc.properties dump you forwarded... however, if it's the same as the trunk code, this is the relevant line: title_full = custom, getAllSubfields(245, " ") As you can see, it's missing a "first" parameter. When I tried to add "first" on my test server, it still failed -- I have a feeling that SolrMarc doesn't allow you to combine the "first" parameter with a custom function. A couple of thoughts: 1.) It's probably worth posting on solrmarc-tech to see if there's a way to get the first value from a custom function. Perhaps this is a SolrMarc bug that can be fixed. 2.) If you can't configure SolrMarc that way, it would be pretty easy to write a custom indexing function that wraps around getAllSubfields() and returns only the first value. - Demian > -----Original Message----- > From: Barnett, Jeffrey [mailto:jef...@ya...] > Sent: Monday, November 09, 2009 9:39 AM > To: Demian Katz; vuf...@li... > Subject: RE: [VuFind-Tech] multiple tags abort in NR fields abort > import-marc.sh > > Marc-error is defined as follows: > > <field name="marc_error" type="string" indexed="false" stored="true" > multiValued="true" /> > > And the console error log says: > > ERROR [main] (MarcImporter.java:258) - Error indexing record: 8963399 - > - Error: Problem in > voking addField in SolrCoreProxy > org.solrmarc.solr.SolrRuntimeException: Error: Problem invoking > addField in SolrCoreProxy > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy. > java:278 > ) > at > org.solrmarc.solr.SolrCoreProxy.addDoc(SolrCoreProxy.java:117) > at > org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:321) > at > org.solrmarc.marc.MarcImporter.addToIndex(MarcImporter.java:287) > at > org.solrmarc.marc.MarcImporter.importRecords(MarcImporter.java:236) > at > org.solrmarc.marc.MarcImporter.handleAll(MarcImporter.java:445) > at org.solrmarc.marc.MarcImporter.main(MarcImporter.java:531) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja > va:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > rImpl.ja > va:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at com.simontuffs.onejar.Boot.run(Boot.java:314) > at com.simontuffs.onejar.Boot.main(Boot.java:159) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > rImpl.ja > va:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.solrmarc.solr.SolrCoreProxy.invokeDocBuilderAddField(SolrCoreProxy. > java:271 > ) > ... 12 more > Caused by: org.apache.solr.common.SolrException: ERROR: multiple values > encountered for no > n multiValued field title_full: first='50 dikter : ett urval ur tre > versbo?cker / Med inle > dning av Carl Fehrman' second='Femtio dikter : ett urval ur tre > versbo?cker' > at > org.apache.solr.update.DocumentBuilder.addSingleField(DocumentBuilder.j > ava:68) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:89 > ) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:11 > 9) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:10 > 2) > ... 16 more > INFO [main] (MarcImporter.java:450) - Exception occurred while > Indexing: Error: Problem i > nvoking addField in SolrCoreProxy > INFO [main] (MarcImporter.java:451) - Setting Solr closed flag > INFO [main] (MarcImporter.java:455) - Adding 303946 of 303947 > documents to index > INFO [main] (MarcImporter.java:456) - Deleting 0 documents from index > INFO [main] (MarcImporter.java:465) - Finished indexing in 25:33.00 > INFO [main] (MarcImporter.java:474) - Indexed 0 at a rate of about 0.0 > per sec > INFO [main] (MarcImporter.java:475) - Deleted 0 records > INFO [Thread-1] (MarcImporter.java:404) - Starting Shutdown hook > INFO [Thread-1] (MarcImporter.java:423) - Finished Shutdown hook > > And immediately ends, with index unoptimized. (146 segments). > > -----Original Message----- > From: Demian Katz [mailto:dem...@vi...] > Sent: Monday, November 09, 2009 8:50 AM > To: Barnett, Jeffrey; vuf...@li... > Subject: RE: [VuFind-Tech] multiple tags abort in NR fields abort > import-marc.sh > > What versions of VuFind and SolrMarc are you working with? I'm going > to be merging the latest version of SolrMarc into the trunk later today > -- it will be interesting to see if that makes a difference. > > Would you be willing to share a sample record and your marc.properties > file? I'd be happy to try to reproduce the issue on my end if that > might yield any useful information. > > Is there any possibility that your Solr schema is missing the > "marc_error" field and that your fatal error is related to an inability > to write a warning message to the index? I think this is a problem > we've seen before, though admittedly it doesn't seem like the most > likely explanation in your case. > > It certainly sounds like a SolrMarc bug if it's truly ignoring the > "first" setting and blowing up. If that is the case, it might be worth > posting on solrmarc-tech to see if the problem can be fixed on that > side. > > - Demian > > > -----Original Message----- > > From: Barnett, Jeffrey [mailto:jef...@ya...] > > Sent: Sunday, November 08, 2009 8:16 PM > > To: Barnett, Jeffrey; vuf...@li... > > Subject: Re: [VuFind-Tech] multiple tags abort in NR fields abort > > import-marc.sh > > > > PS: I bypassed the 100a errors by making the schema fields for > > author_xxx multiValued="true", but the values for title are already > > "first", so I don't understand why the second value is even being > > processed. > > > > ________________________________________ > > From: Barnett, Jeffrey [jef...@ya...] > > Sent: Sunday, November 08, 2009 8:06 PM > > To: vuf...@li... > > Subject: [VuFind-Tech] multiple tags abort in NR fields abort import- > > marc.sh > > > > I realize this is ultimately a solrmarc issue, but vufind should also > > do something to deal with this situation. I have (at least) two marc > > records that contain multiple values in techically non-repeatable > > fields ( 100a and 245a). When I run import-marc.sh against the files > > containing these records the script aborts ungracefully when these > > records are encountered (no more records are processed, the index is > > not optimized). Is there a parameter I can set to bypass these > records > > (apparently earlier versions did)? > > > > --------------------------------------------------------------------- > -- > > ------- > > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 > > 30-Day > > trial. Simplify your report design, integration and deployment - and > > focus on > > what you do best, core application coding. Discover what's new with > > Crystal Reports now. http://p.sf.net/sfu/bobj-july > > _______________________________________________ > > Vufind-tech mailing list > > Vuf...@li... > > https://lists.sourceforge.net/lists/listinfo/vufind-tech > > --------------------------------------------------------------------- > -- > > ------- > > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 > > 30-Day > > trial. Simplify your report design, integration and deployment - and > > focus on > > what you do best, core application coding. Discover what's new with > > Crystal Reports now. http://p.sf.net/sfu/bobj-july > > _______________________________________________ > > Vufind-tech mailing list > > Vuf...@li... > > https://lists.sourceforge.net/lists/listinfo/vufind-tech |