From: Martin F. <mf...@su...> - 2014-04-17 10:37:44
|
Hi, we get delta-files with records with only some fields. The delta record has only a keyword value but no title and author value. Is there an import option to let the import only replace the keywords while the title and author remains unchanged in the solr-Index? Thus no replacement of the full MARC-Record but only of the MARC-Fields given in the delta file? Thanks, Martin |
From: Ere M. <ere...@he...> - 2014-04-17 10:47:57
|
Hi, I'm afraid that's not possible. You need to have an intermediate store where you have the full record stored, then update that and send it to Solr. There would be a possibility to update a doc in Solr, but it won't work with the default VuFind schema since not all fields are stored (see https://cwiki.apache.org/confluence/display/solr/Updating+Parts+of+Documents). In theory you could change the schema and then use this facility, but I'm pretty sure that's outside the scope of the normal import tools. --Ere 17.4.2014 13.24, Martin Fuchs kirjoitti: > Hi, > > we get delta-files with records with only some fields. > > The delta record has only a keyword value but no title and author value. > > Is there an import option to let the import only replace the keywords > while the title and author remains unchanged in the solr-Index? > > Thus no replacement of the full MARC-Record but only of the MARC-Fields > given in the delta file? > > Thanks, Martin > > > > ------------------------------------------------------------------------------ > Learn Graph Databases - Download FREE O'Reilly Book > "Graph Databases" is the definitive new guide to graph databases and their > applications. Written by three acclaimed leaders in the field, > this first edition is now available. Download your free book today! > http://p.sf.net/sfu/NeoTech > > > > _______________________________________________ > Vufind-tech mailing list > Vuf...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-tech > -- Ere Maijala Kansalliskirjasto / The National Library of Finland |
From: Demian K. <dem...@vi...> - 2014-04-18 12:27:38
|
As Ere says, Solr partial updates currently only work if all fields are stored rather than simply indexed. If you modify the schema to make everything stored, you may run into problems with PHP running out of memory, because Solr will return all of the content of all of the fields with every search response, and some of the currently-non-stored fields (like allfields and fulltext) can contain huge amounts of data. To get around this, work would need to be done to pass a custom fl parameter to Solr restricting the field list to only those that are needed to display the response; right now we're just requesting *. - Demian ________________________________________ From: Ere Maijala [ere...@he...] Sent: Thursday, April 17, 2014 6:47 AM To: vuf...@li... Subject: Re: [VuFind-Tech] Delta-Import with partial replacement Hi, I'm afraid that's not possible. You need to have an intermediate store where you have the full record stored, then update that and send it to Solr. There would be a possibility to update a doc in Solr, but it won't work with the default VuFind schema since not all fields are stored (see https://cwiki.apache.org/confluence/display/solr/Updating+Parts+of+Documents). In theory you could change the schema and then use this facility, but I'm pretty sure that's outside the scope of the normal import tools. --Ere 17.4.2014 13.24, Martin Fuchs kirjoitti: > Hi, > > we get delta-files with records with only some fields. > > The delta record has only a keyword value but no title and author value. > > Is there an import option to let the import only replace the keywords > while the title and author remains unchanged in the solr-Index? > > Thus no replacement of the full MARC-Record but only of the MARC-Fields > given in the delta file? > > Thanks, Martin > > > > ------------------------------------------------------------------------------ > Learn Graph Databases - Download FREE O'Reilly Book > "Graph Databases" is the definitive new guide to graph databases and their > applications. Written by three acclaimed leaders in the field, > this first edition is now available. Download your free book today! > http://p.sf.net/sfu/NeoTech > > > > _______________________________________________ > Vufind-tech mailing list > Vuf...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-tech > -- Ere Maijala Kansalliskirjasto / The National Library of Finland ------------------------------------------------------------------------------ Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/NeoTech _______________________________________________ Vufind-tech mailing list Vuf...@li... https://lists.sourceforge.net/lists/listinfo/vufind-tech |