Re: [VuFind-Tech] Merging MARC records from different ILS instances

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

Thanks Demain for a detail explanation. Will try and report ASAP.

Regards

On Mon, Apr 24, 2017 at 6:48 PM, Demian Katz <dem...@vi...>
wrote:

> Yes, your understanding of what the import rule will do is correct.
>
>
>
> The batch-import-marc.sh script accepts a -p switch to specify which
> properties file to use during indexing. This makes it possible to set up
> multiple configurations for multiple ILS instances.
>
>
>
> One possible point of confusion, though: the -p switch does NOT refer to
> marc_local.properties or other mapping files. Instead, it refers to the
> file that by default is called import.properties. This file contains all of
> the SolrMarc settings, one of which is the list of mappings files to use
> (which includes marc_local.properties). So you want to do this:
>
>
>
> 1.       Copy import.properties to import-k41.properties, and copy
> marc_local.properties to marc_local-k41.properties.
>
> 2.       Edit import-k41.properties to refer to marc_local-k41.properties.
>
> 3.       Run the batch import with -p import-k41.properties as an
> additional parameter.
>
>
>
> I hope this helps!
>
> - Demian
>
>
>
> *From:* P. S. Mukhopadhyay [mailto:psm...@gm...]
> *Sent:* Saturday, April 22, 2017 6:09 AM
> *To:* Demian Katz
> *Cc:* vufind-tech
> *Subject:* Re: [VuFind-Tech] Merging MARC records from different ILS
> instances
>
>
>
> Another confusion:
>
> Say I'm following
>
> id = 001, (pattern_map.id_prefix), first
>
> pattern_map.id_prefix.pattern_0 = (.+)=>K41_$1
>
> will it store id in vufind as K41.1234 for a record in Koha with bib id 1234?
>
> We have to create two marc_local.properties (say marc_local-k41.properties and
> marc_local-k42.properties) for two instances/installations. Then how can we instruct to use respective marc_local durong batc-import?
>
> Regards
>
>
>
>
>
> On Sat, Apr 22, 2017 at 2:52 PM, P. S. Mukhopadhyay <
> psm...@gm...> wrote:
>
> Thanks Demian. The ID issue is possibly the reason as pointed out by you.
> In fact a closer look shows that each harvested record has different ID
> (generated by VuFind) but inside the record the ID is Koha biblio ID stored
> in non-MARC tag 999 $c. This we mentioned in marc_local.properties file as
> id=999c, first. As a result, all first 101 records (from Koha set 1) got
> replaced by the first 101 records from Koha set 2.
>
> I'll study the study materials as advised by you and bounce back with the
> outcome of the experiment. Meanwhile one doubt... How can the VuFind track
> real time status of documents available in different Koha installations (as
> we can select only one driver in config.ini)?
>
> Regards
>
>
>
> On Sat, Apr 22, 2017 at 2:09 AM, Demian Katz <dem...@vi...>
> wrote:
>
> I would guess that the problem you are running into here is ID collisions.
> If you set up two instances of Koha, they're both going to start with
> record ID 1 and increment from there. If you index those into the same
> VuFind instance, some of the IDs are going to be the same, and then they're
> going to overwrite each other.
>
>
>
> The solution is to use a different marc_local.properties file for each
> instance so that you can assign a different prefix to each ID based on
> which Koha instance it came from; then you can ensure that all IDs are
> unique. This will cause problems for the Koha ILS driver, though, because
> it expects the raw ID value, not a prefixed version -- but that's where the
> MultiBackend driver can come in to proxy appropriate requests to
> appropriate drivers.
>
>
>
> This wiki page talks about the MultiBackend driver and provides a link to
> the SolrMarc configuration to achieve ID prefixing:
>
>
>
> https://vufind.org/wiki/configuration:ils:multibackend_driver
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fvufind.org%2Fwiki%2Fconfiguration%3Ails%3Amultibackend_driver&data=02%7C01%7Cdemian.katz%40villanova.edu%7C85652c494b14451fb87e08d48967b4a3%7C765a8de5cf9444f09cafae5bf8cfa366%7C0%7C0%7C636284525881087988&sdata=agSeMl4VeHNwv5xVr5f4GmrYWtL8I1AemoYqtdkZSbg%3D&reserved=0>
>
>
>
> Please let me know if you still have any questions or problems!
>
>
>
> - Demian
>
>
> ------------------------------
>
> *From:* P. S. Mukhopadhyay <psm...@gm...>
> *Sent:* Friday, April 21, 2017 3:37 PM
> *To:* vufind-tech
> *Subject:* [VuFind-Tech] Merging MARC records from different ILS instances
>
>
>
> Dear all
>
> Today I encountered an unexpected result in VuFind 3.1.3 (working on
> Ubuntu LTS 16.04 with PHP 7.0).
>
> 1. harvested records (marcxml) from two different installation of Koha
> (one includes 101 and next includes 112 records respectively;
>
>
>
> the process went on successfully.
>
> 2. indexed harvested records;
>
> this has also performed by the system without any error.
>
> The surprise came in next level. Instead merging records (101+112), Solr
> is actually replacing first records set (101 number records) with second
> records set (112 records). As a result after importing in solr we are
> getting 112 records in place of 101+112 records. Initially we though there
> some problems in our process but found same results after performing the
> entire process in three different times.
>
> Our expectation was that - after harvesting and importing records from
> different Koha instances (or installations) we will get a union catalogue
> kind of things in VuFind discovery system. But it is not happening. What
> are we missing?
>
> Note: we have included different sections for different Koha instance
> with unique id by IP address e.g [Koha-42 and Koha-41].
>
> Regards
>
>
> --
>
> -----------------------------------------------------------------------
> Dr. Parthasarathi Mukhopadhyay
> Associate Professor, Department of Library and Information Science,
> University of Kalyani,
> Kalyani - 741 235 (WB), India
> -----------------------------------------------------------------------
>
>
>
>
> --
>
> -----------------------------------------------------------------------
> Dr. Parthasarathi Mukhopadhyay
> Associate Professor, Department of Library and Information Science,
> University of Kalyani,
> Kalyani - 741 235 (WB), India
> -----------------------------------------------------------------------
>
>
>
>
> --
>
> -----------------------------------------------------------------------
> Dr. Parthasarathi Mukhopadhyay
> Associate Professor, Department of Library and Information Science,
> University of Kalyani,
> Kalyani - 741 235 (WB), India
> -----------------------------------------------------------------------
>

-- 
-----------------------------------------------------------------------
Dr. Parthasarathi Mukhopadhyay
Associate Professor, Department of Library and Information Science,
University of Kalyani,
Kalyani - 741 235 (WB), India
-----------------------------------------------------------------------