Menu
▾
▴
Re: [VuFind-Tech] Harvesting ContentDM data and Indexing it in VuFind
|
From: Demian K. <dem...@vi...> - 2012-06-19 18:33:42
|
Once you've polished this, it would be great if you could share with the general community - I'll be happy to add files to the trunk and/or update the wiki: http://vufind.org/wiki/importing_records#specific_examples - Demian From: John Wynstra [mailto:joh...@un...] Sent: Tuesday, June 19, 2012 2:32 PM To: Demian Katz Cc: Chelsea Lobdell; vuf...@li... Subject: Re: [VuFind-Tech] Harvesting ContentDM data and Indexing it in VuFind Chelsea, We have done it here at University of Northern Iowa, but we are not in production with Vufind so I won't call it a finished work. I can share some of our configuration files related to the OIA-PMH harvesting half of the task (getting the data out of ContentDM), and our xsl script for transforming the XML data properly during the load (getting the data into solr). I used the dspace.xsl file as the starting point for our contentdm.xsl file and really did an initial get-it-to-work hack. I need to clean this up, but I should be able to give you enough information to get data from point A to point B. If you want to get thumbnails to display, you have to mess with your theme a little. Here is a sample record (don't expect beauty here): http://vufind.lib.uni.edu/vufind/Record/cdm-yrbk-13914 I will send you some things off list to complete the picture. On Tue, Jun 19, 2012 at 11:00 AM, Demian Katz <dem...@vi...<mailto:dem...@vi...>> wrote: I suspect that ContentDM ingestion will work very much like DSpace or VuDL harvesting, and I suspect there's probably somebody out there already doing it. Basically, the workflow is: 1.) Harvest data with OAI-PMH 2.) Ingest data with VuFind's XML import tools More details on all of that is here (see XML and OAI sections): http://vufind.org/wiki/importing_records As far as creating another channel, I don't think it makes sense to create a new core in this situation. The ContentDM data is going to be structured very similarly to your "Books & more" data, so you'll just end up duplicating structure and code to create a separate search module here. Instead, I would recommend using the biblio core for all of the data, but using filtering on the collection facet to distinguish between the two data sets. That's the technique we use to handle digital library searching here (we show DL items merged with the catalog by default, but we allow a filtered DL-only search). - Demian > -----Original Message----- > From: Chelsea Lobdell [mailto:clo...@sw...<mailto:clo...@sw...>] > Sent: Tuesday, June 19, 2012 11:54 AM > To: vuf...@li...<mailto:vuf...@li...> > Subject: [VuFind-Tech] Harvesting ContentDM data and Indexing it in VuFind > > Hi VuFind, > > For the next phase of our discovery layer implementation we want to bring > ContentDM data into VuFind. We're using a channeled approach with our > discovery layer (currently we have Books & more and Articles channels) and we > intend to display ContentDM data in its own channel so we do not want this > data stored with our regular sold index for our Books & more content. We were > looking at how VuFind works with the authority index and regular solr index > and noticed there are separate cores (authority and biblio). Is this how > ContentDM data will work? Adding a new core for this to keep it as a separate > index? > > We're looking for any advice/tips on how to get started with harvesting > ContentDM and indexing it in VuFind. We'd also like to know for VuFind users > who are pulling in ContentDM data how do you manage the export and indexing of > records? > > Thanks, > > Chelsea Lobdell > Library Applications Programmer > Swarthmore College > clo...@sw...<mailto:clo...@sw...> > (610)690-6818<tel:%28610%29690-6818> > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > Vufind-tech mailing list > Vuf...@li...<mailto:Vuf...@li...> > https://lists.sourceforge.net/lists/listinfo/vufind-tech ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ Vufind-tech mailing list Vuf...@li...<mailto:Vuf...@li...> https://lists.sourceforge.net/lists/listinfo/vufind-tech -- <><><><><><><><><><><><><><><><><><><> John Wynstra Library Information Systems Specialist Rod Library University of Northern Iowa Cedar Falls, IA 50613 wy...@un...<mailto:wy...@un...> (319)273-6399 <><><><><><><><><><><><><><><><><><><> |