Menu
▾
▴
Re: [VuFind-General] Importing records
|
From: Ross S. <ros...@gm...> - 2009-06-11 02:23:00
|
Somewhat relevant to this thread, I've got VuFind's Solrmarc import and update working with Jangle feeds now -- right now it's accessed through a Ruby script (it was easier to reuse what I had written for Blacklight), but this could, theoretically, be ported to any scripting language (PHP-CLI seems a natural choice). I haven't gotten the chance to try it on another machine yet to see if it "just works" (I had to build a SolrMarc .jar from the current trunk), but I should have it and a Jangle driver available by the end of the week. I'm curious as to why Solr needs to be restarted after changes to the index with VuFind -- this isn't the case with Blacklight (nor was it the case with MemoryHole, the Solr-based interface that preceded VuFind at Georgia Tech). -Ross. On Wed, Jun 10, 2009 at 11:13 AM, Andrew Nagy<as...@gm...> wrote: > One nice way of making updates to the Solr index without interfering with > the up-time is to keep a master-slave model. The master can be an off-line > index that can be updated and tweaked at will and every so often (maybe 4 > times a day) the index can be sync'd to the slave which is what VuFInd > operates from. It's a useful model. > > http://wiki.apache.org/solr/SolrReplication > > Hope this helps > > Andrew > > On Wed, Jun 10, 2009 at 10:38 AM, Jody Fagan <fa...@jm...> wrote: >> >> Thanks very much for this post, Alan! So, what method do you use for your >> 4-times-a-day update so that you don't have to stop VuFind, delete >> biblio/index, and re-import everything (thus interrupting use of the system >> for several minutes)? >> >> I read about using curl to send commands to perform updates, deletes, >> etc., and it seems ok for deletes, but was wondering if there's a better way >> for the updates. >> >> thanks, >> >> Jody >> >> Alan Rykhus wrote: >> >> On Tue, 2009-06-09 at 06:48 -0500, an...@ae... wrote: >> >> >> I have a test VuFind installation running (of sorts) on my home Debian >> Server: http://www.librarytwozero.com/vufind/ >> >> I have imported 15 records from Biblios.net and can search these no >> problem. My questions is: >> >> If I now want to purge these 15 records to import more meaningful >> records, how do I accomplish this? >> >> >> >> Since you are just playing around, the easiest way is to stop VuFind, >> delete the biblio/index directory, and then restart VuFind. You need to >> delete the index directory, when you restart VuFind the index directory >> and the 2 segments* files get created. >> >> >> I would also like to hear (either here or perhaps more appropriately to >> my email address) how institutions handle the whole import process >> thing. Do you do an import daily to take account of new acquisitions? >> Does importing on a regular basis mean that you have to selectively >> import only new items? How do you handle the removal of an item in >> VuFind when it is withdrawn on the LMS? >> >> >> >> I update our database 4 times a day. This updates status changes, >> updates the cataloging changes to the records in the database, adds new >> records, and deletes suppressed records. If you can somehow get the >> record number of deleted records, you can send a delete command to the >> database and have the record deleted from the Solr/Lucene database. >> >> >> >> I have a lot of questions surrounding the whole import process and how >> institutions are working through it....would anyone be willing to >> share their experiences? >> >> >> >> We run an Aleph ILS system. We licensed their publishing platform to >> track which records are updated and also have circ status changes. I >> then use a standard procedure that comes with the system to export the >> records in MARC format. I use cron job scripts to export, transfer, and >> update the database. >> >> al >> >> >> >> Thanks >> Andy Ekins >> >> >> ------------------------------------------------------------------------------ >> Crystal Reports - New Free Runtime and 30 Day Trial Check out the new >> simplified licensing option that enables unlimited royalty-free >> distribution of the report engine for externally facing server and web >> deployment. http://p.sf.net/sfu/businessobjects >> _______________________________________________ VuFind-General mailing >> list VuF...@li... >> https://lists.sourceforge.net/lists/listinfo/vufind-general >> >> >> -- >> Jody Condit Fagan >> Associate Professor and Content Interfaces Coordinator >> James Madison University >> Carrier Library MSC 1704 >> Harrisonburg, VA 22807 >> fa...@jm... >> >> Currently Reading: >> Matter, by Iain M. Banks >> >> >> >> >> >> ------------------------------------------------------------------------------ >> Crystal Reports - New Free Runtime and 30 Day Trial >> Check out the new simplified licensing option that enables unlimited >> royalty-free distribution of the report engine for externally facing >> server and web deployment. >> http://p.sf.net/sfu/businessobjects >> _______________________________________________ >> VuFind-General mailing list >> VuF...@li... >> https://lists.sourceforge.net/lists/listinfo/vufind-general >> > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables unlimited > royalty-free distribution of the report engine for externally facing > server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > > |