Re: [VuFind-Tech] incremental imports from Unicorn?

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

If you're actually on 2.0 or 2.0.1, there were some bugs that could cause problems with the command line apps. It's probably easiest to upgrade to 2.1.1 to eliminate these problems. This should not be too difficult if you haven't many any core changes.

And just for future reference, the reason all the utility scripts are set up the same way is that VuFind includes a custom router that detects command line mode and loads the appropriate action from one of the controllers in the VuFindConsole module -- so all the real logic can be found in the module/VuFindConsole/src/VuFindConsole/Controller directory; everything else is boilerplate.

Please let me know if you still have questions or problems!

- Demian
________________________________
From: Shepard, Thomas - 1150 - MITLL [tsh...@ll...]
Sent: Thursday, October 31, 2013 3:39 PM
To: VUFind-Unicorn Driver Development List
Cc: vuf...@li...
Subject: Re: [VuFind-Tech] incremental imports from Unicorn?

We are using 2.0, and I think that does matter.

I tried again, this time with just the list of IDs (the “flat” part of the command initially made me think that it was expecting a flat marc file (d’oh!)
However, I still get the same response, or lack thereof, namely:

Zend Framework 2.2.4 application
Usage:

The delete.php in vufind 2.0 is so vastly different from the earlier version, I thought it was incomplete, especially since its commands mirror other util scripts, such as index_reserves.php and expire_searches.php.
I see it performs its magic through the Vend Framework, something I know absolutely nothing about.

Has anyone using vufind 2.0 been able to delete records this way?

Thanks,
-Thom

// Load the Zend framework -- this will automatically trigger the appropriate
// controller action based on directory and file names
define('CLI_DIR', __DIR__);     // save directory name of current script
require_once __DIR__ . '/../public/index.php';

From: vufind-unicorn-l-bounces+tshepard=ll....@li... [mailto:vufind-unicorn-l-bounces+tshepard=ll....@li...] On Behalf Of Stephen Hovey
Sent: Thursday, October 31, 2013 6:15 AM
To: VUFind-Unicorn Driver Development List
Subject: Re: [VUFind-Unicorn-L] incremental imports from Unicorn?

I’m using vufind 1.3, not 2.X – not sure if it matters.

Deleted.txt should not be marc records.. just the record ids like:

107781
114480
145004
146748
166669
237282
315175
346140
407214
409081
424264
495780
509024
531162
539584

From: vufind-unicorn-l-bounces+hoveys=buf...@li...<mailto:vufind-unicorn-l-bounces+hoveys=buf...@li...> [mailto:vufind-unicorn-l-bounces+hoveys=buf...@li...] On Behalf Of Shepard, Thomas - 1150 - MITLL
Sent: Wednesday, October 30, 2013 4:00 PM
To: VUFind-Unicorn Driver Development List
Subject: Re: [VUFind-Unicorn-L] incremental imports from Unicorn?

Stephen,

I have been attempting variations of the delete portion of the vufind import script you provided, but without any success.
On the commandline, I type:

/usr/bin/php /usr/local/vufind2/util/deletes.php /usr/local/vufind2/import/deleted.txt flat

My deleted.txt is a flat file export from sirsi. (The same collection of marc records that I had successfully imported.)

The response I get back is basically no response:

Zend Framework 2.2.4 application
Usage:

Can you give me a clue as to what I am doing wrong?

Thanks,
Thom Shepard

From: vufind-unicorn-l-bounces+tshepard=ll....@li...<mailto:vufind-unicorn-l-bounces+tshepard=ll....@li...> [mailto:vufind-unicorn-l-bounces+tshepard=ll....@li...] On Behalf Of Stephen Hovey
Sent: Tuesday, July 30, 2013 2:04 PM
To: VUFind-Unicorn Driver Development List
Subject: Re: [VUFind-Unicorn-L] incremental imports from Unicorn?

We are.  I used Tuan’s scripts with a little adjustment.

The attached does the exporting on the sirsi box, run as sirsi in cron – shadowed/hidden records are not exported.

Then on the vufind side the import script is:

cd /usr/local/vufind
VUFIND_HOME=/usr/local/vufind;export VUFIND_HOME
./import-marc.sh ../catalog.mrc
/usr/local/bin/php util/deletes.php /usr/local/deleted.txt flat
./index-alphabetic-browse.sh
/usr/local/vufind/vufind.sh restart

We run it once a day at an off hour

From: vufind-unicorn-l-bounces+hoveys=buf...@li...<mailto:vufind-unicorn-l-bounces+hoveys=buf...@li...> [mailto:vufind-unicorn-l-bounces+hoveys=buf...@li...] On Behalf Of Shepard, Thomas - 1150 - MITLL
Sent: Tuesday, July 30, 2013 1:56 PM
To: vuf...@li...<mailto:vuf...@li...>
Subject: [VUFind-Unicorn-L] incremental imports from Unicorn?

I am not finding anything in the vufind documentation on setting up incremental imports into vufind from SirsiDynix Symphony.

We want to just add new (or modified) records – possibly throughout the course of a day -- adding dozens of records rather than 200,000+ records.

Is anyone out there doing incremental data updates into vufind?

Thanks,
Thom

Thom Shepard
Information Services Dept.
MIT Lincon Lab, SM-730A
244 Wood St. Lexington, 02420-9176
tsh...@ll...<mailto:tsh...@ll...>
781 981 0370

________________________________
The Buffalo & Erie County Public Library System has more than 2.6 million materials available for borrowing including books, eBooks, DVDs, music and more. Free library card applications can be downloaded and taken to any of the 37- local public libraries for processing. A valid form of identification and proof of address is necessary. For more information call 716-858-8900 or visit www.BuffaloLib.org<http://www.BuffaloLib.org> .