From: Tim F. <T.F...@bb...> - 2012-11-26 10:44:08
|
Hi, I am trying to automate our VuFind daily update process so that newly edited records can be imported, and deleted records removed. We will then have a fresh import once week at a quiet time. I have a script that works fine when run manually form the command line but I cannot get it to run using cron so if anyone can give me some advice about how to fix this it would be much appreciated. The script for indexing the new & updated records is very simple: #!/bin/sh # Import the records to VuFind: IMPORT_SCRIPT=import-marc.sh NEWRECS=vufind_new_import.mrc $VUFIND_HOME/$IMPORT_SCRIPT $VUFIND_HOME/$NEWRECS exit The marc file is imported as a separate process and is present. The cron script has the same permissions as import-marc.sh. Many thanks, Tim --------------- Tim Fletcher Library Technology Innovation Manager Birkbeck, University of London Malet Street London WC1E 7HX t.f...@bb... Tel: 020 7380 3269 Fax: 020 7631 6066 http://www.bbk.ac.uk/lib/ |
From: Jonathan F. <jon...@pt...> - 2012-11-26 11:17:03
|
Hi Tim, You may need to put the full path to the files in IMPORT_SCRIPT and NEWRECS as, when you run from cron, it will probably use the home directory as the working directory even if you used the full path to the script in your cron entry. If this doesn't work, try looking at the cron logs (/var/log/cron.log) to see if there are messages. Or you could put a set -x after the first line of your shell script to get some more verbose output. Thanks Jonathan On 26/11/2012 10:43, Tim Fletcher wrote: > Hi, > > I am trying to automate our VuFind daily update process so that newly > edited records can be imported, and deleted records removed. We will > then have a fresh import once week at a quiet time. > > I have a script that works fine when run manually form the command line > but I cannot get it to run using cron so if anyone can give me some > advice about how to fix this it would be much appreciated. > > The script for indexing the new & updated records is very simple: > > #!/bin/sh > > # Import the records to VuFind: > IMPORT_SCRIPT=import-marc.sh > NEWRECS=vufind_new_import.mrc > > $VUFIND_HOME/$IMPORT_SCRIPT $VUFIND_HOME/$NEWRECS > > exit > > The marc file is imported as a separate process and is present. The cron > script has the same permissions as import-marc.sh. > > Many thanks, > > Tim > --------------- > Tim Fletcher > > Library Technology Innovation Manager > Birkbeck, University of London > Malet Street > London WC1E 7HX > > t.f...@bb... > > Tel: 020 7380 3269 > Fax: 020 7631 6066 > http://www.bbk.ac.uk/lib/ > > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > -- Jonathan Field Technical Director, PTFS Europe Limited Content Management and Library Solutions jon...@pt... skype: jonathan.field2 http://www.ptfs-europe.com |
From: Filipe MS B. (UA) <fs...@ua...> - 2012-11-26 12:21:20
|
Hi! In the line of Jonathan's thought (writing from the top of my head as I still haven't this working yet -- not yet in production / only missing the cronjob itself), I guess $VUFIND_HOME, as an environment variable and depending from your Linux flavor (I reckon), it's only available for bash shell (read from /etc/profile). If you want to use that same script without full paths, I would try beginning the shell script with: #!/bin/bash -l (or #!/bin/sh -l, as "sh" usually is a symbolic link to "bash") ( = --login > from "man sh": Make bash act as if it had been invoked as a login shell ) forcing it to read /etc/profile. But above all, I would say that Jonathan's tips should do the job / point you to the solution. Anyway, I guess you've consulted VuFind's Automation wiki page http://vufind.org/wiki/automation. Hope I've helped, somehow... All the best, Filipe On Mon, Nov 26, 2012 at 10:54 AM, Jonathan Field <jon...@pt...> wrote: > Hi Tim, > > You may need to put the full path to the files in IMPORT_SCRIPT and > NEWRECS as, when you run from cron, it will probably use the home > directory as the working directory even if you used the full path to the > script in your cron entry. > > If this doesn't work, try looking at the cron logs (/var/log/cron.log) > to see if there are messages. Or you could put a > set -x > after the first line of your shell script to get some more verbose output. > Thanks > Jonathan > > On 26/11/2012 10:43, Tim Fletcher wrote: >> Hi, >> >> I am trying to automate our VuFind daily update process so that newly >> edited records can be imported, and deleted records removed. We will >> then have a fresh import once week at a quiet time. >> >> I have a script that works fine when run manually form the command line >> but I cannot get it to run using cron so if anyone can give me some >> advice about how to fix this it would be much appreciated. >> >> The script for indexing the new & updated records is very simple: >> >> #!/bin/sh >> >> # Import the records to VuFind: >> IMPORT_SCRIPT=import-marc.sh >> NEWRECS=vufind_new_import.mrc >> >> $VUFIND_HOME/$IMPORT_SCRIPT $VUFIND_HOME/$NEWRECS >> >> exit >> >> The marc file is imported as a separate process and is present. The cron >> script has the same permissions as import-marc.sh. >> >> Many thanks, >> >> Tim >> --------------- >> Tim Fletcher >> >> Library Technology Innovation Manager >> Birkbeck, University of London >> Malet Street >> London WC1E 7HX >> >> t.f...@bb... >> >> Tel: 020 7380 3269 >> Fax: 020 7631 6066 >> http://www.bbk.ac.uk/lib/ >> >> >> ------------------------------------------------------------------------------ >> Monitor your physical, virtual and cloud infrastructure from a single >> web console. Get in-depth insight into apps, servers, databases, vmware, >> SAP, cloud infrastructure, etc. Download 30-day Free Trial. >> Pricing starts from $795 for 25 servers or applications! >> http://p.sf.net/sfu/zoho_dev2dev_nov >> _______________________________________________ >> VuFind-General mailing list >> VuF...@li... >> https://lists.sourceforge.net/lists/listinfo/vufind-general >> > > -- > > Jonathan Field > Technical Director, PTFS Europe Limited > Content Management and Library Solutions > jon...@pt... > skype: jonathan.field2 > > http://www.ptfs-europe.com > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general |
From: Tim F. <T.F...@bb...> - 2012-11-26 12:29:32
|
Hi Jonathan (and Felipe), Thanks for the advice. Still no joy - and no sign of any cron logs. Running it manually with the changes you suggested worked so I am obviously missing something with regard to cron. It's almost as if nothing is actually running. I think I need to do some more checks with regard to cron although as far as I know the restart job we have running each morning is OK. Tim -----Original Message----- From: Jonathan Field [mailto:jon...@pt...] Sent: 26 November 2012 10:55 To: vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help Hi Tim, You may need to put the full path to the files in IMPORT_SCRIPT and NEWRECS as, when you run from cron, it will probably use the home directory as the working directory even if you used the full path to the script in your cron entry. If this doesn't work, try looking at the cron logs (/var/log/cron.log) to see if there are messages. Or you could put a set -x after the first line of your shell script to get some more verbose output. Thanks Jonathan On 26/11/2012 10:43, Tim Fletcher wrote: > Hi, > > I am trying to automate our VuFind daily update process so that newly > edited records can be imported, and deleted records removed. We will > then have a fresh import once week at a quiet time. > > I have a script that works fine when run manually form the command > line but I cannot get it to run using cron so if anyone can give me > some advice about how to fix this it would be much appreciated. > > The script for indexing the new & updated records is very simple: > > #!/bin/sh > > # Import the records to VuFind: > IMPORT_SCRIPT=import-marc.sh > NEWRECS=vufind_new_import.mrc > > $VUFIND_HOME/$IMPORT_SCRIPT $VUFIND_HOME/$NEWRECS > > exit > > The marc file is imported as a separate process and is present. The > cron script has the same permissions as import-marc.sh. > > Many thanks, > > Tim > --------------- > Tim Fletcher > > Library Technology Innovation Manager > Birkbeck, University of London > Malet Street > London WC1E 7HX > > t.f...@bb... > > Tel: 020 7380 3269 > Fax: 020 7631 6066 > http://www.bbk.ac.uk/lib/ > > > ---------------------------------------------------------------------- > -------- Monitor your physical, virtual and cloud infrastructure from > a single web console. Get in-depth insight into apps, servers, > databases, vmware, SAP, cloud infrastructure, etc. Download 30-day > Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > -- Jonathan Field Technical Director, PTFS Europe Limited Content Management and Library Solutions jon...@pt... skype: jonathan.field2 http://www.ptfs-europe.com ------------------------------------------------------------------------ ------ Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov _______________________________________________ VuFind-General mailing list VuF...@li... https://lists.sourceforge.net/lists/listinfo/vufind-general |
From: Osullivan L. <L.O...@sw...> - 2012-11-26 12:33:41
|
Hi Folks, Have you made sure that the log files have the correct permissions set for writing? That caught me out once before... Cheers, Luke ________________________________________ From: Tim Fletcher [T.F...@bb...] Sent: 26 November 2012 12:29 To: jon...@pt...; vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help Hi Jonathan (and Felipe), Thanks for the advice. Still no joy - and no sign of any cron logs. Running it manually with the changes you suggested worked so I am obviously missing something with regard to cron. It's almost as if nothing is actually running. I think I need to do some more checks with regard to cron although as far as I know the restart job we have running each morning is OK. Tim -----Original Message----- From: Jonathan Field [mailto:jon...@pt...] Sent: 26 November 2012 10:55 To: vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help Hi Tim, You may need to put the full path to the files in IMPORT_SCRIPT and NEWRECS as, when you run from cron, it will probably use the home directory as the working directory even if you used the full path to the script in your cron entry. If this doesn't work, try looking at the cron logs (/var/log/cron.log) to see if there are messages. Or you could put a set -x after the first line of your shell script to get some more verbose output. Thanks Jonathan On 26/11/2012 10:43, Tim Fletcher wrote: > Hi, > > I am trying to automate our VuFind daily update process so that newly > edited records can be imported, and deleted records removed. We will > then have a fresh import once week at a quiet time. > > I have a script that works fine when run manually form the command > line but I cannot get it to run using cron so if anyone can give me > some advice about how to fix this it would be much appreciated. > > The script for indexing the new & updated records is very simple: > > #!/bin/sh > > # Import the records to VuFind: > IMPORT_SCRIPT=import-marc.sh > NEWRECS=vufind_new_import.mrc > > $VUFIND_HOME/$IMPORT_SCRIPT $VUFIND_HOME/$NEWRECS > > exit > > The marc file is imported as a separate process and is present. The > cron script has the same permissions as import-marc.sh. > > Many thanks, > > Tim > --------------- > Tim Fletcher > > Library Technology Innovation Manager > Birkbeck, University of London > Malet Street > London WC1E 7HX > > t.f...@bb... > > Tel: 020 7380 3269 > Fax: 020 7631 6066 > http://www.bbk.ac.uk/lib/ > > > ---------------------------------------------------------------------- > -------- Monitor your physical, virtual and cloud infrastructure from > a single web console. Get in-depth insight into apps, servers, > databases, vmware, SAP, cloud infrastructure, etc. Download 30-day > Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > -- Jonathan Field Technical Director, PTFS Europe Limited Content Management and Library Solutions jon...@pt... skype: jonathan.field2 http://www.ptfs-europe.com ------------------------------------------------------------------------ ------ Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov _______________________________________________ VuFind-General mailing list VuF...@li... https://lists.sourceforge.net/lists/listinfo/vufind-general ------------------------------------------------------------------------------ Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov _______________________________________________ VuFind-General mailing list VuF...@li... https://lists.sourceforge.net/lists/listinfo/vufind-general |
From: Jonathan F. <jon...@pt...> - 2012-11-26 12:34:02
|
What does your crontab entry look like? Say, it's something like this 25 2 * * * /usr/local/vufind/update_daily.sh Try, something like this 25 2 * * * /usr/local/vufind/update_daily.sh >/tmp/update.log 2>&1 and then, after the run, check what's in the /tmp/update.log file. It sounds like cron is running if the restart is OK. /var/log/cron.log should list the jobs as they run so that is your check that cron is actually getting it done. Jonathan On 26/11/2012 12:29, Tim Fletcher wrote: > Hi Jonathan (and Felipe), > > Thanks for the advice. Still no joy - and no sign of any cron logs. > Running it manually with the changes you suggested worked so I am > obviously missing something with regard to cron. It's almost as if > nothing is actually running. I think I need to do some more checks with > regard to cron although as far as I know the restart job we have running > each morning is OK. > > Tim > > -----Original Message----- > From: Jonathan Field [mailto:jon...@pt...] > Sent: 26 November 2012 10:55 > To: vuf...@li... > Subject: Re: [VuFind-General] Automating updates - cron help > > Hi Tim, > > You may need to put the full path to the files in IMPORT_SCRIPT and > NEWRECS as, when you run from cron, it will probably use the home > directory as the working directory even if you used the full path to the > script in your cron entry. > > If this doesn't work, try looking at the cron logs (/var/log/cron.log) > to see if there are messages. Or you could put a set -x after the first > line of your shell script to get some more verbose output. > Thanks > Jonathan > > On 26/11/2012 10:43, Tim Fletcher wrote: >> Hi, >> >> I am trying to automate our VuFind daily update process so that newly >> edited records can be imported, and deleted records removed. We will >> then have a fresh import once week at a quiet time. >> >> I have a script that works fine when run manually form the command >> line but I cannot get it to run using cron so if anyone can give me >> some advice about how to fix this it would be much appreciated. >> >> The script for indexing the new & updated records is very simple: >> >> #!/bin/sh >> >> # Import the records to VuFind: >> IMPORT_SCRIPT=import-marc.sh >> NEWRECS=vufind_new_import.mrc >> >> $VUFIND_HOME/$IMPORT_SCRIPT $VUFIND_HOME/$NEWRECS >> >> exit >> >> The marc file is imported as a separate process and is present. The >> cron script has the same permissions as import-marc.sh. >> >> Many thanks, >> >> Tim >> --------------- >> Tim Fletcher >> >> Library Technology Innovation Manager >> Birkbeck, University of London >> Malet Street >> London WC1E 7HX >> >> t.f...@bb... >> >> Tel: 020 7380 3269 >> Fax: 020 7631 6066 >> http://www.bbk.ac.uk/lib/ >> >> >> ---------------------------------------------------------------------- >> -------- Monitor your physical, virtual and cloud infrastructure from >> a single web console. Get in-depth insight into apps, servers, >> databases, vmware, SAP, cloud infrastructure, etc. Download 30-day >> Free Trial. >> Pricing starts from $795 for 25 servers or applications! >> http://p.sf.net/sfu/zoho_dev2dev_nov >> _______________________________________________ >> VuFind-General mailing list >> VuF...@li... >> https://lists.sourceforge.net/lists/listinfo/vufind-general >> > -- Jonathan Field Technical Director, PTFS Europe Limited Content Management and Library Solutions +44 (0) 800 756 6803 (phone) +44 (0) 7919 372002 (mobile) +44 (0) 800 756 6384 (fax) jon...@pt... skype: jonathan.field2 http://www.ptfs-europe.com |
From: Osullivan L. <L.O...@sw...> - 2012-11-26 12:36:47
|
For reference, here's what we do - explicitly setting VUFIND_HOME might help... #cron # Update records 15 7 * * * /usr/local/vufindScripts/update_ifind.sh > /var/log/vufind/update_ifind.log 2>&1 #update_ifind.sh cd /usr/local/preproc export VUFIND_HOME=/usr/local/vufind cat /usr/local/marc/swanac/vufindsu.mrc /usr/local/marc/swanac/vufindsu_bibswithchangedmfhds.mrc > ./suaddamend.mrc /usr/local/vufindScripts/marc_merge_mfhd.pl suaddamend.mrc suload.mrc cat /usr/local/marc/swanac/deleted.bib.marc /usr/local/marc/swanac/vufindsu_suppressed.mrc > ./sudeletes.mrc /usr/local/vufindScripts/marc_removals.pl sudeletes.mrc suremove.mrc 20 cd /usr/local/vufind ./import-marc.sh /usr/local/preproc/suload.mrc cd /usr/local/vufind/util php deletes.php /usr/local/preproc/suremove.mrc /usr/local/vufind/index-alphabetic-browse.sh ________________________________________ From: Tim Fletcher [T.F...@bb...] Sent: 26 November 2012 12:29 To: jon...@pt...; vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help Hi Jonathan (and Felipe), Thanks for the advice. Still no joy - and no sign of any cron logs. Running it manually with the changes you suggested worked so I am obviously missing something with regard to cron. It's almost as if nothing is actually running. I think I need to do some more checks with regard to cron although as far as I know the restart job we have running each morning is OK. Tim -----Original Message----- From: Jonathan Field [mailto:jon...@pt...] Sent: 26 November 2012 10:55 To: vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help Hi Tim, You may need to put the full path to the files in IMPORT_SCRIPT and NEWRECS as, when you run from cron, it will probably use the home directory as the working directory even if you used the full path to the script in your cron entry. If this doesn't work, try looking at the cron logs (/var/log/cron.log) to see if there are messages. Or you could put a set -x after the first line of your shell script to get some more verbose output. Thanks Jonathan On 26/11/2012 10:43, Tim Fletcher wrote: > Hi, > > I am trying to automate our VuFind daily update process so that newly > edited records can be imported, and deleted records removed. We will > then have a fresh import once week at a quiet time. > > I have a script that works fine when run manually form the command > line but I cannot get it to run using cron so if anyone can give me > some advice about how to fix this it would be much appreciated. > > The script for indexing the new & updated records is very simple: > > #!/bin/sh > > # Import the records to VuFind: > IMPORT_SCRIPT=import-marc.sh > NEWRECS=vufind_new_import.mrc > > $VUFIND_HOME/$IMPORT_SCRIPT $VUFIND_HOME/$NEWRECS > > exit > > The marc file is imported as a separate process and is present. The > cron script has the same permissions as import-marc.sh. > > Many thanks, > > Tim > --------------- > Tim Fletcher > > Library Technology Innovation Manager > Birkbeck, University of London > Malet Street > London WC1E 7HX > > t.f...@bb... > > Tel: 020 7380 3269 > Fax: 020 7631 6066 > http://www.bbk.ac.uk/lib/ > > > ---------------------------------------------------------------------- > -------- Monitor your physical, virtual and cloud infrastructure from > a single web console. Get in-depth insight into apps, servers, > databases, vmware, SAP, cloud infrastructure, etc. Download 30-day > Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > -- Jonathan Field Technical Director, PTFS Europe Limited Content Management and Library Solutions jon...@pt... skype: jonathan.field2 http://www.ptfs-europe.com ------------------------------------------------------------------------ ------ Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov _______________________________________________ VuFind-General mailing list VuF...@li... https://lists.sourceforge.net/lists/listinfo/vufind-general ------------------------------------------------------------------------------ Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov _______________________________________________ VuFind-General mailing list VuF...@li... https://lists.sourceforge.net/lists/listinfo/vufind-general |
From: Filipe MS B. (UA) <fs...@ua...> - 2012-11-26 12:57:59
|
Actually, if VuFind is installed in the default "/usr/local/vufind" directory, it shouldn't be necessary to include the full path or define/export $VUFIND_HOME environment variable, as import-marc.sh script checks if all the necessary VuFind related environment variables are set and if they aren't (string length = 0 > "-z" in the if clause bellow) it defines them to the default value. Sample from VuFind 1.x: ------ ################################################## # Set VUFIND_HOME ################################################## if [ -z "$VUFIND_HOME" ] then VUFIND_HOME="/usr/local/vufind" fi ----- Sample from VF2: -------------- if not "!%VUFIND_HOME%!"=="!!" goto vufindhomefound rem VUFIND_HOME not set -- try to call vufind.bat to rem fix the problem before we give up completely if exist vufind.bat goto usevufindbat --------------- So, Tim (et al.) I guess the problem lies somewhere else but like Jonathan suggested and Luke has ( > /var/log/vufind/update_ifind.log 2>&1 ), redirecting the output of the script to a log file, checking should give some insight of what's going on (or not). -- Filipe -------------------------- Filipe Manuel S. Bento | http://about.filipebento.pt/ |
From: Filipe MS B. (UA) <fs...@ua...> - 2012-11-26 13:03:18
|
PS: Sorry forgot to mentioned that the VuFind 2 sample was from the .bat (as you've probably guessed looking at it). >From the .sh, it's the same code, taking a fast look at it, that checks that out in VF1.x: ################################################## # Set VUFIND_HOME ################################################## if [ -z "$VUFIND_HOME" ] then VUFIND_HOME="/usr/local/vufind" fi On Mon, Nov 26, 2012 at 12:57 PM, Filipe MS Bento (UA) <fs...@ua...> wrote: > Actually, if VuFind is installed in the default "/usr/local/vufind" > directory, it shouldn't be necessary to include the full path or > define/export $VUFIND_HOME environment variable, as import-marc.sh > script checks if all the necessary VuFind related environment > variables are set and if they aren't (string length = 0 > "-z" in the > if clause bellow) it defines them to the default value. > > Sample from VuFind 1.x: > > ------ > > ################################################## > # Set VUFIND_HOME > ################################################## > if [ -z "$VUFIND_HOME" ] > then > VUFIND_HOME="/usr/local/vufind" > fi > > ----- > > Sample from VF2: > > -------------- > > if not "!%VUFIND_HOME%!"=="!!" goto vufindhomefound > rem VUFIND_HOME not set -- try to call vufind.bat to > rem fix the problem before we give up completely > if exist vufind.bat goto usevufindbat > > --------------- > > So, Tim (et al.) I guess the problem lies somewhere else but like > Jonathan suggested and Luke has ( > /var/log/vufind/update_ifind.log > 2>&1 ), redirecting the output of the script to a log file, checking > should give some insight of what's going on (or not). > > -- Filipe > > > -------------------------- > > Filipe Manuel S. Bento | http://about.filipebento.pt/ |
From: Tim F. <T.F...@bb...> - 2012-11-26 13:09:53
|
Thanks everyone for all the advice. I'm off to meetings but will try to digest it all and have another go later, or tomorrow morning. Best wishes, Tim -----Original Message----- From: Filipe MS Bento (UA) [mailto:fs...@ua...] Sent: 26 November 2012 13:03 To: Tim Fletcher; vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help PS: Sorry forgot to mentioned that the VuFind 2 sample was from the .bat (as you've probably guessed looking at it). From the .sh, it's the same code, taking a fast look at it, that checks that out in VF1.x: ################################################## # Set VUFIND_HOME ################################################## if [ -z "$VUFIND_HOME" ] then VUFIND_HOME="/usr/local/vufind" fi On Mon, Nov 26, 2012 at 12:57 PM, Filipe MS Bento (UA) <fs...@ua...> wrote: > Actually, if VuFind is installed in the default "/usr/local/vufind" > directory, it shouldn't be necessary to include the full path or > define/export $VUFIND_HOME environment variable, as import-marc.sh > script checks if all the necessary VuFind related environment > variables are set and if they aren't (string length = 0 > "-z" in the > if clause bellow) it defines them to the default value. > > Sample from VuFind 1.x: > > ------ > > ################################################## > # Set VUFIND_HOME > ################################################## > if [ -z "$VUFIND_HOME" ] > then > VUFIND_HOME="/usr/local/vufind" > fi > > ----- > > Sample from VF2: > > -------------- > > if not "!%VUFIND_HOME%!"=="!!" goto vufindhomefound rem VUFIND_HOME > not set -- try to call vufind.bat to rem fix the problem before we > give up completely if exist vufind.bat goto usevufindbat > > --------------- > > So, Tim (et al.) I guess the problem lies somewhere else but like > Jonathan suggested and Luke has ( > /var/log/vufind/update_ifind.log > 2>&1 ), redirecting the output of the script to a log file, checking > should give some insight of what's going on (or not). > > -- Filipe > > > -------------------------- > > Filipe Manuel S. Bento | http://about.filipebento.pt/ |
From: Stephen H. <ho...@bu...> - 2012-11-26 13:13:10
|
This is likely a dumb question - but I'm close to implementing and never asked. When importing new/changed - so I shut vufind down, run the import, then bring it back up? Or run the import and just do a restart? -----Original Message----- From: Filipe MS Bento (UA) [mailto:fs...@ua...] Sent: Monday, November 26, 2012 7:57 AM To: Osullivan L. Cc: Tim Fletcher; vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help Actually, if VuFind is installed in the default "/usr/local/vufind" directory, it shouldn't be necessary to include the full path or define/export $VUFIND_HOME environment variable, as import-marc.sh script checks if all the necessary VuFind related environment variables are set and if they aren't (string length = 0 > "-z" in the if clause bellow) it defines them to the default value. Sample from VuFind 1.x: ------ ################################################## # Set VUFIND_HOME ################################################## if [ -z "$VUFIND_HOME" ] then VUFIND_HOME="/usr/local/vufind" fi ----- Sample from VF2: -------------- if not "!%VUFIND_HOME%!"=="!!" goto vufindhomefound rem VUFIND_HOME not set -- try to call vufind.bat to rem fix the problem before we give up completely if exist vufind.bat goto usevufindbat --------------- So, Tim (et al.) I guess the problem lies somewhere else but like Jonathan suggested and Luke has ( > /var/log/vufind/update_ifind.log 2>&1 ), redirecting the output of the script to a log file, checking should give some insight of what's going on (or not). -- Filipe -------------------------- Filipe Manuel S. Bento | http://about.filipebento.pt/ ------------------------------------------------------------------------------ Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov _______________________________________________ VuFind-General mailing list VuF...@li... https://lists.sourceforge.net/lists/listinfo/vufind-general The Buffalo & Erie County Public Library System has more than 2.6 million materials available for borrowing including books, eBooks, DVDs, music and more. Free library card applications can be downloaded and taken to any of the 37- local public libraries for processing. A valid form of identification and proof of address is necessary. For more information call 716-858-8900 or visit www.BuffaloLib.org . |
From: Filipe MS B. (UA) <fs...@ua...> - 2012-11-26 13:20:32
|
Hi! MARC or OAI records import: no need to anything else (even restart Vufind, at least in VF 1.x). Pure "Plug & Play" :) All the best, -- Filipe PS: But I guess a VuFind restart won't hurt... (especially after a huge amount of OAI records import) On Mon, Nov 26, 2012 at 1:00 PM, Stephen Hovey <ho...@bu...> wrote: > This is likely a dumb question - but I'm close to implementing and never asked. > > When importing new/changed - so I shut vufind down, run the import, then bring it back up? Or run the import and just do a restart? > > -----Original Message----- > From: Filipe MS Bento (UA) [mailto:fs...@ua...] > Sent: Monday, November 26, 2012 7:57 AM > To: Osullivan L. > Cc: Tim Fletcher; vuf...@li... > Subject: Re: [VuFind-General] Automating updates - cron help > > Actually, if VuFind is installed in the default "/usr/local/vufind" > directory, it shouldn't be necessary to include the full path or > define/export $VUFIND_HOME environment variable, as import-marc.sh > script checks if all the necessary VuFind related environment > variables are set and if they aren't (string length = 0 > "-z" in the > if clause bellow) it defines them to the default value. > > Sample from VuFind 1.x: > > ------ > > ################################################## > # Set VUFIND_HOME > ################################################## > if [ -z "$VUFIND_HOME" ] > then > VUFIND_HOME="/usr/local/vufind" > fi > > ----- > > Sample from VF2: > > -------------- > > if not "!%VUFIND_HOME%!"=="!!" goto vufindhomefound > rem VUFIND_HOME not set -- try to call vufind.bat to > rem fix the problem before we give up completely > if exist vufind.bat goto usevufindbat > > --------------- > > So, Tim (et al.) I guess the problem lies somewhere else but like > Jonathan suggested and Luke has ( > /var/log/vufind/update_ifind.log > 2>&1 ), redirecting the output of the script to a log file, checking > should give some insight of what's going on (or not). > > -- Filipe > > > -------------------------- > > Filipe Manuel S. Bento | http://about.filipebento.pt/ > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > > > The Buffalo & Erie County Public Library System has more than 2.6 million materials available for borrowing including books, eBooks, DVDs, music and more. Free library card applications can be downloaded and taken to any of the 37- local public libraries for processing. A valid form of identification and proof of address is necessary. For more information call 716-858-8900 or visit www.BuffaloLib.org . > > ------------------------------------------------------------------------------ > Monitor your physical, virtual and cloud infrastructure from a single > web console. Get in-depth insight into apps, servers, databases, vmware, > SAP, cloud infrastructure, etc. Download 30-day Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general |
From: Tim F. <T.F...@bb...> - 2012-11-27 14:34:11
|
Hi everyone, Many thanks for the suggestions - I seem to have got things working now. Once I had sorted out the logging issue by changing the permissions on the log folder (thanks, Luke) I was able to see where I was going wrong and it does appear that explicitly setting the $VUIFIND_HOME variable does help a great deal. I've also got my deletions running as well, after grinding to a halt with one tiny typo! When I get a chance I will try to put some notes about how we are doing this on the VuFind site in case it is of interest for any other Horizon libraries. Best wishes, Tim -----Original Message----- From: Filipe MS Bento (UA) [mailto:fs...@ua...] Sent: 26 November 2012 13:20 To: Stephen Hovey Cc: Osullivan L.; Tim Fletcher; vuf...@li... Subject: Re: [VuFind-General] Automating updates - cron help Hi! MARC or OAI records import: no need to anything else (even restart Vufind, at least in VF 1.x). Pure "Plug & Play" :) All the best, -- Filipe PS: But I guess a VuFind restart won't hurt... (especially after a huge amount of OAI records import) On Mon, Nov 26, 2012 at 1:00 PM, Stephen Hovey <ho...@bu...> wrote: > This is likely a dumb question - but I'm close to implementing and never asked. > > When importing new/changed - so I shut vufind down, run the import, then bring it back up? Or run the import and just do a restart? > > -----Original Message----- > From: Filipe MS Bento (UA) [mailto:fs...@ua...] > Sent: Monday, November 26, 2012 7:57 AM > To: Osullivan L. > Cc: Tim Fletcher; vuf...@li... > Subject: Re: [VuFind-General] Automating updates - cron help > > Actually, if VuFind is installed in the default "/usr/local/vufind" > directory, it shouldn't be necessary to include the full path or > define/export $VUFIND_HOME environment variable, as import-marc.sh > script checks if all the necessary VuFind related environment > variables are set and if they aren't (string length = 0 > "-z" in the > if clause bellow) it defines them to the default value. > > Sample from VuFind 1.x: > > ------ > > ################################################## > # Set VUFIND_HOME > ################################################## > if [ -z "$VUFIND_HOME" ] > then > VUFIND_HOME="/usr/local/vufind" > fi > > ----- > > Sample from VF2: > > -------------- > > if not "!%VUFIND_HOME%!"=="!!" goto vufindhomefound rem VUFIND_HOME > not set -- try to call vufind.bat to rem fix the problem before we > give up completely if exist vufind.bat goto usevufindbat > > --------------- > > So, Tim (et al.) I guess the problem lies somewhere else but like > Jonathan suggested and Luke has ( > /var/log/vufind/update_ifind.log > 2>&1 ), redirecting the output of the script to a log file, checking > should give some insight of what's going on (or not). > > -- Filipe > > > -------------------------- > > Filipe Manuel S. Bento | http://about.filipebento.pt/ > > ---------------------------------------------------------------------- > -------- Monitor your physical, virtual and cloud infrastructure from > a single web console. Get in-depth insight into apps, servers, > databases, vmware, SAP, cloud infrastructure, etc. Download 30-day > Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general > > > The Buffalo & Erie County Public Library System has more than 2.6 million materials available for borrowing including books, eBooks, DVDs, music and more. Free library card applications can be downloaded and taken to any of the 37- local public libraries for processing. A valid form of identification and proof of address is necessary. For more information call 716-858-8900 or visit www.BuffaloLib.org . > > ---------------------------------------------------------------------- > -------- Monitor your physical, virtual and cloud infrastructure from > a single web console. Get in-depth insight into apps, servers, > databases, vmware, SAP, cloud infrastructure, etc. Download 30-day > Free Trial. > Pricing starts from $795 for 25 servers or applications! > http://p.sf.net/sfu/zoho_dev2dev_nov > _______________________________________________ > VuFind-General mailing list > VuF...@li... > https://lists.sourceforge.net/lists/listinfo/vufind-general |