From: James F. <jfa...@dr...> - 2008-03-31 20:40:50
|
Andrew, If you get rid of import.properties, where will we set this? # Field for generating the unique ID for Solr # For 001 - 010, subfield is not used # ex. # control.field = 035 # control.subfield = a control.field = 001 control.subfield = Jim >>> Andrew Nagy <and...@vi...> 03/31/08 3:32 PM >>> We can also get rid of the import.properties file at this point too since all of the path info is in the vufind_home var. Andrew From: Andrew Nagy Sent: Monday, March 31, 2008 3:30 PM To: 'Wayne Graham'; VuFind-General; vuf...@li... Subject: RE: [VuFind-Tech] Bugs in 0.8 Wayne - can't we just also include the vufind_home var in the import.sh file as well. Since the vufind.sh script must be run before hand, the vufind_home var is set. This can make for a good check as well to make sure solr is running by checking to see if vufind_home is set. Andrew From: vuf...@li... [mailto:vuf...@li...] On Behalf Of Wayne Graham Sent: Thursday, March 27, 2008 4:39 PM To: VuFind-General; vuf...@li... Subject: [VuFind-Tech] Bugs in 0.8 There are two rather major bugs that have surfaced in the 0.8 release that I wanted everyone to know about, along with the fixes. First, as many of you have figured out, the import.sh script is in the root of the vufind folder and the import.properties file needs to be in the same folder. The easiest fix is to either move the import.properties file up, or the import.sh script into the import folder. The second bug is also related to the import.sh script. The variable SOLR_DATA_DIR is not being set properly. I will be committing a fix to both the trunk and Vufind-0.8 branch shortly, but wanted to let folks know that if you've indexed in 0.8, your index has most likely gone to /index (in root). You can just move these files into your $SOLR_HOME/data/index. In the mean time, here is the condensed fix with the import.sh script: #!/bin/sh INDEX_OPTIONS="-Xms256m -Xmx256m" if [ -z "$SOLR_HOME" ] then echo "You need to set the SOLR_HOME environmental variable before running this script." exit 1 fi if [ "$SOLR_HOME" ] then INDEX_OPTIONS="$INDEX_OPTIONS -Dsolr.solr.home=$SOLR_HOME" INDEX_OPTIONS="$INDEX_OPTIONS -Dsolr.data.dir=$SOLR_HOME/data" fi java $INDEX_OPTIONS -jar import/import.jar |
From: Andrew N. <and...@vi...> - 2008-03-31 21:39:29
|
In the new mapping file ... that currently does not yet exist :) Andrew > -----Original Message----- > From: James Farrugia [mailto:jfa...@dr...] > Sent: Monday, March 31, 2008 4:41 PM > To: vuf...@li...; vufind- > te...@li...; Andrew Nagy; ws...@wm... > Subject: Re: [VuFind-General] [VuFind-Tech] Bugs in 0.8 > > Andrew, > > If you get rid of import.properties, where will we set this? > > # Field for generating the unique ID for Solr > # For 001 - 010, subfield is not used > # ex. > # control.field = 035 > # control.subfield = a > control.field = 001 > control.subfield = > > > Jim > > >>> Andrew Nagy <and...@vi...> 03/31/08 3:32 PM >>> > We can also get rid of the import.properties file at this point too > since all of the path info is in the vufind_home var. > > Andrew > > From: Andrew Nagy > Sent: Monday, March 31, 2008 3:30 PM > To: 'Wayne Graham'; VuFind-General; vuf...@li... > Subject: RE: [VuFind-Tech] Bugs in 0.8 > > Wayne - can't we just also include the vufind_home var in the import.sh > file as well. Since the vufind.sh script must be run before hand, the > vufind_home var is set. This can make for a good check as well to make > sure solr is running by checking to see if vufind_home is set. > > Andrew > > From: vuf...@li... [mailto:vufind-tech- > bo...@li...] On Behalf Of Wayne Graham > Sent: Thursday, March 27, 2008 4:39 PM > To: VuFind-General; vuf...@li... > Subject: [VuFind-Tech] Bugs in 0.8 > > There are two rather major bugs that have surfaced in the 0.8 release > that I wanted everyone to know about, along with the fixes. > > First, as many of you have figured out, the import.sh script is in the > root of the vufind folder and the import.properties file needs to be in > the same folder. The easiest fix is to either move the > import.properties file up, or the import.sh script into the import > folder. > > The second bug is also related to the import.sh script. The variable > SOLR_DATA_DIR is not being set properly. I will be committing a fix to > both the trunk and Vufind-0.8 branch shortly, but wanted to let folks > know that if you've indexed in 0.8, your index has most likely gone to > /index (in root). You can just move these files into your > $SOLR_HOME/data/index. > > In the mean time, here is the condensed fix with the import.sh script: > > #!/bin/sh > INDEX_OPTIONS="-Xms256m -Xmx256m" > if [ -z "$SOLR_HOME" ] > then > echo "You need to set the SOLR_HOME environmental variable before > running this script." > exit 1 > fi > > if [ "$SOLR_HOME" ] > then > INDEX_OPTIONS="$INDEX_OPTIONS -Dsolr.solr.home=$SOLR_HOME" > INDEX_OPTIONS="$INDEX_OPTIONS -Dsolr.data.dir=$SOLR_HOME/data" > fi > > java $INDEX_OPTIONS -jar import/import.jar |
From: Wayne G. <ws...@wm...> - 2008-03-31 22:51:51
|
The control field is same as the id field in Solr. If you get rid of the import.properties file, you'll need to pass some variables to the command line... On Mon, Mar 31, 2008 at 5:35 PM, Andrew Nagy <and...@vi...> wrote: > In the new mapping file ... that currently does not yet exist :) > > Andrew > > > -----Original Message----- > > From: James Farrugia [mailto:jfa...@dr...] > > Sent: Monday, March 31, 2008 4:41 PM > > To: vuf...@li...; vufind- > > te...@li...; Andrew Nagy; ws...@wm... > > Subject: Re: [VuFind-General] [VuFind-Tech] Bugs in 0.8 > > > > Andrew, > > > > If you get rid of import.properties, where will we set this? > > > > # Field for generating the unique ID for Solr > > # For 001 - 010, subfield is not used > > # ex. > > # control.field = 035 > > # control.subfield = a > > control.field = 001 > > control.subfield = > > > > > > Jim > > > > >>> Andrew Nagy <and...@vi...> 03/31/08 3:32 PM >>> > > We can also get rid of the import.properties file at this point too > > since all of the path info is in the vufind_home var. > > > > Andrew > > > > From: Andrew Nagy > > Sent: Monday, March 31, 2008 3:30 PM > > To: 'Wayne Graham'; VuFind-General; vuf...@li... > > Subject: RE: [VuFind-Tech] Bugs in 0.8 > > > > Wayne - can't we just also include the vufind_home var in the import.sh > > file as well. Since the vufind.sh script must be run before hand, the > > vufind_home var is set. This can make for a good check as well to make > > sure solr is running by checking to see if vufind_home is set. > > > > Andrew > > > > From: vuf...@li... [mailto:vufind-tech- > > bo...@li...] On Behalf Of Wayne Graham > > Sent: Thursday, March 27, 2008 4:39 PM > > To: VuFind-General; vuf...@li... > > Subject: [VuFind-Tech] Bugs in 0.8 > > > > There are two rather major bugs that have surfaced in the 0.8 release > > that I wanted everyone to know about, along with the fixes. > > > > First, as many of you have figured out, the import.sh script is in the > > root of the vufind folder and the import.properties file needs to be in > > the same folder. The easiest fix is to either move the > > import.properties file up, or the import.sh script into the import > > folder. > > > > The second bug is also related to the import.sh script. The variable > > SOLR_DATA_DIR is not being set properly. I will be committing a fix to > > both the trunk and Vufind-0.8 branch shortly, but wanted to let folks > > know that if you've indexed in 0.8, your index has most likely gone to > > /index (in root). You can just move these files into your > > $SOLR_HOME/data/index. > > > > In the mean time, here is the condensed fix with the import.sh script: > > > > #!/bin/sh > > INDEX_OPTIONS="-Xms256m -Xmx256m" > > if [ -z "$SOLR_HOME" ] > > then > > echo "You need to set the SOLR_HOME environmental variable before > > running this script." > > exit 1 > > fi > > > > if [ "$SOLR_HOME" ] > > then > > INDEX_OPTIONS="$INDEX_OPTIONS -Dsolr.solr.home=$SOLR_HOME" > > INDEX_OPTIONS="$INDEX_OPTIONS -Dsolr.data.dir=$SOLR_HOME/data" > > fi > > > > java $INDEX_OPTIONS -jar import/import.jar > > |