Re: [VuFind-General] Java Importer

[Antonio B. <abarrera@Princeton.EDU>]

Perfect.  First import of 90k records took about 40 minutes.  I'll be
working my way up to 4 mill, using this.  This is my slower importing
machine, but nonetheless it is a big improvement, considering it also
does the marc conversion.

I'll report errors to you as always.

To those of you who are idiots like me and couldn't figure this out:

>From the vufind directory:

ant compile
cp -R $VUFIND_HOME/java/lib $VUFIND_HOME/import
ant jar
Edit the $VUFIND_HOME/import/import.properties file "make sure there's a
trailing slash at the end of the output.path variable"
cd import
java -jar vufind-0.7-dev....jar

Antonio

-----Original Message-----
From: Wayne Graham [mailto:ws...@wm...]=20
Sent: Wednesday, November 07, 2007 3:22 PM
To: Antonio Barrera
Cc: vuf...@li...
Subject: Re: [VuFind-General] Java Importer

The ant script _should_ be putting the compiled jar file in the import
folder. Since it's still in development, you'll get a really long dev
string with a timestamp on it (e.g
vufind-0.7-dev.2007.11.07.20.18.17.jar). After you run "ant jar" in the
$VUFIND_HOME folder, do you see a bunch of output about making directory
and copying?

Antonio Barrera wrote:
> No, errors, but where is the vufind-0.7-dev supposed to be built?  I
> don't see it in import.
>=20
> -----Original Message-----
> From: Wayne Graham [mailto:ws...@wm...]=20
> Sent: Wednesday, November 07, 2007 1:10 PM
> To: Antonio Barrera
> Cc: vuf...@li...
> Subject: Re: [VuFind-General] Java Importer
>=20
> Any errors being reported? I just looked at this and it looks like I
> forgot to include copying the lib folder in the correct place in the
ant
> script. Try this:
>=20
> cp -R $VUFIND_HOME/java/lib $VUFIND_HOME/import
>=20
> Then,
>=20
> java -jar vufind-0.7-dev....jar
>=20
> Wayne
>=20
> Antonio Barrera wrote:
>> Wayne,
>>
>> Ok, I built it, no errors, and configured the
import/import.properties
>> file.  But how do I run it, I don't see anything else in import other
>> than the .php files?
>>
>> Antonio
>>
>> -----Original Message-----
>> From: Wayne Graham [mailto:ws...@wm...]=20
>> Sent: Monday, November 05, 2007 12:01 PM
>> To: Antonio Barrera
>> Cc: vuf...@li...
>> Subject: Re: [VuFind-General] Java Importer
>>
>> Sorry for not getting this out to the list...it's been a bit busy
here
>> the last few weeks.
>>
>> Anyway, the Java importer is in the SVN repository. There are some
> XSLT
>> updates that need to be made (I have them somewhere, but haven't
>> committed them yet) and some more cleanup and documenting to be done.
>>
>> If you're brave, you can try this out, but you'll need Ant installed.
> If
>> you got to the main directory and do
>>
>> ant compile
>>
>> The system should build the files you need in the import file. You'll
>> need to edit the file import.properties with your specific
> information.
>> One VERY import note...make sure there's a trailing slash at the end
> of
>> the output.path variable!!!! This is a bug that I haven't fixed yet.
> If
>> you don't put the trailing slash, it'll put the XML files in your
> vufind
>> directory with a prefix of "data" on it. Again...put a trailing slash
> on
>> the variable!
>>
>> Another note, right now this doesn't update your real index...rather,
> it
>> creates a folder in your import folder for the index that you have to
>> manually move to the correct location. This is intentional until I've
>> finished the code, but you can overwrite this in the
>> solr/config/solrconfig.xml file by putting the path into the dataDir
>> element:
>>
>> <dataDir>${solr.data.dir:/usr/local/vufind/solr:./solr/data}<dataDir>
>>
>> There will (hopefully) be more on this later this week.
>>
>> Wayne
>>
>> Antonio Barrera wrote:
>>> Wayne,
>>>
>>> =20
>>>
>>> Any updates on the Java Importer?
>>>
>>> =20
>>>
>>> Thanks,
>>>
>>> Antonio Barrera
>>>
>>> Princeton University Library
>>>
>>>
>>>
>
------------------------------------------------------------------------
>
------------------------------------------------------------------------
>> -
>>> This SF.net email is sponsored by: Splunk Inc.
>>> Still grepping through log files to find problems?  Stop.
>>> Now Search log events and configuration files using AJAX and a
>> browser.
>>> Download your FREE copy of Splunk now >> http://get.splunk.com/
>>>
>>>
>>>
>
------------------------------------------------------------------------
>>> _______________________________________________
>>> VuFind-General mailing list
>>> VuF...@li...
>>> https://lists.sourceforge.net/lists/listinfo/vufind-general
>=20

--=20
/**
 * Wayne Graham
 * Earl Gregg Swem Library
 * PO Box 8794
 * Williamsburg, VA 23188
 * 757.221.3112
 * http://swem.wm.edu/blogs/waynegraham/
 */