Re: [VuFind-General] Indexing harvester records using batch import

[Dinesh R. <ran...@gm...>]

Thanks for the utility. Since I am currently working on marc records, its
quite helpful.

I am working on windows system and when I run the merge.php script in cmd
prompt, it just prints all the records as a merged record.
But I am not able to locate the saved file for indexing. Please let me know
if any variable has to be set for the location of the file.

regards,
Dinesh

On Fri, Jun 1, 2012 at 4:43 PM, Demian Katz <dem...@vi...>wrote:

>  What type of records are you indexing?  If you are harvesting and
> indexing MARC records, you might find the script on this ticket helpful:
>
> http://vufind.org/jira/browse/VUFIND-459
>
> This will merge multiple MARCXML files into a single file.  This should
> allow faster MARC importing.
>
> If you are importing non-MARC records, I don't think there is a lot you
> can do.  The process is designed to handle one record at a time, and if you
> are including full-text indexing in the process, that naturally slows
> things down since a lot of extra downloading and processing is involved.
> Depending on exactly what you are working with, there may be some room for
> improvement, but it will likely involve significant work -- like, for
> example, rewriting the import tools to run in a faster language like Java,
> or changing your import to use SolrMarc's recently added XPath support.
>
> Let me know if you need more details on anything!
>
> - Demian
>  ------------------------------
> *From:* Dinesh Ranjan [ran...@gm...]
> *Sent:* Friday, June 01, 2012 3:50 AM
> *To:* vuf...@li...
> *Subject:* [VuFind-General] Indexing harvester records using batch import
>
>  Hi all,
>
> I am trying to index harvested records using vufind. But, while indexing
> for harvested records using the batch-import, it takes a long time to index
> the records. But incase of import-marc script where it takes a single file
> for import, the indexing works very fast.
>
> Can any one suggest if there is any other option for indexing the
> harvested records faster.
>
> Thanks & regards,
> Dinesh
>
>
>


-- 
Dinesh Ranjan Pradhan
Scientific Technical Officer (LS)
INFLIBNET Centre
(An IUC of UGC)