[Archive-access-discuss] Env Setup Help for Large Set of ARCs

[Alex Wu <aw...@sd...>]

Hi,

We have a project with about 48000 ARC files, and would like inputs  
on the best way to implement the wayback machine 0.6.0

Our setup is Tomcat 5.5.17, JDK 1.5, 1GB memory for JVM. We have only  
6000 ARCs indexed at this point over a 1 week period. We would like  
to increase this rate significantly.


Some questions we have are:

1. Suggested environment setup for this number of ARC files and greater.

2. Parallel indexing option for the current version or additional  
tools that will allow for this.

3. The index is tied to the machine name. How to avoid this.

4. Is it possible to have multiple wayback installations, each with  
its own JVM, use the same arc files and/or index.

5. The user manual at http://archive-access.sourceforge.net/projects/ 
wayback/user_manual.html mentions a non-LocalBDBResourceIndex  
resource implementation that communicates with a remote wayback  
installation. The user manual does not cover the preparation of the  
index data. What are the steps for this setup, including index data  
preparation.

6. Is there a limitation to the number of ARCs wayback will handle.


Thank you for your input.

Alex Wu
858-534-5074