This code was developed and tested in the Linux environment (Red Hat Enterprise Linux 5).
Maven 2.x:
Checkout Hadoop (branch-0.14):
svn co http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.14 hadoopcd hadoopant
ant jar
mvn install:install-file -DgroupId=org.apache -DartifactId=hadoop -Dversion=0.14.5-dev-core -Dpackaging=jar -Dfile=build/hadoop-0.14.5-dev-core.jar
This version of Hadoop (http://hadoop.apache.org/) must be used for all mapreduce processing.
Checkout PwaLucene + PwaArchiveAccess:
svn checkout http://pwa-technologies.googlecode.com/svn/trunk/ pwa-technologies
Install PwaLucene:
cd pwa-technologies/PwaLucene
mvn install
Install PwaArchiveAccess:
cd pwa-technologies/PwaArchive-access
mvn installmvn install (only if configuration was changed)The JAR and WAR files are available in:
pwa-technologies/PwaArchive-access/projects/nutchwax/nutchwax-job/target/nutchwax-job-0.11.0-SNAPSHOT.jarpwa-technologies/PwaArchive-access/projects/nutchwax/nutchwax-webapp/target/nutchwax-webapp-0.11.0-SNAPSHOT.warpwa-technologies/PwaArchive-access/projects/wayback/wayback-webapp/target/wayback-1.2.1.warpwa-technologies/PwaLucene/target/pwalucene-1.0.0-SNAPSHOT.jarSymbolic link of nutch for nutch-trec:
cd pwa-technologies/PwaArchive-accessln -s ../../projects/nutchwax/nutchwax-thirdparty/nutch/ projects/nutch-trec/This is only necessary if you will use the TREC datasets for tests.
Wiki: Install
Wiki: Operation
Wiki: PwaArchiveAccess
Wiki: PwaLucene