Menu

Compile

Anonymous

This code was developed and tested in the Linux environment (Red Hat Enterprise Linux 5).

Requirements

Maven 2.x:

Step-by-step

Checkout Hadoop (branch-0.14):

  • svn co http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.14 hadoop
    Install Hadoop:
  • cd hadoop
  • ant

  • ant jar

  • mvn install:install-file -DgroupId=org.apache -DartifactId=hadoop -Dversion=0.14.5-dev-core -Dpackaging=jar -Dfile=build/hadoop-0.14.5-dev-core.jar

This version of Hadoop (http://hadoop.apache.org/) must be used for all mapreduce processing.

Checkout PwaLucene + PwaArchiveAccess:

  • svn checkout http://pwa-technologies.googlecode.com/svn/trunk/ pwa-technologies
    Install PwaLucene:

  • cd pwa-technologies/PwaLucene

  • mvn install
    Install PwaArchiveAccess:

  • cd pwa-technologies/PwaArchive-access

  • mvn install
  • configure
  • mvn install (only if configuration was changed)

The JAR and WAR files are available in:

  • pwa-technologies/PwaArchive-access/projects/nutchwax/nutchwax-job/target/nutchwax-job-0.11.0-SNAPSHOT.jar
  • pwa-technologies/PwaArchive-access/projects/nutchwax/nutchwax-webapp/target/nutchwax-webapp-0.11.0-SNAPSHOT.war
  • pwa-technologies/PwaArchive-access/projects/wayback/wayback-webapp/target/wayback-1.2.1.war
  • pwa-technologies/PwaLucene/target/pwalucene-1.0.0-SNAPSHOT.jar

Others

Symbolic link of nutch for nutch-trec:

  • cd pwa-technologies/PwaArchive-access
  • ln -s ../../projects/nutchwax/nutchwax-thirdparty/nutch/ projects/nutch-trec/

This is only necessary if you will use the TREC datasets for tests.


Related

Wiki: Install
Wiki: Operation
Wiki: PwaArchiveAccess
Wiki: PwaLucene

Auth0 Logo