[Archive-access-cvs] SF.net SVN: archive-access:[2952] tags/nutchwax-0_12_9/archive/src/java/org /archive/nutchwax/Importer.java

[<bi...@us...>]

Revision: 2952
          http://archive-access.svn.sourceforge.net/archive-access/?rev=2952&view=rev
Author:   binzino
Date:     2010-01-19 22:11:50 +0000 (Tue, 19 Jan 2010)

Log Message:
-----------
Added property check to disable writing of crawl datum.

Modified Paths:
--------------
    tags/nutchwax-0_12_9/archive/src/java/org/archive/nutchwax/Importer.java

Modified: tags/nutchwax-0_12_9/archive/src/java/org/archive/nutchwax/Importer.java
===================================================================
--- tags/nutchwax-0_12_9/archive/src/java/org/archive/nutchwax/Importer.java	2010-01-13 01:31:20 UTC (rev 2951)
+++ tags/nutchwax-0_12_9/archive/src/java/org/archive/nutchwax/Importer.java	2010-01-19 22:11:50 UTC (rev 2952)
@@ -465,7 +465,11 @@
     
     try
       {
-        output.collect( key, new NutchWritable( datum ) );
+        // Back-port this little change from NutchWAX 0.13.  We don't need the crawl datum.
+        if ( jobConf.getBoolean( "nutchwax.import.store.crawl", false ) )
+          {
+            output.collect( key, new NutchWritable( datum ) );
+          }
 
         if ( jobConf.getBoolean( "nutchwax.import.store.content", false ) )
           {


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.