[Archive-access-cvs] SF.net SVN: archive-access:[2699] trunk/archive-access/projects/nutchwax/ archive/src/java/org/archive/nutchwax/Importer.java

[<bi...@us...>]

Revision: 2699
          http://archive-access.svn.sourceforge.net/archive-access/?rev=2699&view=rev
Author:   binzino
Date:     2009-05-05 20:24:22 +0000 (Tue, 05 May 2009)

Log Message:
-----------
WAX-42.  Add option to continue/abort importing after read error on
archive file.

Modified Paths:
--------------
    trunk/archive-access/projects/nutchwax/archive/src/java/org/archive/nutchwax/Importer.java

Modified: trunk/archive-access/projects/nutchwax/archive/src/java/org/archive/nutchwax/Importer.java
===================================================================
--- trunk/archive-access/projects/nutchwax/archive/src/java/org/archive/nutchwax/Importer.java	2009-05-05 20:20:45 UTC (rev 2698)
+++ trunk/archive-access/projects/nutchwax/archive/src/java/org/archive/nutchwax/Importer.java	2009-05-05 20:24:22 UTC (rev 2699)
@@ -210,6 +210,15 @@
             reporter.progress();
           }
       }
+    catch ( Exception e )
+      {
+        LOG.warn( "Error processing archive file: " + arcUrl, e );
+
+        if ( jobConf.getBoolean( "nutchwax.import.abortOnArchiveReadError", false ) )
+          {
+            throw new IOException( e );
+          }
+      }
     finally
       {
         r.close();


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.