[Archive-crawler-cvs] SF.net SVN: archive-crawler:[6530] trunk

[<sz...@us...>]

Revision: 6530
          http://archive-crawler.svn.sourceforge.net/archive-crawler/?rev=6530&view=rev
Author:   szznax
Date:     2009-09-30 17:06:53 +0000 (Wed, 30 Sep 2009)

Log Message:
-----------
As part of fix for [HER-1634] verify/port/update latest WARC
implementation in 1.14.3/heritrix2 to latest ISO document,
heritrix3 - in warcinfo record, "robots" field should be
"robots: classic" rather than "robots: CLASSIC"
* WARCWriterProcessor.java
  made robots entry in metadata lower-case

Modified Paths:
--------------
    trunk/heritrix2/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java
    trunk/heritrix3/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java

Modified: trunk/heritrix2/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java
===================================================================
--- trunk/heritrix2/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java	2009-09-30 02:30:43 UTC (rev 6529)
+++ trunk/heritrix2/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java	2009-09-30 17:06:53 UTC (rev 6530)
@@ -572,7 +572,7 @@
 //                }
 //            }
         addIfNotBlank(record,"description", provider.getJobDescription());
-        addIfNotBlank(record,"robots", provider.getRobotsPolicy());
+        addIfNotBlank(record,"robots", provider.getRobotsPolicy().toLowerCase());
 
         addIfNotBlank(record,"http-header-user-agent",
                 provider.getUserAgent());

Modified: trunk/heritrix3/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java
===================================================================
--- trunk/heritrix3/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java	2009-09-30 02:30:43 UTC (rev 6529)
+++ trunk/heritrix3/modules/src/main/java/org/archive/modules/writer/WARCWriterProcessor.java	2009-09-30 17:06:53 UTC (rev 6530)
@@ -547,7 +547,7 @@
 //                }
 //            }
         addIfNotBlank(record,"description", provider.getDescription());
-        addIfNotBlank(record,"robots", provider.getRobotsPolicyName());
+        addIfNotBlank(record,"robots", provider.getRobotsPolicyName().toLowerCase());
 
         addIfNotBlank(record,"http-header-user-agent",
                 provider.getUserAgent());


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.