[Archive-access-cvs] SF.net SVN: archive-access: [2099] trunk/archive-access/projects/wayback/ wayback-core/src/main/java/org/archive/wayback/accesscontrol/robotstxt/ RobotExclusionFilter.java

[<bra...@us...>]

Revision: 2099
          http://archive-access.svn.sourceforge.net/archive-access/?rev=2099&view=rev
Author:   bradtofel
Date:     2007-11-29 13:06:55 -0800 (Thu, 29 Nov 2007)

Log Message:
-----------
INTERFACE: no longer call parseHeaders on Resource

Modified Paths:
--------------
    trunk/archive-access/projects/wayback/wayback-core/src/main/java/org/archive/wayback/accesscontrol/robotstxt/RobotExclusionFilter.java

Modified: trunk/archive-access/projects/wayback/wayback-core/src/main/java/org/archive/wayback/accesscontrol/robotstxt/RobotExclusionFilter.java
===================================================================
--- trunk/archive-access/projects/wayback/wayback-core/src/main/java/org/archive/wayback/accesscontrol/robotstxt/RobotExclusionFilter.java	2007-11-29 21:05:22 UTC (rev 2098)
+++ trunk/archive-access/projects/wayback/wayback-core/src/main/java/org/archive/wayback/accesscontrol/robotstxt/RobotExclusionFilter.java	2007-11-29 21:06:55 UTC (rev 2099)
@@ -148,7 +148,6 @@
 					tmpRules = new RobotRules();
 					Resource resource = webCache.getCachedResource(new URL(urlString),
 							maxCacheMS,true);
-					resource.parseHeaders();
 					tmpRules.parse(resource);
 					rulesCache.put(firstUrlString,tmpRules);
 					rules = tmpRules;


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.