Heritrix: Internet Archive Web Crawler

This issue is now discussed in the new JIRA tracker at
http://webteam.archive.org/jira/browse/HER-395 -- please add further
comments at that location.

Logged In: YES
user_id=1269624

Test in harness, bug verified on previous builds. Absence
of bug verified in current build (Heritrix
1.5.0-200506091041) -- closing bug.

Logged In: YES
user_id=144912

This section of the HTML4 DTD had given me the impression
'for' could wind up being used on SCRIPT tags for some URI
purpose:

<!ATTLIST SCRIPT
charset %Charset; #IMPLIED -- char encoding of
linked resource --
type %ContentType; #REQUIRED -- content type of
script language --
src %URI; #IMPLIED -- URI for an
external script --
defer (defer) #IMPLIED -- UA may defer
execution of script --
event CDATA #IMPLIED -- reserved for
possible future use --
for %URI; #IMPLIED -- reserved for
possible future use --
>

However, I don't think we've ever seen such usage, and we've
received multiple complaints for 'for' attribute extraction
as relative URIs. So, removing that extraction from the regexp.

Commit comment:

Fix for [ 1181892 ] Aggressive extraction of `for' attributes
* ExtractorHTML.java
remove 'for' attribute-match from extractor regexp

Considerd fixed, assigning to Karl for verification.

Logged In: YES
user_id=924942

See also '[ 1075982 ] Overeager extraction can lead to
side-effects for admins.