Heritrix: Internet Archive Web Crawler

This issue is now discussed in the new JIRA tracker at
http://webteam.archive.org/jira/browse/HER-397 -- please add further
comments at that location.

Logged In: YES
user_id=144912

There's a new RFE for UURI to ensure DNS URIs are legal at
construction time:

[ 1298220 ] UURI could reject illegal DNS URIs
http://sourceforge.net/tracker/index.php?func=detail&aid=1298220&group_id=73833&atid=539102

In the meantime, a fix for another bug has made FetchDNS
better handle a null getReferencedHost() return value from a
UURI. See:

[ 1065413 ] [uuri] '$' in path gets scheduled, spawns
queueing error
https://sourceforge.net/tracker/?func=detail&atid=539099&aid=1065413&group_id=73833

This is preferred somewhat over having
UURI.getReferencedHost() throw an exception, because
ideally, once something is instantiated as a U(sable)URI ,
it should not be subject to parse/format errors on followup
accesses.


I've confirmed that this other FetchDNS fix also addresses
this NPE, replacing it with a more-sensible marking of the
DNS URI as being unfetchable.

So, closing as out-of-date (because fixed elsewhere).

Logged In: YES
user_id=924942

dns UURIs always return null for path (They're 'host' is the
path component). Need to fix javadoc.

dns:www.treasurequest.com.%0A%3CBR looks like it should fail
a UURI parse -- this would cause the UURI to fail before it
got near FetchDNS.

Thanks for reporting Christian.