#21 Add link to the urlcache depending on the handleDocument()

[Matteo Catena]

Hi,

right now (part of) the discovered urls are added to the cache before the handleDocument() call. What if I want to follow links conditionally to the result of the handleDocument() method (ex.: only if the html body contains a certain string) ?
IMHO the discovered urls should be added to the cache after the handleDocument() call.

Matteo