could you post the link which is causing the problem?
So maybe i'm able to prevent the crawler from hanging in an infinite loop eventhough the link
is corrupted, this should not happen.
Thanks!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I have a problem in that when PHPCrawl gets to a certain page, there is an incorrectly formatted link which is causing an infinite loop…
How can I warn PHPCrawl about a link it should ignore?
I figured out to use:
$this->addURLFilterRule("#(clear\.gif)# i");
Hey Patrick,
could you post the link which is causing the problem?
So maybe i'm able to prevent the crawler from hanging in an infinite loop eventhough the link
is corrupted, this should not happen.
Thanks!