Hello,
I installed the crawler today. It stops always at different pages and never runs to the end (summary). I don't get any error code. My changes in example.php are:
$crawler->setTrafficLimit(2000000 * 1024);
$crawler->setStreamTimeout(5);
$crawler->setConnectionTimeout(10);
$crawler->setPageLimit(2000);
What can I do to find out, why it stops? TY
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hello,
I installed the crawler today. It stops always at different pages and never runs to the end (summary). I don't get any error code. My changes in example.php are:
$crawler->setTrafficLimit(2000000 * 1024);
$crawler->setStreamTimeout(5);
$crawler->setConnectionTimeout(10);
$crawler->setPageLimit(2000);
What can I do to find out, why it stops? TY
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi,
Please try this:
This http://phpcrawl.cuab.de/classreferences/PHPCrawlerProcessReport/property_detail_tpl_property_abort_reason.htm gives more insight in why the crawler stopped.
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi,
tried that, but nothing was displayed. I suppose, it stops before reaching that instruction. :-/
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
What is the time limit of PHP?
I set this in the first lines of my script:
Normally PHP will stop the script after 30 seconds I guess...
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
I did set it like this:
set_time_limit(2000000);
It should be enough for about 700 pages?
Hi!
Sorry for my late answer!
DId you get it to work meanwhile?
Or dooes the problem still exist?