#6 setDelay() setting

closed
nobody
None
5
2014-01-18
2012-03-09
Uwe Hunfeld
No

A setDelay-function that let's the crawler pause a given time before requesting the next document in queue
(in order not to overstain the load of the hosting webserver).

As requested here:
https://sourceforge.net/projects/phpcrawl/forums/forum/307695/topic/1372555
https://sourceforge.net/projects/phpcrawl/forums/forum/307696/topic/5103238

Discussion

  • Uwe Hunfeld

    Uwe Hunfeld - 2014-01-18
    • status: open --> closed
     
  • Uwe Hunfeld

    Uwe Hunfeld - 2014-01-18

    Available since verion 0.82.
    See method setRequestDelay().

     


Anonymous

Cancel  Add attachments