PHPCrawl / Bugs / #61 setPageLimit doesn't set a limit to "pages", but rather for requests

#61 setPageLimit doesn't set a limit to "pages", but rather for requests

Status: closed-fixed

Owner: nobody

Labels: None

Priority: 5

Updated: 2015-01-27

Created: 2014-01-08

Creator: Anonymous

Private: No

Also see this forum-post:
http://sourceforge.net/p/phpcrawl/discussion/307696/thread/6efae816/

For instance:
If the pageLimit is set to 1, and the first requested URL is a redirect (302), the crawler stops after this request. So there was NO "page" received so far.

Solution: Rename setPageLimit to setRequestLimit, and implement a real pageLimit.

Discussion

Uwe Hunfeld - 2015-01-27

Fixed since version 0.83, renamed method setPageLimit() to setRequestLimit().
(setPageLimit() marked as deprecated).

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Anonymous
  
  Add attachments
  Cancel
  You seem to have CSS turned off. Please don't fill out this field.
  
  You seem to have CSS turned off. Please don't fill out this field.

Uwe Hunfeld - 2015-01-27

status: open --> closed-fixed
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Anonymous
  
  Add attachments
  Cancel
  You seem to have CSS turned off. Please don't fill out this field.
  
  You seem to have CSS turned off. Please don't fill out this field.

Anonymous

setPageLimit doesn't set a limit to "pages", but rather for requests

Searches

Help

#61 setPageLimit doesn't set a limit to "pages", but rather for requests

Discussion