Menu ▾ ▴

#16 prepareRequest callback

open
nobody
None
5
2016-09-10
2013-01-21
Anonymous
No

A overridable callback-function like "prepareReqest" would be useful.

This function should be called before a request is done so users may manipulate
everything regarding the request (URL, header) or even abort the entire request.

See this forum post:
http://sourceforge.net/projects/phpcrawl/forums/forum/307696/topic/5199468

Also is related to this featurer-request:
http://sourceforge.net/tracker/?func=detail&aid=3588762&group_id=89439&atid=590149

Discussion

  • Comment has been marked as spam. 
    Undo

    View and moderate all "feature-requests Discussion" comments posted by this user

    Mark all as spam, and block user from posting to "Feature Requests"

    Anonymous

    Anonymous - 2014-04-17

    this function would be soooo useful! i can't find a way to rewrite request's headers before they are send. in fact, i need to add a pragma header to the request. does anyone have an alternative solution to this?

     

  • benjamin wenderoth

    benjamin wenderoth - 2015-03-19

    yeah +1, this would be cool

     
  • Comment has been marked as spam. 
    Undo

    View and moderate all "feature-requests Discussion" comments posted by this user

    Mark all as spam, and block user from posting to "Feature Requests"

    Anonymous

    Anonymous - 2016-09-10

    If this will solve my problem in the thread above, +1
    https://sourceforge.net/p/phpcrawl/discussion/307696/thread/b153a524/

    (I would like to filter crawling by a callback function, to "on single url level" return true or false if I want it crawled.

     

Anonymous
Anonymous

Add attachments
Cancel