prepareRequest callback
Status: Beta
Brought to you by:
huni
Menu
▾
▴
#16 prepareRequest callback
open
nobody
None
5
2016-09-10
2013-01-21
Anonymous
No
A overridable callback-function like "prepareReqest" would be useful.
This function should be called before a request is done so users may manipulate
everything regarding the request (URL, header) or even abort the entire request.
See this forum post:
http://sourceforge.net/projects/phpcrawl/forums/forum/307696/topic/5199468
Also is related to this featurer-request:
http://sourceforge.net/tracker/?func=detail&aid=3588762&group_id=89439&atid=590149
Discussion
Anonymous
View and moderate all "feature-requests Discussion" comments posted by this user
Mark all as spam, and block user from posting to "Feature Requests"
this function would be soooo useful! i can't find a way to rewrite request's headers before they are send. in fact, i need to add a pragma header to the request. does anyone have an alternative solution to this?
View and moderate all "feature-requests Discussion" comments posted by this user
Mark all as spam, and block user from posting to "Feature Requests"
+1
yeah +1, this would be cool
View and moderate all "feature-requests Discussion" comments posted by this user
Mark all as spam, and block user from posting to "Feature Requests"
+1 Anyway great crawler many-many thanks for it!
View and moderate all "feature-requests Discussion" comments posted by this user
Mark all as spam, and block user from posting to "Feature Requests"
If this will solve my problem in the thread above, +1
https://sourceforge.net/p/phpcrawl/discussion/307696/thread/b153a524/
(I would like to filter crawling by a callback function, to "on single url level" return true or false if I want it crawled.