I resolved how to crawl on password protected parts of site, i.e. log in manually, then inject authentication cookie to PHPCrawl before start it.
Modified Testinterface and phpcrawlesetup.class
Are you interested?
Pietro
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
the feature to crawl protected areas/pathes (by HTTP-basic-authentication) is already implemented since verison 0.7, just pass the URL, password and username to the method "addBasicAuthentication()".
Or do you mean something different?
If you want to just let me take a look. Could you send your modifications to phpcrawl|at|cuab.de?
Thanks!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I having trouble setting the username and password for the test interface configuration file.. I have entered in a username and password in the config file but how do I initiate the setup of those vaules into the appropiate files?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I resolved how to crawl on password protected parts of site, i.e. log in manually, then inject authentication cookie to PHPCrawl before start it.
Modified Testinterface and phpcrawlesetup.class
Are you interested?
Pietro
Hi,
the feature to crawl protected areas/pathes (by HTTP-basic-authentication) is already implemented since verison 0.7, just pass the URL, password and username to the method "addBasicAuthentication()".
Or do you mean something different?
If you want to just let me take a look. Could you send your modifications to phpcrawl|at|cuab.de?
Thanks!
I having trouble setting the username and password for the test interface configuration file.. I have entered in a username and password in the config file but how do I initiate the setup of those vaules into the appropiate files?