I know that if I return -1 from the HandleDocumnetInfo() the program will exit. But I have loaded 10 other URLS in the InitChild function. So what I will really want is to load the first url scan the links by going though all of them myself using links_found[key] array(). Like the testinterface and the say ok. Im done with this url give the next URL THAT I HAVE LOADED in the Initchild fuction. I do not want the crawler to continue crawling the site just let me move to the next url on "MY" list.
Simply put I only want to scan the the links on the first page myself without having to crawl the rest of the site. Just move on to the next.
Can this be done?
Thanks
Last edit: Anonymous 2014-02-03
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi,
I know that if I return -1 from the HandleDocumnetInfo() the program will exit. But I have loaded 10 other URLS in the InitChild function. So what I will really want is to load the first url scan the links by going though all of them myself using links_found[key] array(). Like the testinterface and the say ok. Im done with this url give the next URL THAT I HAVE LOADED in the Initchild fuction. I do not want the crawler to continue crawling the site just let me move to the next url on "MY" list.
Simply put I only want to scan the the links on the first page myself without having to crawl the rest of the site. Just move on to the next.
Can this be done?
Thanks
Last edit: Anonymous 2014-02-03