Is it possible to get information about current crawling progress?
I need to know how many links already processed and how many links to be processed by crawler.
Thx.
Last edit: Anonymous 2013-11-19
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
So far there is no official way to determinate these infos, the DocumentInfo-Object doen't contain these counters.
The links already processed can be counted easily in your extended counter-class, just implement a simple counter that increases each time the handleDocumentInfo-method() get's called.
To determinate the links to be processed is a little difficult and has to be implemented in phpcrawl, right know i don't know a workarond.
But feel free to open a feature-request for this if you want to!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi.
Is it possible to get information about current crawling progress?
I need to know how many links already processed and how many links to be processed by crawler.
Thx.
Last edit: Anonymous 2013-11-19
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
flush()?
Hi!
Sorry for my late answer!
So far there is no official way to determinate these infos, the DocumentInfo-Object doen't contain these counters.
The links already processed can be counted easily in your extended counter-class, just implement a simple counter that increases each time the handleDocumentInfo-method() get's called.
To determinate the links to be processed is a little difficult and has to be implemented in phpcrawl, right know i don't know a workarond.
But feel free to open a feature-request for this if you want to!
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Is there way to get know the crawl process is finished?
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi!
What exactly do you mean?
Do you mean "when will it finish"?
Or "Is it finished"?