I'm crawling a huge, huge website and using Resumable Proccess, with 25 multiprocesses (sorry for my bad english).
Sudenly, my crawl proccess ends and, if I not delete the resumable archive (with last CrawlerID), they not crawl again.
I put to print proccessReport at the end of file, but it's not printing, what mean that not ended crawl, right?
Is there some problem with Resume aborted processes?
Thanks by the way.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hello everyone.
I'm crawling a huge, huge website and using Resumable Proccess, with 25 multiprocesses (sorry for my bad english).
Sudenly, my crawl proccess ends and, if I not delete the resumable archive (with last CrawlerID), they not crawl again.
I put to print proccessReport at the end of file, but it's not printing, what mean that not ended crawl, right?
Is there some problem with Resume aborted processes?
Thanks by the way.