NPE with Web Crawler when no unique field is set
An open source search engine with RESTFul API and crawlers
Brought to you by:
emmanuel_keller
Menu
▾
▴
#137 NPE with Web Crawler when no unique field is set
When no unique field is selected in the schema, the web crawler can generate NullPointerException.
java.lang.NullPointerException
at com.jaeksoft.searchlib.index.WriterLocal.deleteDocuments(Unknown Source)
at com.jaeksoft.searchlib.index.IndexSingle.deleteDocuments(Unknown Source)
at com.jaeksoft.searchlib.Client.deleteDocuments(Unknown Source)
at com.jaeksoft.searchlib.crawler.web.database.UrlManagerAbstract.updateCrawlTarget(Unknown Source)
at com.jaeksoft.searchlib.crawler.web.database.UrlCrawlQueue.updateCrawls(Unknown Source)
at com.jaeksoft.searchlib.crawler.web.database.UrlCrawlQueue.indexWork(Unknown Source)
at com.jaeksoft.searchlib.crawler.common.process.CrawlQueueAbstract.index(Unknown Source)
at com.jaeksoft.searchlib.crawler.web.process.WebCrawlMaster.runner(Unknown Source)
at com.jaeksoft.searchlib.process.ThreadAbstract.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Fixed in SVN revision 1502