It is installed, but I think it is not propertly configured..

thanks!


2014/1/15 Demian Katz <demian.katz@villanova.edu>

The web import requires either Tika or Aperture to be configured in fulltext.ini in order to harvest content. The symptoms you are seeing suggest that you do not have either tool installed. That’s probably the first thing you should check!

 

- Demian

 

From: Hugo Agud [mailto:hagud@orex.es]
Sent: Wednesday, January 15, 2014 9:06 AM
To: Demian Katz
Cc: vufind-general@lists.sourceforge.net
Subject: Re: [VuFind-General] indexing web

 

hi

 

Thanks to Nathan we are testing the sitemap.xml, we have created the testing one.. and testing webcrawler, but we face some problems that we do no know how to manage

 

System Vufind 2.1

vufind working fine

We think we have followed the instructions https://vufind.org/wiki/vufind2:indexing_websites

 

Any clue on this? the system claim to have a unique id, like the marc.import... but here we do not know how to fix it

 

logs

Harvesting http://idescat.koha.es/vufind/sitemap.xml...

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

PHP Warning:  Invalid argument supplied for foreach() in /usr/local/vufind2/module/VuFind/src/VuFind/XSLT/Import/VuFindSitemap.php on line 195

15-ene-2014 13:49:03 org.apache.solr.update.processor.LogUpdateProcessor finish

INFO: [website] webapp=/solr path=/update params={} {} 0 0

15-ene-2014 13:49:03 org.apache.solr.common.SolrException log

GRAVE: org.apache.solr.common.SolrException: Document is missing mandatory uniqueKey field: id

at org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:88)

at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:464)

at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:346)

at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)

at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:246)

at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:173)

at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)

at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)

at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)

at org.apache.solr.core.SolrCore.execute(SolrCore.java:1817)

at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:639)

at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)

at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)

at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)

at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)

at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)

at org.eclipse.jetty.server.Server.handle(Server.java:365)

at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)

at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)

at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)

at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)

at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)

at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)

at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)

at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)

at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)

at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)

at java.lang.Thread.run(Thread.java:679)

 

VuFindSearch\Backend\Exception\RequestErrorException: 400 Bad Request

15-ene-2014 13:49:03 org.apache.solr.update.processor.LogUpdateProcessor finish

INFO: [website] webapp=/solr path=/update params={} {deleteByQuery=last_indexed:[* TO 2014-01-15T08:48:58Z] (-1457304364707217408)} 0 2

15-ene-2014 13:49:03 org.apache.solr.update.DirectUpdateHandler2 commit

INFO: start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}

15-ene-2014 13:49:03 org.apache.solr.core.SolrDeletionPolicy onCommit

INFO: SolrDeletionPolicy.onCommit: commits:num=2

commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/usr/local/vufind2/solr/website/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd41677; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]

commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/usr/local/vufind2/solr/website/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd41677; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6,filenames=[segments_6]

15-ene-2014 13:49:03 org.apache.solr.core.SolrDeletionPolicy updateCommits

INFO: newest commit = 6[segments_6]

15-ene-2014 13:49:03 org.apache.solr.search.SolrIndexSearcher <init>

INFO: Opening Searcher@1d5f0876 main

15-ene-2014 13:49:03 org.apache.solr.core.QuerySenderListener newSearcher

INFO: QuerySenderListener sending requests to Searcher@1d5f0876 main{StandardDirectoryReader(segments_1:1:nrt)}

15-ene-2014 13:49:03 org.apache.solr.core.SolrCore execute

INFO: [website] webapp=null path=null params={start=0&event=newSearcher&q=science+art+business+engineering+history&distrib=false&rows=10} hits=0 status=0 QTime=1 

15-ene-2014 13:49:03 org.apache.solr.core.QuerySenderListener newSearcher

INFO: QuerySenderListener done.

15-ene-2014 13:49:03 org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener newSearcher

INFO: Index is not optimized therefore skipping building spell check index for: default

15-ene-2014 13:49:03 org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener newSearcher

INFO: Index is not optimized therefore skipping building spell check index for: basicSpell

15-ene-2014 13:49:03 org.apache.solr.core.SolrCore registerSearcher

INFO: [website] Registered new searcher Searcher@1d5f0876 main{StandardDirectoryReader(segments_1:1:nrt)}

15-ene-2014 13:49:03 org.apache.solr.update.DirectUpdateHandler2 commit

INFO: end_commit_flush

15-ene-2014 13:49:03 org.apache.solr.update.processor.LogUpdateProcessor finish

INFO: [website] webapp=/solr path=/update params={} {commit=} 0 34

15-ene-2014 13:49:03 org.apache.solr.update.DirectUpdateHandler2 commit

INFO: start commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}

15-ene-2014 13:49:03 org.apache.solr.core.SolrDeletionPolicy onCommit

INFO: SolrDeletionPolicy.onCommit: commits:num=2

commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/usr/local/vufind2/solr/website/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd41677; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6,filenames=[segments_6]

commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/usr/local/vufind2/solr/website/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd41677; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_7,generation=7,filenames=[segments_7]

15-ene-2014 13:49:03 org.apache.solr.core.SolrDeletionPolicy updateCommits

INFO: newest commit = 7[segments_7]

15-ene-2014 13:49:03 org.apache.solr.search.SolrIndexSearcher <init>

INFO: Opening Searcher@1af2f973 main

15-ene-2014 13:49:03 org.apache.solr.core.QuerySenderListener newSearcher

INFO: QuerySenderListener sending requests to Searcher@1af2f973 main{StandardDirectoryReader(segments_1:1:nrt)}

15-ene-2014 13:49:03 org.apache.solr.core.SolrCore execute

INFO: [website] webapp=null path=null params={start=0&event=newSearcher&q=science+art+business+engineering+history&distrib=false&rows=10} hits=0 status=0 QTime=1 

15-ene-2014 13:49:03 org.apache.solr.core.QuerySenderListener newSearcher

INFO: QuerySenderListener done.

15-ene-2014 13:49:03 org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener newSearcher

INFO: Index is not optimized therefore skipping building spell check index for: default

15-ene-2014 13:49:03 org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener newSearcher

INFO: Index is not optimized therefore skipping building spell check index for: basicSpell

15-ene-2014 13:49:03 org.apache.solr.core.SolrCore registerSearcher

INFO: [website] Registered new searcher Searcher@1af2f973 main{StandardDirectoryReader(segments_1:1:nrt)}

15-ene-2014 13:49:03 org.apache.solr.update.DirectUpdateHandler2 commit

INFO: end_commit_flush

15-ene-2014 13:49:03 org.apache.solr.update.processor.LogUpdateProcessor finish

INFO: [website] webapp=/solr path=/update params={} {optimize=} 0 20

ubuntu@ip-10-33-169-88:/usr/local/vufind2/import$ 

 

 

 

 

 

 

 

 

 

 

 

2014/1/15 Demian Katz <demian.katz@villanova.edu>

Right now, the indexing tool included with VuFind requires a sitemap.xml. I’m sure another solution would be possible (e.g. using some kind of crawler tool), but any other approach will require some development work. It definitely might be worth looking into the tool that Nathan suggested.

 

- Demian

 

From: Hugo Agud [mailto:hagud@orex.es]
Sent: Wednesday, January 15, 2014 3:21 AM
To: vufind-general@lists.sourceforge.net
Subject: [VuFind-General] indexing web

 

Hi

 

We have one request to index one web (http://www.idescat.cat/cataleg/) via Vufind and check how it looks like.

 

We have checked the indexing web of Vufind (https://vufind.org/wiki/vufind2:indexing_websites) the issue is that homepage has not sitemap.xml and we wish to ask you IF there is any way to avoid it or if is it mandatory

 

Kindest Regards

Hugo 

 

--

Hugo Agud - Orex Digital 

www.orex.es

 

Director

Passatge de la Llançadera, 3 · 08338 Premià de Dalt - Tel: 93 539 40 70   hagud@orex.es · http://www.orex.es/

 

No imprima este mensaje a no ser que sea necesario. Una tonelada de papel implica la tala de 15 árboles y el consumo de 250.000 litros de agua.

 

Aviso de confidencialidad
Este mensaje contiene información que puede ser CONFIDENCIAL y/o de USO RESTRINGIDO. Si usted no es el receptor deseado del mensaje (ni
está autorizado a recibirlo por el remitente), no está autorizado a copiar, reenviar o divulgar el mensaje o su contenido. Si ha recibido este mensaje
por error, por favor, notifíquenoslo inmediatamente y bórrelo de su sistema.

 



 

--

Hugo Agud - Orex Digital 

www.orex.es

 

Director

Passatge de la Llançadera, 3 · 08338 Premià de Dalt - Tel: 93 539 40 70   hagud@orex.es · http://www.orex.es/

 

No imprima este mensaje a no ser que sea necesario. Una tonelada de papel implica la tala de 15 árboles y el consumo de 250.000 litros de agua.

 

Aviso de confidencialidad
Este mensaje contiene información que puede ser CONFIDENCIAL y/o de USO RESTRINGIDO. Si usted no es el receptor deseado del mensaje (ni
está autorizado a recibirlo por el remitente), no está autorizado a copiar, reenviar o divulgar el mensaje o su contenido. Si ha recibido este mensaje
por error, por favor, notifíquenoslo inmediatamente y bórrelo de su sistema.

 




--

Hugo Agud - Orex Digital 

www.orex.es


Director

Passatge de la Llançadera, 3 · 08338 Premià de Dalt - Tel: 93 539 40 70   hagud@orex.es · http://www.orex.es/

 

No imprima este mensaje a no ser que sea necesario. Una tonelada de papel implica la tala de 15 árboles y el consumo de 250.000 litros de agua.

 

Aviso de confidencialidad
Este mensaje contiene información que puede ser CONFIDENCIAL y/o de USO RESTRINGIDO. Si usted no es el receptor deseado del mensaje (ni
está autorizado a recibirlo por el remitente), no está autorizado a copiar, reenviar o divulgar el mensaje o su contenido. Si ha recibido este mensaje
por error, por favor, notifíquenoslo inmediatamente y bórrelo de su sistema.