I've got an issue with a particular installation of OSS v1.5.12 on Windows Server 2008 r2 that I can't seem to rectify.
I've installed Tomcat 8 and jdk1.8.0_65
The server starts normally and responds to begin with but after an half an hour stops responding to search requests, attempts to login to the admin panel also fail.
About 20 mins after the service is started the log begins to fill up with warnings like....
When the first warnings start to appear point inspecting the Runtime system tab:-
Version OpenSearchServer v1.5.12 - build 3d77781724 The running OpenSearchServer version
Available processors 2 The maximum number of processors available to the virtual machine
Free memory 276.0 MB The amount of free memory in the Java Virtual Machine
Free memory rate 7.6 % The rate of free memory in the Java Virtual Machine
Max memory 3.6 GB The maximum amount of memory that the Java virtual machine will attempt to use
Total memory 1.2 GB The total amount of memory in the Java virtual machine
Data directory path F:\OpenSerarch The location of the directory containing the indices
Free disk space 14.0 GB The free space on a drive or volume
Disk space rate 93.2 % The rate of free space on a drive or volume
Total disk space 15.0 GB The total space on a drive or volume
Index count 1 The total number of indices
Then about 40 minutes later (after logging warnings every 500ms it starts occasionally logging:-
It seems to seize up completely, it responds to status requests for the state of the crawler, but does not respond to search requests, attempts to login into the admin console also timeout.
Here's the log from start up to fail...
12:52:26,313 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler_$SIMPLE_NON_CLUSTERED shutting down.
12:52:26,313 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$SIMPLE_NON_CLUSTERED paused.
12:52:26,313 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$_SIMPLE_NON_CLUSTERED shutdown complete.
12:52:26,313 INFO: root - OSS unloads index IndexWithAboutThirtyThousandDocs
13:35:16,259 INFO: root - OSS IS STARTING
13:35:16,634 INFO: org.quartz.core.SchedulerSignalerImpl - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
13:35:16,650 INFO: org.quartz.core.QuartzScheduler - Quartz Scheduler v.2.1.7 created.
13:35:16,666 INFO: org.quartz.simpl.RAMJobStore - RAMJobStore initialized.
13:35:16,666 INFO: org.quartz.core.QuartzScheduler - Scheduler meta-data: Quartz Scheduler (v2.1.7) 'SimpleQuartzScheduler' with instanceId 'SIMPLE_NON_CLUSTERED'
Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
NOT STARTED.
Currently in standby mode.
Number of jobs executed: 0
Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 20 threads.
Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.
13:35:16,666 INFO: org.quartz.impl.DirectSchedulerFactory - Quartz scheduler 'SimpleQuartzScheduler
13:35:16,666 INFO: org.quartz.impl.DirectSchedulerFactory - Quartz scheduler version: 2.1.7
13:35:16,666 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler_$SIMPLE_NON_CLUSTERED started.
13:35:16,666 INFO: root - OSS starts loading index(es)
13:35:16,681 INFO: root - OSS loads index IndexWithAboutThirtyThousandDocs
13:35:18,713 INFO: org.apache.cxf.endpoint.ServerImpl - Setting the server's publish address to be /rest
13:35:24,213 INFO: root - The file crawler is starting for IndexWithAboutThirtyThousandDocs
13:35:25,307 INFO: root - OSS ends loading index(es)
13:40:01,899 INFO: root - OSS SHUTDOWN
13:40:01,899 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$SIMPLE_NON_CLUSTERED shutting down.
13:40:01,899 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$SIMPLE_NON_CLUSTERED paused.
13:40:01,914 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$_SIMPLE_NON_CLUSTERED shutdown complete.
13:40:01,914 INFO: root - OSS unloads index IndexWithAboutThirtyThousandDocs
13:40:02,320 ERROR: root - MMapIndexInput already closed: MMapIndexInput(path="F:\OpenSerarch\IndexWithAboutThirtyThousandDocs\index_do.tis")
13:40:02,414 ERROR: root - com.jaeksoft.searchlib.autocompletion.AutoCompletionBuildThread.buildTermEnum(AutoCompletionBuildThread.java:126)
13:40:32,217 INFO: root - OSS IS STARTING
13:40:32,435 INFO: org.quartz.core.SchedulerSignalerImpl - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
13:40:32,435 INFO: org.quartz.core.QuartzScheduler - Quartz Scheduler v.2.1.7 created.
13:40:32,451 INFO: org.quartz.simpl.RAMJobStore - RAMJobStore initialized.
13:40:32,451 INFO: org.quartz.core.QuartzScheduler - Scheduler meta-data: Quartz Scheduler (v2.1.7) 'SimpleQuartzScheduler' with instanceId 'SIMPLE_NON_CLUSTERED'
Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
NOT STARTED.
Currently in standby mode.
Number of jobs executed: 0
Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 20 threads.
Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.
Hi,
I've got an issue with a particular installation of OSS v1.5.12 on Windows Server 2008 r2 that I can't seem to rectify.
I've installed Tomcat 8 and jdk1.8.0_65
The server starts normally and responds to begin with but after an half an hour stops responding to search requests, attempts to login to the admin panel also fail.
About 20 mins after the service is started the log begins to fill up with warnings like....
14:10:25,895 WARN: root - Low memory rate conditions: flushing crawl buffer
When the first warnings start to appear point inspecting the Runtime system tab:-
Version OpenSearchServer v1.5.12 - build 3d77781724 The running OpenSearchServer version
Available processors 2 The maximum number of processors available to the virtual machine
Free memory 276.0 MB The amount of free memory in the Java Virtual Machine
Free memory rate 7.6 % The rate of free memory in the Java Virtual Machine
Max memory 3.6 GB The maximum amount of memory that the Java virtual machine will attempt to use
Total memory 1.2 GB The total amount of memory in the Java virtual machine
Data directory path F:\OpenSerarch The location of the directory containing the indices
Free disk space 14.0 GB The free space on a drive or volume
Disk space rate 93.2 % The rate of free space on a drive or volume
Total disk space 15.0 GB The total space on a drive or volume
Index count 1 The total number of indices
Then about 40 minutes later (after logging warnings every 500ms it starts occasionally logging:-
14:36:10,288 WARN: root - Low memory free conditions: flushing crawl buffer
It seems to seize up completely, it responds to status requests for the state of the crawler, but does not respond to search requests, attempts to login into the admin console also timeout.
Here's the log from start up to fail...
12:52:26,313 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler_$SIMPLE_NON_CLUSTERED shutting down.
12:52:26,313 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$SIMPLE_NON_CLUSTERED paused.
12:52:26,313 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$_SIMPLE_NON_CLUSTERED shutdown complete.
12:52:26,313 INFO: root - OSS unloads index IndexWithAboutThirtyThousandDocs
13:35:16,259 INFO: root - OSS IS STARTING
13:35:16,634 INFO: org.quartz.core.SchedulerSignalerImpl - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
13:35:16,650 INFO: org.quartz.core.QuartzScheduler - Quartz Scheduler v.2.1.7 created.
13:35:16,666 INFO: org.quartz.simpl.RAMJobStore - RAMJobStore initialized.
13:35:16,666 INFO: org.quartz.core.QuartzScheduler - Scheduler meta-data: Quartz Scheduler (v2.1.7) 'SimpleQuartzScheduler' with instanceId 'SIMPLE_NON_CLUSTERED'
Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
NOT STARTED.
Currently in standby mode.
Number of jobs executed: 0
Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 20 threads.
Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.
13:35:16,666 INFO: org.quartz.impl.DirectSchedulerFactory - Quartz scheduler 'SimpleQuartzScheduler
13:35:16,666 INFO: org.quartz.impl.DirectSchedulerFactory - Quartz scheduler version: 2.1.7
13:35:16,666 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler_$SIMPLE_NON_CLUSTERED started.
13:35:16,666 INFO: root - OSS starts loading index(es)
13:35:16,681 INFO: root - OSS loads index IndexWithAboutThirtyThousandDocs
13:35:18,713 INFO: org.apache.cxf.endpoint.ServerImpl - Setting the server's publish address to be /rest
13:35:24,213 INFO: root - The file crawler is starting for IndexWithAboutThirtyThousandDocs
13:35:25,307 INFO: root - OSS ends loading index(es)
13:40:01,899 INFO: root - OSS SHUTDOWN
13:40:01,899 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$SIMPLE_NON_CLUSTERED shutting down.
13:40:01,899 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$SIMPLE_NON_CLUSTERED paused.
13:40:01,914 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$_SIMPLE_NON_CLUSTERED shutdown complete.
13:40:01,914 INFO: root - OSS unloads index IndexWithAboutThirtyThousandDocs
13:40:02,320 ERROR: root - MMapIndexInput already closed: MMapIndexInput(path="F:\OpenSerarch\IndexWithAboutThirtyThousandDocs\index_do.tis")
13:40:02,414 ERROR: root - com.jaeksoft.searchlib.autocompletion.AutoCompletionBuildThread.buildTermEnum(AutoCompletionBuildThread.java:126)
13:40:32,217 INFO: root - OSS IS STARTING
13:40:32,435 INFO: org.quartz.core.SchedulerSignalerImpl - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
13:40:32,435 INFO: org.quartz.core.QuartzScheduler - Quartz Scheduler v.2.1.7 created.
13:40:32,451 INFO: org.quartz.simpl.RAMJobStore - RAMJobStore initialized.
13:40:32,451 INFO: org.quartz.core.QuartzScheduler - Scheduler meta-data: Quartz Scheduler (v2.1.7) 'SimpleQuartzScheduler' with instanceId 'SIMPLE_NON_CLUSTERED'
Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
NOT STARTED.
Currently in standby mode.
Number of jobs executed: 0
Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 20 threads.
Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.
13:40:32,623 INFO: org.quartz.impl.DirectSchedulerFactory - Quartz scheduler 'SimpleQuartzScheduler
13:40:32,623 INFO: org.quartz.impl.DirectSchedulerFactory - Quartz scheduler version: 2.1.7
13:40:32,623 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler_$_SIMPLE_NON_CLUSTERED started.
13:40:32,639 INFO: root - OSS starts loading index(es)
13:40:32,654 INFO: root - OSS loads index IndexWithAboutThirtyThousandDocs
13:40:33,670 INFO: root - The file crawler is starting for IndexWithAboutThirtyThousandDocs
13:40:34,139 INFO: root - OSS ends loading index(es)
13:40:34,326 INFO: org.apache.cxf.endpoint.ServerImpl - Setting the server's publish address to be /rest
14:00:01,853 INFO: root - UPDATE - Hourly - Wed Dec 23 13:00:00 AEDT 2015 - Count:132 - Average:92.18937 - Min:62 - Max:812
14:00:01,931 INFO: root - RELOAD - Hourly - Wed Dec 23 13:00:00 AEDT 2015 - Count:184 - Average:26.603256 - Min:15 - Max:63
14:10:25,895 WARN: root - Low memory rate conditions: flushing crawl buffer
... 850 more "Low memory rate" warnings ...
14:28:53,459 WARN: root - Low memory free conditions: flushing crawl buffer
14:28:53,662 WARN: root - Low memory rate conditions: flushing crawl buffer
... 66 more "Low memory rate" warnings ...
14:29:48,427 WARN: root - Low memory free conditions: flushing crawl buffer
14:29:48,615 WARN: root - Low memory rate conditions: flushing crawl buffer
... 6 more "Low memory rate" warnings ...
14:29:50,208 WARN: root - Low memory free conditions: flushing crawl buffer
14:29:50,443 WARN: root - Low memory rate conditions: flushing crawl buffer
... 3 more "Low memory rate" warnings ...
14:29:51,099 WARN: root - Low memory free conditions: flushing crawl buffer
14:29:51,333 WARN: root - Low memory rate conditions: flushing crawl buffer
... 3 more "Low memory rate" warnings ...
14:29:52,130 WARN: root - Low memory free conditions: flushing crawl buffer
... etc etc ...
14:36:08,960 WARN: root - Low memory rate conditions: flushing crawl buffer
14:36:09,116 WARN: root - Low memory rate conditions: flushing crawl buffer
14:36:09,241 WARN: root - Low memory rate conditions: flushing crawl buffer
14:36:09,491 WARN: root - Low memory rate conditions: flushing crawl buffer
14:36:09,647 WARN: root - Low memory rate conditions: flushing crawl buffer
14:36:09,835 WARN: root - Low memory rate conditions: flushing crawl buffer
14:36:09,960 WARN: root - Low memory rate conditions: flushing crawl buffer
14:36:10,288 WARN: root - Low memory free conditions: flushing crawl buffer
15:00:27,711 INFO: root - UPDATE - Hourly - Wed Dec 23 14:00:00 AEDT 2015 - Count:1945 - Average:75.40046 - Min:62 - Max:203
15:00:27,742 INFO: root - RELOAD - Hourly - Wed Dec 23 14:00:00 AEDT 2015 - Count:2097 - Average:26.47259 - Min:15 - Max:62
15:11:20,145 INFO: root - OSS SHUTDOWN
15:11:20,145 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler_$SIMPLE_NON_CLUSTERED shutting down.
15:11:20,145 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$SIMPLE_NON_CLUSTERED paused.
15:11:20,145 INFO: org.quartz.core.QuartzScheduler - Scheduler SimpleQuartzScheduler$_SIMPLE_NON_CLUSTERED shutdown complete.
The shutdown is from me shutting the service down.
I've tried deleting and recreating the index, reinstalling everything, several times over Apache, the JDK, Just can't get it to work.