[Opaltoolkit-users] Problem reloading opal

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 422-6466

Hi,
I've got a problem when reloading opal2 app from tomcat manager. After 
doing so, registered webservices stop working and the only solution is 
to restart tomcat (which is quite uncomfortable as we have other apps in 
production on the same tomcat server).
Looking at the log, I see some db related errors when reloading: see below.
Can you help me?
Thanks!

Jun 18, 2009 3:18:48 PM org.apache.catalina.core.StandardContext reload
INFO: Reloading this Context has started
Exception in thread "HSQLDB Timer @5d802746" java.lang.NullPointerException
    at org.hsqldb.lib.HsqlTimer.nextTask(Unknown Source)
    at org.hsqldb.lib.HsqlTimer$TaskRunner.run(Unknown Source)
    at java.lang.Thread.run(Thread.java:595)
[http-8383-Processor19] ERROR hbm2ddl.SchemaUpdate  - could not get 
database metadata
java.sql.SQLException: The database is already in use by another 
process: org.hsqldb.NIOLockFile@f6fbb688[file 
=/index/www-tmp/opal/opaldb.lck, exists=true, locked=false, valid=false, 
fl =null]: java.lang.Exception: checkHeartbeat(): lock file 
[/index/www-tmp/opal/opaldb.lck] is presumably locked by another process.
    at org.hsqldb.jdbc.jdbcUtil.sqlException(Unknown Source)
    at org.hsqldb.jdbc.jdbcConnection.<init>(Unknown Source)
    at org.hsqldb.jdbcDriver.getConnection(Unknown Source)
    at org.hsqldb.jdbcDriver.connect(Unknown Source)
    at java.sql.DriverManager.getConnection(DriverManager.java:525)
    at java.sql.DriverManager.getConnection(DriverManager.java:140)
    at 
org.hibernate.connection.DriverManagerConnectionProvider.getConnection(DriverManagerConnectionProvider.java:133)
    at 
org.hibernate.tool.hbm2ddl.SuppliedConnectionProviderConnectionHelper.prepare(SuppliedConnectionProviderConnectionHelper.java:51)
    at 
org.hibernate.tool.hbm2ddl.SchemaUpdate.execute(SchemaUpdate.java:168)
    at 
org.hibernate.impl.SessionFactoryImpl.<init>(SessionFactoryImpl.java:346)
    at 
org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1327)
    at 
edu.sdsc.nbcr.opal.state.HibernateUtil.<clinit>(HibernateUtil.java:48)
    at 
edu.sdsc.nbcr.opal.dashboard.persistence.DBManager.<init>(DBManager.java:79)
    at 
edu.sdsc.nbcr.opal.dashboard.servlet.OpalInfoServlet.init(OpalInfoServlet.java:103)
    at 
org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1139)
    at 
org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:966)
    at 
org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:3956)
    at 
org.apache.catalina.core.StandardContext.start(StandardContext.java:4230)
    at 
org.apache.catalina.core.StandardContext.reload(StandardContext.java:3025)
    at 
org.apache.catalina.manager.ManagerServlet.reload(ManagerServlet.java:904)
    at 
org.apache.catalina.manager.HTMLManagerServlet.reload(HTMLManagerServlet.java:495)
    at 
org.apache.catalina.manager.HTMLManagerServlet.doGet(HTMLManagerServlet.java:99)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:627)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
    at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
    at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
    at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
    at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
    at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:525)
    at 
org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:276)
    at 
org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:81)
    at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
    at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
    at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
    at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
    at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
    at 
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
    at 
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
    at 
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
    at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
    at java.lang.Thread.run(Thread.java:595)
[http-8383-Processor19] ERROR hbm2ddl.SchemaUpdate  - could not complete 
schema update
java.sql.SQLException: The database is already in use by another 
process: org.hsqldb.NIOLockFile@f6fbb688[file 
=/index/www-tmp/opal/opaldb.lck, exists=true, locked=false, valid=false, 
fl =null]: java.lang.Exception: checkHeartbeat(): lock file 
[/index/www-tmp/opal/opaldb.lck] is presumably locked by another process.
    at org.hsqldb.jdbc.jdbcUtil.sqlException(Unknown Source)
    at org.hsqldb.jdbc.jdbcConnection.<init>(Unknown Source)
    at org.hsqldb.jdbcDriver.getConnection(Unknown Source)
    at org.hsqldb.jdbcDriver.connect(Unknown Source)
    at java.sql.DriverManager.getConnection(DriverManager.java:525)
    at java.sql.DriverManager.getConnection(DriverManager.java:140)
    at 
org.hibernate.connection.DriverManagerConnectionProvider.getConnection(DriverManagerConnectionProvider.java:133)
    at 
org.hibernate.tool.hbm2ddl.SuppliedConnectionProviderConnectionHelper.prepare(SuppliedConnectionProviderConnectionHelper.java:51)
    at 
org.hibernate.tool.hbm2ddl.SchemaUpdate.execute(SchemaUpdate.java:168)
    at 
org.hibernate.impl.SessionFactoryImpl.<init>(SessionFactoryImpl.java:346)
    at 
org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1327)
    at 
edu.sdsc.nbcr.opal.state.HibernateUtil.<clinit>(HibernateUtil.java:48)
    at 
edu.sdsc.nbcr.opal.dashboard.persistence.DBManager.<init>(DBManager.java:79)
    at 
edu.sdsc.nbcr.opal.dashboard.servlet.OpalInfoServlet.init(OpalInfoServlet.java:103)
    at 
org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1139)
    at 
org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:966)
    at 
org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:3956)
    at 
org.apache.catalina.core.StandardContext.start(StandardContext.java:4230)
    at 
org.apache.catalina.core.StandardContext.reload(StandardContext.java:3025)
    at 
org.apache.catalina.manager.ManagerServlet.reload(ManagerServlet.java:904)
    at 
org.apache.catalina.manager.HTMLManagerServlet.reload(HTMLManagerServlet.java:495)
    at 
org.apache.catalina.manager.HTMLManagerServlet.doGet(HTMLManagerServlet.java:99)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:627)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
    at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
    at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
    at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
    at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
    at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:525)
    at 
org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:276)
    at 
org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:81)
    at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
    at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
    at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
    at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
    at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
    at 
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
    at 
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
    at 
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
    at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
    at java.lang.Thread.run(Thread.java:595)
[http-8383-Processor19] ERROR util.JDBCExceptionReporter  - The database 
is already in use by another process: 
org.hsqldb.NIOLockFile@f6fbb688[file =/index/www-tmp/opal/opaldb.lck, 
exists=true, locked=false, valid=false, fl =null]: java.lang.Exception: 
checkHeartbeat(): lock file [/index/www-tmp/opal/opaldb.lck] is 
presumably locked by another process.
org.hibernate.exception.JDBCConnectionException: Cannot open connection
    at 
org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:97)
    at 
org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:66)
    at 
org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:52)
    at 
org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:449)
    at 
org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:167)
    at 
org.hibernate.jdbc.BorrowedConnectionProxy.invoke(BorrowedConnectionProxy.java:74)
    at $Proxy3.getMetaData(Unknown Source)
    at 
edu.sdsc.nbcr.opal.dashboard.persistence.DBManager.<init>(DBManager.java:85)
    at 
edu.sdsc.nbcr.opal.dashboard.servlet.OpalInfoServlet.init(OpalInfoServlet.java:103)
    at 
org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1139)
    at 
org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:966)
    at 
org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:3956)
    at 
org.apache.catalina.core.StandardContext.start(StandardContext.java:4230)
    at 
org.apache.catalina.core.StandardContext.reload(StandardContext.java:3025)
    at 
org.apache.catalina.manager.ManagerServlet.reload(ManagerServlet.java:904)
    at 
org.apache.catalina.manager.HTMLManagerServlet.reload(HTMLManagerServlet.java:495)
    at 
org.apache.catalina.manager.HTMLManagerServlet.doGet(HTMLManagerServlet.java:99)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:627)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
    at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
    at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
    at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
    at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
    at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:525)
    at 
org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:276)
    at 
org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:81)
    at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
    at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
    at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
    at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
    at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
    at 
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
    at 
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
    at 
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
    at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
    at java.lang.Thread.run(Thread.java:595)
Caused by: java.sql.SQLException: The database is already in use by 
another process: org.hsqldb.NIOLockFile@f6fbb688[file 
=/index/www-tmp/opal/opaldb.lck, exists=true, locked=false, valid=false, 
fl =null]: java.lang.Exception: checkHeartbeat(): lock file 
[/index/www-tmp/opal/opaldb.lck] is presumably locked by another process.
    at org.hsqldb.jdbc.jdbcUtil.sqlException(Unknown Source)
    at org.hsqldb.jdbc.jdbcConnection.<init>(Unknown Source)
    at org.hsqldb.jdbcDriver.getConnection(Unknown Source)
    at org.hsqldb.jdbcDriver.connect(Unknown Source)
    at java.sql.DriverManager.getConnection(DriverManager.java:525)
    at java.sql.DriverManager.getConnection(DriverManager.java:140)
    at 
org.hibernate.connection.DriverManagerConnectionProvider.getConnection(DriverManagerConnectionProvider.java:133)
    at 
org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:446)
    ... 32 more