DT instance seems stuck on "Initializing upgrade framework" #3665

nigellh · 2024-05-02T12:25:49Z

nigellh
May 2, 2024

Hi

DT instance started giving Server 500 errors on trying to log in. Had a look at the logs and it looked unhealthy. So we restarted the server it was running on (needed it anyway) still not well and so I did a docker-compose down then up. Now it seems to be hanging.

docker-compose logs --tail="1000" dtrack-apiserver

WARNING: Some services (dtrack-apiserver) use the 'deploy' key, which will be ignored. Compose does not support 'deploy' configuration - use `docker stack deploy` to deploy to a swarm.
Attaching to nhopper_dtrack-apiserver_1
dtrack-apiserver_1  | 2024-05-02 12:12:29,141 INFO [EmbeddedJettyServer] alpine-executable-war v2.2.4 (8d84d2cd-5055-4cbc-bfff-50bb7e5a2268) built on: 2023-12-06T15:54:14Z
dtrack-apiserver_1  | 2024-05-02 12:12:33,734 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 12:12:33,736 INFO [Config] OS Name:      Linux
dtrack-apiserver_1  | 2024-05-02 12:12:33,737 INFO [Config] OS Version:   5.4.0-177-generic
dtrack-apiserver_1  | 2024-05-02 12:12:33,737 INFO [Config] OS Arch:      amd64
dtrack-apiserver_1  | 2024-05-02 12:12:33,738 INFO [Config] CPU Cores:    8
dtrack-apiserver_1  | 2024-05-02 12:12:33,740 INFO [Config] Max Memory:   12.5 GB (13,420,199,936.0 bytes)
dtrack-apiserver_1  | 2024-05-02 12:12:33,741 INFO [Config] Java Vendor:  Eclipse Adoptium
dtrack-apiserver_1  | 2024-05-02 12:12:33,743 INFO [Config] Java Version: 21.0.1+12-LTS
dtrack-apiserver_1  | 2024-05-02 12:12:33,743 INFO [Config] Java Home:    /opt/java/openjdk
dtrack-apiserver_1  | 2024-05-02 12:12:33,743 INFO [Config] Java Temp:    /tmp
dtrack-apiserver_1  | 2024-05-02 12:12:33,743 INFO [Config] User:         dtrack
dtrack-apiserver_1  | 2024-05-02 12:12:33,744 INFO [Config] User Home:    /data/
dtrack-apiserver_1  | 2024-05-02 12:12:33,744 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 12:12:33,744 INFO [Config] Initializing Configuration
dtrack-apiserver_1  | 2024-05-02 12:12:33,745 INFO [Config] System property alpine.application.properties not specified
dtrack-apiserver_1  | 2024-05-02 12:12:33,745 INFO [Config] Loading application.properties from classpath
dtrack-apiserver_1  | 2024-05-02 12:12:33,753 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 12:12:33,754 INFO [Config] Application:  Dependency-Track
dtrack-apiserver_1  | 2024-05-02 12:12:33,754 INFO [Config] Version:      4.10.1
dtrack-apiserver_1  | 2024-05-02 12:12:33,754 INFO [Config] Built-on:     2023-12-19T10:56:01Z
dtrack-apiserver_1  | 2024-05-02 12:12:33,754 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 12:12:33,755 INFO [Config] Framework:    Alpine
dtrack-apiserver_1  | 2024-05-02 12:12:33,755 INFO [Config] Version :     2.2.4
dtrack-apiserver_1  | 2024-05-02 12:12:33,755 INFO [Config] Built-on:     2023-12-06T15:54:14Z
dtrack-apiserver_1  | 2024-05-02 12:12:33,755 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 12:12:33,866 INFO [RequirementsVerifier] Initializing requirements verifier
dtrack-apiserver_1  | 2024-05-02 12:12:33,867 INFO [UpgradeInitializer] Initializing upgrade framework

I searched on the repo and I can see the message appears to be generated by:

src/main/java/org/dependencytrack/upgrade/UpgradeInitializer.java

This was 20 minutes ago, any suggestions?

nigellh · 2024-05-02T13:38:08Z

nigellh
May 2, 2024
Author

Hi, Rebooted restarted DT and Logs now show it is sick.

Similar to #1552 ???

Is this a case of delete the underlying DT Data and starting again?

dtrack-apiserver_1  | 2024-05-02 13:31:03,949 INFO [PersistenceInitializer] Shutting down database service
dtrack-apiserver_1  | 2024-05-02 13:31:27,048 INFO [EmbeddedJettyServer] alpine-executable-war v2.2.4 (8d84d2cd-5055-4cbc-bfff-50bb7e5a2268) built on: 2023-12-06T15:54:14Z
dtrack-apiserver_1  | 2024-05-02 13:31:31,308 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 13:31:31,311 INFO [Config] OS Name:      Linux
dtrack-apiserver_1  | 2024-05-02 13:31:31,311 INFO [Config] OS Version:   5.4.0-177-generic
dtrack-apiserver_1  | 2024-05-02 13:31:31,311 INFO [Config] OS Arch:      amd64
dtrack-apiserver_1  | 2024-05-02 13:31:31,312 INFO [Config] CPU Cores:    8
dtrack-apiserver_1  | 2024-05-02 13:31:31,315 INFO [Config] Max Memory:   12.5 GB (13,420,199,936.0 bytes)
dtrack-apiserver_1  | 2024-05-02 13:31:31,315 INFO [Config] Java Vendor:  Eclipse Adoptium
dtrack-apiserver_1  | 2024-05-02 13:31:31,318 INFO [Config] Java Version: 21.0.1+12-LTS
dtrack-apiserver_1  | 2024-05-02 13:31:31,318 INFO [Config] Java Home:    /opt/java/openjdk
dtrack-apiserver_1  | 2024-05-02 13:31:31,319 INFO [Config] Java Temp:    /tmp
dtrack-apiserver_1  | 2024-05-02 13:31:31,319 INFO [Config] User:         dtrack
dtrack-apiserver_1  | 2024-05-02 13:31:31,319 INFO [Config] User Home:    /data/
dtrack-apiserver_1  | 2024-05-02 13:31:31,319 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 13:31:31,319 INFO [Config] Initializing Configuration
dtrack-apiserver_1  | 2024-05-02 13:31:31,322 INFO [Config] System property alpine.application.properties not specified
dtrack-apiserver_1  | 2024-05-02 13:31:31,323 INFO [Config] Loading application.properties from classpath
dtrack-apiserver_1  | 2024-05-02 13:31:31,337 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 13:31:31,338 INFO [Config] Application:  Dependency-Track
dtrack-apiserver_1  | 2024-05-02 13:31:31,338 INFO [Config] Version:      4.10.1
dtrack-apiserver_1  | 2024-05-02 13:31:31,338 INFO [Config] Built-on:     2023-12-19T10:56:01Z
dtrack-apiserver_1  | 2024-05-02 13:31:31,339 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 13:31:31,339 INFO [Config] Framework:    Alpine
dtrack-apiserver_1  | 2024-05-02 13:31:31,339 INFO [Config] Version :     2.2.4
dtrack-apiserver_1  | 2024-05-02 13:31:31,339 INFO [Config] Built-on:     2023-12-06T15:54:14Z
dtrack-apiserver_1  | 2024-05-02 13:31:31,340 INFO [Config] --------------------------------------------------------------------------------
dtrack-apiserver_1  | 2024-05-02 13:31:31,503 INFO [RequirementsVerifier] Initializing requirements verifier
dtrack-apiserver_1  | 2024-05-02 13:31:31,503 INFO [UpgradeInitializer] Initializing upgrade framework
dtrack-apiserver_1  | 2024-05-02 13:31:36,522 INFO [PersistenceManagerFactory] Initializing persistence framework
dtrack-apiserver_1  | 2024-05-02 13:31:36,524 INFO [PersistenceManagerFactory] Creating transactional connection pool
dtrack-apiserver_1  | 2024-05-02 13:31:36,659 INFO [PersistenceManagerFactory] Creating non-transactional connection pool
dtrack-apiserver_1  | 2024-05-02 13:31:36,916 ERROR [HikariPool] transactional - Error thrown while acquiring connection from data source
dtrack-apiserver_1  | org.h2.jdbc.JdbcSQLNonTransientConnectionException: The database has been closed [90098-224]
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:690)
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:489)
dtrack-apiserver_1  |   at org.h2.message.DbException.get(DbException.java:212)
dtrack-apiserver_1  |   at org.h2.engine.SessionLocal.getTransaction(SessionLocal.java:1610)
dtrack-apiserver_1  |   at org.h2.engine.SessionLocal.startStatementWithinTransaction(SessionLocal.java:1631)
dtrack-apiserver_1  |   at org.h2.command.Command.executeQuery(Command.java:186)
dtrack-apiserver_1  |   at org.h2.jdbc.JdbcConnection.isReadOnly(JdbcConnection.java:588)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.PoolBase.setupConnection(PoolBase.java:403)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:364)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:733)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:712)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.Thread.run(Unknown Source)
dtrack-apiserver_1  | Caused by: org.h2.mvstore.MVStoreException: Invalid chunk id 0 [2.2.224/6]
dtrack-apiserver_1  |   at org.h2.mvstore.DataUtils.newMVStoreException(DataUtils.java:996)
dtrack-apiserver_1  |   at org.h2.mvstore.Chunk.<init>(Chunk.java:210)
dtrack-apiserver_1  |   at org.h2.mvstore.SFChunk.<init>(SFChunk.java:22)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:54)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:28)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.createChunk(FileStore.java:764)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.serializeAndStore(FileStore.java:1423)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.lambda$storeIt$2(FileStore.java:1376)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
dtrack-apiserver_1  |   ... 4 common frames omitted
dtrack-apiserver_1  | 2024-05-02 13:31:36,922 ERROR [Datastore] Error thrown executing DROP TABLE DELETEME1714656696836 CASCADE : General error: "org.h2.mvstore.MVStoreException: This store is closed [2.2.224/4]"; SQL statement:
dtrack-apiserver_1  | DROP TABLE DELETEME1714656696836 CASCADE [50000-224]
dtrack-apiserver_1  | org.h2.jdbc.JdbcSQLNonTransientException: General error: "org.h2.mvstore.MVStoreException: This store is closed [2.2.224/4]"; SQL statement:
dtrack-apiserver_1  | DROP TABLE DELETEME1714656696836 CASCADE [50000-224]
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:566)
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:489)
dtrack-apiserver_1  |   at org.h2.message.DbException.get(DbException.java:212)
dtrack-apiserver_1  |   at org.h2.message.DbException.convert(DbException.java:407)
dtrack-apiserver_1  |   at org.h2.command.Command.executeUpdate(Command.java:268)
dtrack-apiserver_1  |   at org.h2.jdbc.JdbcStatement.executeInternal(JdbcStatement.java:262)
dtrack-apiserver_1  |   at org.h2.jdbc.JdbcStatement.execute(JdbcStatement.java:231)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.table.AbstractTable.executeDdlStatement(AbstractTable.java:799)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.table.AbstractTable.executeDdlStatementList(AbstractTable.java:749)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.table.AbstractTable.drop(AbstractTable.java:507)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager.initialiseSchema(RDBMSStoreManager.java:1439)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:359)
dtrack-apiserver_1  |   at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source)
dtrack-apiserver_1  |   at org.datanucleus.util.ClassUtils.newInstance(ClassUtils.java:81)
dtrack-apiserver_1  |   at org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:592)
dtrack-apiserver_1  |   at org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:296)
dtrack-apiserver_1  |   at org.datanucleus.store.StoreManagerHelper.createStoreManagerForProperties(StoreManagerHelper.java:111)
dtrack-apiserver_1  |   at org.datanucleus.PersistenceNucleusContextImpl.initialise(PersistenceNucleusContextImpl.java:424)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:865)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:352)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:275)
dtrack-apiserver_1  |   at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.reflect.Method.invoke(Unknown Source)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper$16.run(JDOHelper.java:1975)
dtrack-apiserver_1  |   at java.base/java.security.AccessController.doPrivileged(Unknown Source)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.invoke(JDOHelper.java:1970)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1139)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:851)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:1109)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:969)
dtrack-apiserver_1  |   at alpine.server.persistence.PersistenceManagerFactory.contextInitialized(PersistenceManagerFactory.java:111)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392)
dtrack-apiserver_1  |   at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1304)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306)
dtrack-apiserver_1  |   at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:532)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.Server.start(Server.java:470)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.Server.doStart(Server.java:415)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
dtrack-apiserver_1  |   at alpine.embedded.EmbeddedJettyServer.main(EmbeddedJettyServer.java:100)
dtrack-apiserver_1  | Caused by: org.h2.mvstore.MVStoreException: This store is closed [2.2.224/4]
dtrack-apiserver_1  |   at org.h2.mvstore.DataUtils.newMVStoreException(DataUtils.java:996)
dtrack-apiserver_1  |   at org.h2.mvstore.MVStore.checkOpen(MVStore.java:1416)
dtrack-apiserver_1  |   at org.h2.mvstore.MVStore.removeMap(MVStore.java:1463)
dtrack-apiserver_1  |   at org.h2.mvstore.tx.TransactionStore.removeMap(TransactionStore.java:483)
dtrack-apiserver_1  |   at org.h2.mvstore.tx.Transaction.removeMap(Transaction.java:762)
dtrack-apiserver_1  |   at org.h2.mvstore.db.MVPrimaryIndex.remove(MVPrimaryIndex.java:301)
dtrack-apiserver_1  |   at org.h2.mvstore.db.MVTable.removeChildrenAndResources(MVTable.java:609)
dtrack-apiserver_1  |   at org.h2.engine.Database.removeSchemaObject(Database.java:1689)
dtrack-apiserver_1  |   at org.h2.command.ddl.DropTable.executeDrop(DropTable.java:126)
dtrack-apiserver_1  |   at org.h2.command.ddl.DropTable.update(DropTable.java:134)
dtrack-apiserver_1  |   at org.h2.command.CommandContainer.update(CommandContainer.java:169)
dtrack-apiserver_1  |   at org.h2.command.Command.executeUpdate(Command.java:256)
dtrack-apiserver_1  |   ... 47 more
dtrack-apiserver_1  | Caused by: org.h2.mvstore.MVStoreException: Invalid chunk id 0 [2.2.224/6]
dtrack-apiserver_1  |   at org.h2.mvstore.DataUtils.newMVStoreException(DataUtils.java:996)
dtrack-apiserver_1  |   at org.h2.mvstore.Chunk.<init>(Chunk.java:210)
dtrack-apiserver_1  |   at org.h2.mvstore.SFChunk.<init>(SFChunk.java:22)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:54)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:28)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.createChunk(FileStore.java:764)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.serializeAndStore(FileStore.java:1423)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.lambda$storeIt$2(FileStore.java:1376)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.Thread.run(Unknown Source)
dtrack-apiserver_1  | 
dtrack-apiserver_1  | 2024-05-02 13:31:36,923 WARN [Schema] Error obtaining connection to database : General error: "org.h2.mvstore.MVStoreException: This store is closed [2.2.224/4]"; SQL statement:
dtrack-apiserver_1  | DROP TABLE DELETEME1714656696836 CASCADE [50000-224] Please check that your database JDBC driver is accessible, and the database URL and username/password are correct.
dtrack-apiserver_1  | 2024-05-02 13:31:36,969 ERROR [Schema] An exception was thrown while adding/validating class(es) : The database has been closed [90098-224]
dtrack-apiserver_1  | The database has been closed [90098-224]
dtrack-apiserver_1  | org.datanucleus.exceptions.NucleusDataStoreException: The database has been closed [90098-224]
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:472)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.AbstractSchemaTransaction.getCurrentConnection(AbstractSchemaTransaction.java:86)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.performTablesValidation(RDBMSStoreManager.java:3497)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.run(RDBMSStoreManager.java:3024)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.AbstractSchemaTransaction.execute(AbstractSchemaTransaction.java:118)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager.createSchemaForClasses(RDBMSStoreManager.java:3866)
dtrack-apiserver_1  |   at org.datanucleus.store.schema.SchemaTool.createSchemaForClasses(SchemaTool.java:507)
dtrack-apiserver_1  |   at org.datanucleus.PersistenceNucleusContextImpl.initialiseSchema(PersistenceNucleusContextImpl.java:824)
dtrack-apiserver_1  |   at org.datanucleus.PersistenceNucleusContextImpl.initialise(PersistenceNucleusContextImpl.java:484)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:865)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:352)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:275)
dtrack-apiserver_1  |   at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.reflect.Method.invoke(Unknown Source)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper$16.run(JDOHelper.java:1975)
dtrack-apiserver_1  |   at java.base/java.security.AccessController.doPrivileged(Unknown Source)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.invoke(JDOHelper.java:1970)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1139)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:851)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:1109)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:969)
dtrack-apiserver_1  |   at alpine.server.persistence.PersistenceManagerFactory.contextInitialized(PersistenceManagerFactory.java:111)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392)
dtrack-apiserver_1  |   at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1304)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306)
dtrack-apiserver_1  |   at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:532)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.Server.start(Server.java:470)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.Server.doStart(Server.java:415)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
dtrack-apiserver_1  |   at alpine.embedded.EmbeddedJettyServer.main(EmbeddedJettyServer.java:100)
dtrack-apiserver_1  | Caused by: org.h2.jdbc.JdbcSQLNonTransientConnectionException: The database has been closed [90098-224]
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:690)
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:489)
dtrack-apiserver_1  |   at org.h2.message.DbException.get(DbException.java:212)
dtrack-apiserver_1  |   at org.h2.engine.SessionLocal.getTransaction(SessionLocal.java:1610)
dtrack-apiserver_1  |   at org.h2.engine.SessionLocal.startStatementWithinTransaction(SessionLocal.java:1631)
dtrack-apiserver_1  |   at org.h2.command.Command.executeQuery(Command.java:186)
dtrack-apiserver_1  |   at org.h2.jdbc.JdbcConnection.isReadOnly(JdbcConnection.java:588)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.HikariProxyConnection.isReadOnly(HikariProxyConnection.java)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:417)
dtrack-apiserver_1  |   ... 38 more
dtrack-apiserver_1  | Caused by: org.h2.mvstore.MVStoreException: Invalid chunk id 0 [2.2.224/6]
dtrack-apiserver_1  |   at org.h2.mvstore.DataUtils.newMVStoreException(DataUtils.java:996)
dtrack-apiserver_1  |   at org.h2.mvstore.Chunk.<init>(Chunk.java:210)
dtrack-apiserver_1  |   at org.h2.mvstore.SFChunk.<init>(SFChunk.java:22)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:54)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:28)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.createChunk(FileStore.java:764)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.serializeAndStore(FileStore.java:1423)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.lambda$storeIt$2(FileStore.java:1376)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.Thread.run(Unknown Source)
dtrack-apiserver_1  | Nested Throwables StackTrace:
dtrack-apiserver_1  | org.h2.jdbc.JdbcSQLNonTransientConnectionException: The database has been closed [90098-224]
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:690)
dtrack-apiserver_1  |   at org.h2.message.DbException.getJdbcSQLException(DbException.java:489)
dtrack-apiserver_1  |   at org.h2.message.DbException.get(DbException.java:212)
dtrack-apiserver_1  |   at org.h2.engine.SessionLocal.getTransaction(SessionLocal.java:1610)
dtrack-apiserver_1  |   at org.h2.engine.SessionLocal.startStatementWithinTransaction(SessionLocal.java:1631)
dtrack-apiserver_1  |   at org.h2.command.Command.executeQuery(Command.java:186)
dtrack-apiserver_1  |   at org.h2.jdbc.JdbcConnection.isReadOnly(JdbcConnection.java:588)
dtrack-apiserver_1  |   at com.zaxxer.hikari.pool.HikariProxyConnection.isReadOnly(HikariProxyConnection.java)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:417)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.AbstractSchemaTransaction.getCurrentConnection(AbstractSchemaTransaction.java:86)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.performTablesValidation(RDBMSStoreManager.java:3497)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.run(RDBMSStoreManager.java:3024)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.AbstractSchemaTransaction.execute(AbstractSchemaTransaction.java:118)
dtrack-apiserver_1  |   at org.datanucleus.store.rdbms.RDBMSStoreManager.createSchemaForClasses(RDBMSStoreManager.java:3866)
dtrack-apiserver_1  |   at org.datanucleus.store.schema.SchemaTool.createSchemaForClasses(SchemaTool.java:507)
dtrack-apiserver_1  |   at org.datanucleus.PersistenceNucleusContextImpl.initialiseSchema(PersistenceNucleusContextImpl.java:824)
dtrack-apiserver_1  |   at org.datanucleus.PersistenceNucleusContextImpl.initialise(PersistenceNucleusContextImpl.java:484)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:865)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:352)
dtrack-apiserver_1  |   at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:275)
dtrack-apiserver_1  |   at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.reflect.Method.invoke(Unknown Source)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper$16.run(JDOHelper.java:1975)
dtrack-apiserver_1  |   at java.base/java.security.AccessController.doPrivileged(Unknown Source)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.invoke(JDOHelper.java:1970)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1139)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:851)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:1109)
dtrack-apiserver_1  |   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:969)
dtrack-apiserver_1  |   at alpine.server.persistence.PersistenceManagerFactory.contextInitialized(PersistenceManagerFactory.java:111)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392)
dtrack-apiserver_1  |   at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1304)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901)
dtrack-apiserver_1  |   at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306)
dtrack-apiserver_1  |   at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:532)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.Server.start(Server.java:470)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89)
dtrack-apiserver_1  |   at org.eclipse.jetty.server.Server.doStart(Server.java:415)
dtrack-apiserver_1  |   at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
dtrack-apiserver_1  |   at alpine.embedded.EmbeddedJettyServer.main(EmbeddedJettyServer.java:100)
dtrack-apiserver_1  | Caused by: org.h2.mvstore.MVStoreException: Invalid chunk id 0 [2.2.224/6]
dtrack-apiserver_1  |   at org.h2.mvstore.DataUtils.newMVStoreException(DataUtils.java:996)
dtrack-apiserver_1  |   at org.h2.mvstore.Chunk.<init>(Chunk.java:210)
dtrack-apiserver_1  |   at org.h2.mvstore.SFChunk.<init>(SFChunk.java:22)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:54)
dtrack-apiserver_1  |   at org.h2.mvstore.RandomAccessStore.createChunk(RandomAccessStore.java:28)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.createChunk(FileStore.java:764)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.serializeAndStore(FileStore.java:1423)
dtrack-apiserver_1  |   at org.h2.mvstore.FileStore.lambda$storeIt$2(FileStore.java:1376)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
dtrack-apiserver_1  |   at java.base/java.lang.Thread.run(Unknown Source)

0 replies

nigellh · 2024-05-02T14:14:30Z

nigellh
May 2, 2024
Author

Deleted the volume to delete the DB and it is running fine now, just need to re-add everyone and get them to re-create their projects. Will look at a different DB at some point when I have more time

0 replies

bohdanbinahai · 2024-07-10T12:57:12Z

bohdanbinahai
Jul 10, 2024

same problem, delete the DB sounds bad (

0 replies

userdehghani · 2024-09-07T05:27:12Z

userdehghani
Sep 7, 2024

same here

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DT instance seems stuck on "Initializing upgrade framework" #3665

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 4 comments

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

DT instance seems stuck on "Initializing upgrade framework" #3665

nigellh May 2, 2024

Replies: 4 comments

nigellh May 2, 2024 Author

nigellh May 2, 2024 Author

bohdanbinahai Jul 10, 2024

userdehghani Sep 7, 2024

nigellh
May 2, 2024

nigellh
May 2, 2024
Author

nigellh
May 2, 2024
Author

bohdanbinahai
Jul 10, 2024

userdehghani
Sep 7, 2024