[Exist-open] On migration from eXist-1.0b2-build-1107 to eXist-snapshot-20050805

[<Oyv...@id...>]

Hi everybody

This is probably something stupid alltogether but I can't seem to migrate=
=20
my data from eXist-1.0b2-build-1107 to eXist-snapshot-20050805

What I did was to move my the data dir out of the eXist-1.0b2-build-1107=20
catalogue and install the eXist-snapshot-20050805 as recommended on the d=
ownload page.
I modified the config.xml of the snapshot to read:

         <db-connection database=3D"native" files=3D"/home/oyvindve/Docum=
ents/forskningsrelatert/datagrunnlag/eXistData"
                 pageSize=3D"4096" cacheSize=3D"48M" free_mem_min=3D"5">

The only change here to the "default"/original entry in config.xml should=
=20
be the path to the data catalogue which holds the following files:

-rw-r--r--  1 root root  36K 2005-10-03 13:31 collections.dbx
-rw-r--r--  1 root root 743M 2005-10-03 13:31 dom.dbx
-rw-r--r--  1 root root 196M 2005-10-03 13:31 elements.dbx
-rw-r--r--  1 root root   69 2005-09-30 13:42 README
-rw-r--r--  1 root root 2.9K 2005-09-30 13:42 symbols.dbx
-rw-r--r--  1 root root 266M 2005-10-03 13:31 words.dbx

When I startup eXist-1.0b2-build-1107 (startup.sh and server.sh) this=20
directory is read fine, but with eXist-snapshot-20050805 i get an=20
ArrayOutOfBoundsException. I also get

03 Oct 2005 13:55:01,136 [main] DEBUG (NativeBroker.java [<init>]:246) -=20
failed to initialize database: Error opening elements.dbx
org.exist.storage.btree.DBException: Error opening elements.dbx

Should it be possible to migrate the data, and if so, what do I have to=20
migrate my data? I see the snapshot has additional files in its=20
data directory.

I could reload the data in a batch, but that takes app. 6=20
hours using xmlrpc with current memory settings.

The full readout of startup.sh is given below.

kind regards
=D8yvind Vestavik


root@oyvindve1:/usr/local/eXist/eXist-snapshot-20050805/bin# ./startup.sh
Configuring eXist from /usr/local/eXist/eXist-snapshot-20050805/conf.xml
03 Oct 2005 14:03:31,751 [main] DEBUG (IndexSpec.java [read]:92) - Readin=
g=20
configuration ...
Loading catalog:=20
/usr/local/eXist/eXist-snapshot-20050805/webapp/WEB-INF/catalog
03 Oct 2005 14:03:31,788 [main] INFO  (Configuration.java=20
[configureBackend]:310) - data directory =3D=20
/home/oyvindve/Documents/forskningsrelatert/datagrunnlag/eXistData
03 Oct 2005 14:03:31,790 [main] DEBUG (BrokerPool.java [configure]:116) -=
=20
configuring database instance 'exist' ...
03 Oct 2005 14:03:31,799 [main] INFO  (BrokerPool.java [<init>]:323) -=20
Max. wait during shutdown: 120000
03 Oct 2005 14:03:31,800 [main] INFO  (BrokerPool.java [<init>]:325) -=20
Instances: min =3D 1; max =3D 20; sync =3D 120000
03 Oct 2005 14:03:31,810 [main] DEBUG (BrokerPool.java [initialize]:544) =
-=20
initializing database exist
03 Oct 2005 14:03:31,815 [main] INFO  (CacheManager.java [<init>]:103) -=20
Cache settings: totalPages: 12288; maxCacheSize: 9216
03 Oct 2005 14:03:31,823 [main] INFO  (XQueryPool.java [<init>]:93) -=20
QueryPool: maxStackSize =3D 5; timeout =3D 120000; timeoutCheckInterval =3D=
=20
30000
03 Oct 2005 14:03:31,853 [main] DEBUG (Journal.java [<init>]:140) -=20
SyncOnCommit =3D false
03 Oct 2005 14:03:31,855 [main] DEBUG (Journal.java [<init>]:167) - Using=
=20
directory for the journal:=20
/usr/local/eXist/eXist-snapshot-20050805/webapp/WEB-INF/data
03 Oct 2005 14:03:31,951 [main] DEBUG (DBBroker.java [<init>]:166) -=20
Loading symbol table from=20
/home/oyvindve/Documents/forskningsrelatert/datagrunnlag/eXistData/symbol=
s.dbx
03 Oct 2005 14:03:31,979 [main] DEBUG (DBBroker.java [<init>]:181) -=20
fragmentation =3D 20
03 Oct 2005 14:03:32,026 [main] DEBUG (NativeBroker.java [<init>]:196) -=20
Initializing broker 3916375
java.lang.ArrayIndexOutOfBoundsException: 4096
         at org.exist.util.ByteConversion.byteToInt(ByteConversion.java:3=
6)
         at org.exist.storage.index.FreeList.read(FreeList.java:161)
         at org.exist.storage.index.BFile$BFileHeader.read(BFile.java:148=
0)
         at org.exist.storage.btree.Paged$FileHeader.read(Paged.java:653)
         at org.exist.storage.btree.Paged.open(Paged.java:308)
         at org.exist.storage.btree.BTree.open(BTree.java:173)
         at org.exist.storage.index.BFile.open(BFile.java:596)
         at org.exist.storage.index.BFile.<init>(BFile.java:151)
         at=20
org.exist.storage.NativeBroker.createValueIndexFile(NativeBroker.java:298=
)
         at=20
org.exist.storage.NativeBroker.createIndexFiles(NativeBroker.java:259)
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:211)
         at=20
org.exist.storage.BrokerFactory.getInstance(BrokerFactory.java:34)
         at org.exist.storage.BrokerPool.createBroker(BrokerPool.java:437=
)
         at org.exist.storage.BrokerPool.initialize(BrokerPool.java:566)
         at org.exist.storage.BrokerPool.<init>(BrokerPool.java:330)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:117)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:95)
         at org.exist.JettyStart.run(JettyStart.java:71)
         at org.exist.JettyStart.main(JettyStart.java:45)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at=20
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java=
:39)
         at=20
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI=
mpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:585)
         at org.exist.start.Main.invokeMain(Main.java:119)
         at org.exist.start.Main.run(Main.java:375)
         at org.exist.start.Main.main(Main.java:48)
         at org.exist.start.Main.main(Main.java:48)
03 Oct 2005 14:03:32,142 [main] DEBUG (NativeBroker.java [<init>]:246) -=20
failed to initialize database: Error opening elements.dbx
org.exist.storage.btree.DBException: Error opening elements.dbx
         at org.exist.storage.btree.Paged.open(Paged.java:318)
         at org.exist.storage.btree.BTree.open(BTree.java:173)
         at org.exist.storage.index.BFile.open(BFile.java:596)
         at org.exist.storage.index.BFile.<init>(BFile.java:151)
         at=20
org.exist.storage.NativeBroker.createValueIndexFile(NativeBroker.java:298=
)
         at=20
org.exist.storage.NativeBroker.createIndexFiles(NativeBroker.java:259)
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:211)
         at=20
org.exist.storage.BrokerFactory.getInstance(BrokerFactory.java:34)
         at org.exist.storage.BrokerPool.createBroker(BrokerPool.java:437=
)
         at org.exist.storage.BrokerPool.initialize(BrokerPool.java:566)
         at org.exist.storage.BrokerPool.<init>(BrokerPool.java:330)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:117)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:95)
         at org.exist.JettyStart.run(JettyStart.java:71)
         at org.exist.JettyStart.main(JettyStart.java:45)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at=20
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java=
:39)
         at=20
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI=
mpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:585)
         at org.exist.start.Main.invokeMain(Main.java:119)
         at org.exist.start.Main.run(Main.java:375)
         at org.exist.start.Main.main(Main.java:48)
configuration error: org.exist.storage.btree.DBException: Error opening=20
elements.dbx
org.exist.EXistException: org.exist.storage.btree.DBException: Error=20
opening elements.dbx
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:247)
         at=20
org.exist.storage.BrokerFactory.getInstance(BrokerFactory.java:34)
         at org.exist.storage.BrokerPool.createBroker(BrokerPool.java:437=
)
         at org.exist.storage.BrokerPool.initialize(BrokerPool.java:566)
         at org.exist.storage.BrokerPool.<init>(BrokerPool.java:330)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:117)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:95)
         at org.exist.JettyStart.run(JettyStart.java:71)
         at org.exist.JettyStart.main(JettyStart.java:45)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at=20
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java=
:39)
         at=20
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI=
mpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:585)
         at org.exist.start.Main.invokeMain(Main.java:119)
         at org.exist.start.Main.run(Main.java:375)
         at org.exist.start.Main.main(Main.java:48)
Caused by: org.exist.storage.btree.DBException: Error opening elements.db=
x
         at org.exist.storage.btree.Paged.open(Paged.java:318)
         at org.exist.storage.btree.BTree.open(BTree.java:173)
         at org.exist.storage.index.BFile.open(BFile.java:596)
         at org.exist.storage.index.BFile.<init>(BFile.java:151)
         at=20
org.exist.storage.NativeBroker.createValueIndexFile(NativeBroker.java:298=
)
         at=20
org.exist.storage.NativeBroker.createIndexFiles(NativeBroker.java:259)
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:211)
         ... 15 more