[Geotools-devel] Optimizations to shapefile and transaction

[Jesse E. <je...@re...>]

So that everyone stays in the know and aren't too alarmed by my  
changes over the last week I thought I'd let everyone know what I've  
been up to.

Myron and myself have had to work on shapefile and shapefile's  
transaction state over the last week because we needed it to be able  
to perform well when there are hundreds of thousands to millions of  
bbox queries and feature modifications, deletes and adds.  The good  
news is that we were able to take an operation that used to take over  
a week and shorten it to around 7 hours.  More good news is that we  
didn't need to make any structural changes, just cleaned up code and  
fixed a number of hacks that "made it work" but didn't make it work  
efficiently (some of which were introduced my yours truly).  The last  
good news is that there isn't any bad news to this story (that I know  
of).

The changes are very well tested because:
1.  All the unit tests still pass.
2.  We have run the operations of many different datasets from sets  
that are a few hundred features to sets that are 200000 features.
3.  I am working on interactive editing in uDig and am banging the  
shapefile/transaction implementation very hard, I found a few bugs  
through this work and have since fixed the issues.

The changes are on both trunk and 2.2.x

Cheers,

Jesse