#317 Deleting Data Collections Doesn't Work Right
Text here from my student Sam Thompson, who did some sleuthing. Note also the attached error log which has the text of the errors she was getting.
Problem:
When you delete a data collection, Enchilada doesn’t recognize it in the total particle count, which leads to errors when trying to cluster.
Tests:
1. Fresh new data set (117 particles) with two collections in it. Clustered it.
-no problems
2. I backed it up
-no problems
3. Restored it from the backup
-no problems
4. Deleted one collection of data
-particle count still says 117. Should have 64. The error showed up when I tried to cluster. I asked for 2 clusters and Enchilada gave me 4 cluster centers. The cluster folder only has two subfolders (clusters) but the number of particles in that subfolder add up to 117 so something went wrong there (it should only have 64 particles in the clusters).
5. Restored original database and clustered again
-no problem
I then deleted all the extra folders from old clusters (so all that remained was one set of data folders) and closed Enchilada and reopened it. It still says I have 117 particles, but the clustering worked fine. In the cluster folder I have the correct number of clusters and all the particles add up to 64 which is right. It also gave me the right number of cluster centers. So the only thing that’s wrong is the big collection folder still says the wrong number of total particles.
6. Restored. I only deleted all previous cluster folders. No data was deleted.
-I got the error message that I’ve been getting. I got the right number of everything (although no data was deleted)
7.Restored. I only deleted the cluster folder
-No problems
8. Restored. I only deleted the cluster centers folder
-No problems
9. Restored. I deleted both at once. (cluster folder and cluster centers). (same as 6)
-I got the error message.
10. Restored. I just deleted some data, but left all the previous cluster folders intact.
-No error message. Right number of clusters, wrong number of particles in the clusters folders.
11. Restored. Just deleted data, left the clusters alone, then restarted Enchilada.
-Same as last time
12. Restored. Deleted everything (old clusters, some data), then restarted Enchilada
-No error, right number of particles in the folders, wrong total number of particles in the heading
What I’ve discovered:
1. The error may not have anything to do with deleting the data sets, but rather with deleting the old clusters.
2. When you close Enchilada it gives you a message that some data has been deleted and asks you if you want to clean up the database. This seems to help a little with clustering correctly.
3. No matter what you do it always tells you (in the particle list info) that you have the same number of total particles.
Error Log from Enchilada