I am accumulating a substantial number of checkpoint files - I know from reading here that I can delete old checkpoints - but what about checkpoints that correspond to partial stages.. For instance, could I safely delete
7-0-CGW/genome.ckp.51 (logical ckp05-1SM-partial)
after
7-0-CGW/genome.ckp.52 (logical ckp05-1SM-partial)
has been created?
Thanks, Matt
Yes. The partial just means the stage is still computing, but the way it computes allows for restarting from any checkpoint. I tend to keep at least two checkpoints around - the last one and the one before the current stage (ckp04 here) would be the most important.
Files in the tigStore follow the checkpoints, but you cannot delete those files.