Heritrix: Internet Archive Web Crawler

Several reports are only created at end of crawl (very
end when all threads have terminated). Sometimes a
crawl will encounter an error that makes it impossible
to achive this state (threads hung or otherwise unable
to be reported as terminated). In those instances it
would be very usefull to have an option to force the
writing of those reports. The same code could probably
also be used to automatically write those reports when
error conditions known to halt crawling occurs (such as
out of memory).