[Archive-crawler-cvs] [internetarchive/heritrix3] 18c69d: CheckpointService: Add checkpointOnShutdown option

[Alex O. <no...@gi...>]

  Branch: refs/heads/master
  Home:   https://github.com/internetarchive/heritrix3
  Commit: 18c69def9ae3decea0d27486e78dd04c0470d596
      https://github.com/internetarchive/heritrix3/commit/18c69def9ae3decea0d27486e78dd04c0470d596
  Author: Alex Osborne <aos...@nl...>
  Date:   2024-11-24 (Sun, 24 Nov 2024)

  Changed paths:
    M engine/src/main/java/org/archive/crawler/framework/CheckpointService.java
    M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.cxml

  Log Message:
  -----------
  CheckpointService: Add checkpointOnShutdown option

This enables a checkpoint to be automatically created during a graceful termination. This makes it easier to stop and restart Heritrix without having to manually checkpoint each running job.


  Commit: 585fed8575d76febd78273fabf94b0464e986eaa
      https://github.com/internetarchive/heritrix3/commit/585fed8575d76febd78273fabf94b0464e986eaa
  Author: Alex Osborne <aos...@nl...>
  Date:   2024-11-24 (Sun, 24 Nov 2024)

  Changed paths:
    M docs/operating.rst
    M engine/src/main/java/org/archive/crawler/Heritrix.java

  Log Message:
  -----------
  Add --checkpoint command-line option

This makes it possible to select a checkpoint from the command-line when using the --run-job option.


  Commit: ec689dbce3c39490c3414cf357c81337dce42682
      https://github.com/internetarchive/heritrix3/commit/ec689dbce3c39490c3414cf357c81337dce42682
  Author: Alex Osborne <aos...@nl...>
  Date:   2024-11-24 (Sun, 24 Nov 2024)

  Changed paths:
    M docs/operating.rst

  Log Message:
  -----------
  Document checkpointOnShutdown and --checkpoint options in the operating guide


  Commit: 4093871de19643bb9ff7b99f44b39a0563e2eb49
      https://github.com/internetarchive/heritrix3/commit/4093871de19643bb9ff7b99f44b39a0563e2eb49
  Author: Alex Osborne <aos...@nl...>
  Date:   2024-11-28 (Thu, 28 Nov 2024)

  Changed paths:
    M docs/operating.rst
    M engine/src/main/java/org/archive/crawler/Heritrix.java
    M engine/src/main/java/org/archive/crawler/framework/CheckpointService.java
    M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.cxml

  Log Message:
  -----------
  Merge pull request #626 from internetarchive/checkpoint-on-shutdown

Add checkpoint on shutdown and --checkpoint CLI option


Compare: https://github.com/internetarchive/heritrix3/compare/8ec614224ebe...4093871de196

To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications