[Archive-crawler-cvs] [internetarchive/heritrix3] bc2597: Update to Jetty 12.0.16 and Restlet 2.6.0-M2

[Alex O. <no...@gi...>]

  Branch: refs/heads/master
  Home:   https://github.com/internetarchive/heritrix3
  Commit: bc259728a0583709e9a17bab0236339381c1f289
      https://github.com/internetarchive/heritrix3/commit/bc259728a0583709e9a17bab0236339381c1f289
  Author: Alex Osborne <aos...@nl...>
  Date:   2025-04-24 (Thu, 24 Apr 2025)

  Changed paths:
    M engine/pom.xml
    M engine/src/main/java/org/archive/crawler/Heritrix.java
    A engine/src/main/java/org/archive/crawler/restlet/NoSniHostCheckHttpsServerHelper.java
    M engine/src/test/java/org/archive/crawler/selftest/CheckpointSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/FormAuthServlet.java
    M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/RandomServlet.java
    M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java
    M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/UserAgentServlet.java
    M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java
    M modules/pom.xml
    M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java
    M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java
    M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java
    M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java
    M pom.xml

  Log Message:
  -----------
  Update to Jetty 12.0.16 and Restlet 2.6.0-M2

The Jetty API has changed, which mostly affects test code.

Jetty now does a strict SNI host check which unfortunately causes it to
return "SNI error" for our existing ad-hoc certificates. For now, I've
disabled it to avoid breaking existing deployments but added a
--sni-host-check command-line option so you can re-enable it if
you've configured your own certificate appropriately.


  Commit: 0f5358ffef3761b93d969737a7d32a772e1f5543
      https://github.com/internetarchive/heritrix3/commit/0f5358ffef3761b93d969737a7d32a772e1f5543
  Author: Alex Osborne <aos...@nl...>
  Date:   2025-04-28 (Mon, 28 Apr 2025)

  Changed paths:
    M engine/pom.xml

  Log Message:
  -----------
  Exclude jetty-quiche-native from restlet

It's very large and we don't use Restlet's HTTP/3 support currently.


  Commit: db16b6096079b009ee241325c88fa8cd10557b0d
      https://github.com/internetarchive/heritrix3/commit/db16b6096079b009ee241325c88fa8cd10557b0d
  Author: Alex Osborne <aos...@nl...>
  Date:   2025-04-28 (Mon, 28 Apr 2025)

  Changed paths:
    M engine/src/main/java/org/archive/crawler/restlet/JobResource.java
    M engine/src/main/java/org/archive/crawler/restlet/models/CrawlJobModel.java
    M engine/src/main/resources/org/archive/crawler/restlet/Job.ftl

  Log Message:
  -----------
  Fix 'anypath' URL generation and avoid unnecessary usages of it

Restlet 2.6 refuses paths with double slash in the static path and we
were inadvertently generating them.


  Commit: bc9b21e2ee4d44feb94b98ab264dd5caf269cf6a
      https://github.com/internetarchive/heritrix3/commit/bc9b21e2ee4d44feb94b98ab264dd5caf269cf6a
  Author: Alex Osborne <aos...@nl...>
  Date:   2025-04-29 (Tue, 29 Apr 2025)

  Changed paths:
    M engine/pom.xml
    M engine/src/main/java/org/archive/crawler/Heritrix.java
    M engine/src/main/java/org/archive/crawler/restlet/JobResource.java
    A engine/src/main/java/org/archive/crawler/restlet/NoSniHostCheckHttpsServerHelper.java
    M engine/src/main/java/org/archive/crawler/restlet/models/CrawlJobModel.java
    M engine/src/main/resources/org/archive/crawler/restlet/Job.ftl
    M engine/src/test/java/org/archive/crawler/selftest/CheckpointSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/FormAuthServlet.java
    M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/RandomServlet.java
    M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java
    M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java
    M engine/src/test/java/org/archive/crawler/selftest/UserAgentServlet.java
    M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java
    M modules/pom.xml
    M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java
    M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java
    M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java
    M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java
    M pom.xml

  Log Message:
  -----------
  Merge pull request #648 from internetarchive/jetty-12

Update to Jetty 12.0.16 and Restlet 2.6.0-M2


Compare: https://github.com/internetarchive/heritrix3/compare/d73e2f6b8790...bc9b21e2ee4d

To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications