Menu
▾
▴
archive-crawler-cvs — cvs commits
You can subscribe to this list here.
| 2003 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
(2) |
Sep
(50) |
Oct
(197) |
Nov
(305) |
Dec
(295) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2004 |
Jan
(429) |
Feb
(694) |
Mar
(443) |
Apr
(479) |
May
(357) |
Jun
(74) |
Jul
(218) |
Aug
(162) |
Sep
(156) |
Oct
(340) |
Nov
(132) |
Dec
(224) |
| 2005 |
Jan
(170) |
Feb
(122) |
Mar
(265) |
Apr
(215) |
May
(139) |
Jun
(247) |
Jul
(179) |
Aug
(116) |
Sep
(103) |
Oct
(125) |
Nov
(97) |
Dec
(221) |
| 2006 |
Jan
(132) |
Feb
(18) |
Mar
(23) |
Apr
(35) |
May
(71) |
Jun
(268) |
Jul
(220) |
Aug
(376) |
Sep
(181) |
Oct
(71) |
Nov
(131) |
Dec
(172) |
| 2007 |
Jan
(125) |
Feb
(79) |
Mar
(90) |
Apr
(76) |
May
(91) |
Jun
(64) |
Jul
(113) |
Aug
(96) |
Sep
(40) |
Oct
(30) |
Nov
(85) |
Dec
(56) |
| 2008 |
Jan
(37) |
Feb
(79) |
Mar
(22) |
Apr
(6) |
May
(13) |
Jun
(22) |
Jul
(83) |
Aug
(50) |
Sep
(8) |
Oct
(32) |
Nov
(55) |
Dec
(28) |
| 2009 |
Jan
(15) |
Feb
(30) |
Mar
(28) |
Apr
(69) |
May
(82) |
Jun
(19) |
Jul
(64) |
Aug
(71) |
Sep
(53) |
Oct
(84) |
Nov
(105) |
Dec
(40) |
| 2010 |
Jan
(11) |
Feb
(19) |
Mar
(24) |
Apr
(58) |
May
(15) |
Jun
(35) |
Jul
(14) |
Aug
(13) |
Sep
(31) |
Oct
(15) |
Nov
(39) |
Dec
(10) |
| 2011 |
Jan
(59) |
Feb
(32) |
Mar
(10) |
Apr
(37) |
May
(20) |
Jun
(21) |
Jul
(39) |
Aug
(9) |
Sep
(31) |
Oct
(29) |
Nov
(3) |
Dec
(1) |
| 2012 |
Jan
(7) |
Feb
(4) |
Mar
(5) |
Apr
(12) |
May
(5) |
Jun
(8) |
Jul
(9) |
Aug
(6) |
Sep
(15) |
Oct
(1) |
Nov
(3) |
Dec
(9) |
| 2013 |
Jan
(9) |
Feb
(2) |
Mar
(41) |
Apr
(13) |
May
(9) |
Jun
(20) |
Jul
(5) |
Aug
(22) |
Sep
(5) |
Oct
(3) |
Nov
(13) |
Dec
(8) |
| 2014 |
Jan
(27) |
Feb
(16) |
Mar
(7) |
Apr
(14) |
May
(10) |
Jun
(2) |
Jul
(16) |
Aug
(6) |
Sep
(6) |
Oct
(11) |
Nov
(7) |
Dec
|
| 2015 |
Jan
|
Feb
(7) |
Mar
(4) |
Apr
|
May
(2) |
Jun
|
Jul
|
Aug
(2) |
Sep
(2) |
Oct
(5) |
Nov
(1) |
Dec
|
| 2016 |
Jan
(15) |
Feb
(5) |
Mar
(4) |
Apr
(1) |
May
(7) |
Jun
(16) |
Jul
(6) |
Aug
(2) |
Sep
|
Oct
(1) |
Nov
|
Dec
|
| 2017 |
Jan
|
Feb
(1) |
Mar
(3) |
Apr
|
May
(4) |
Jun
(25) |
Jul
|
Aug
|
Sep
(4) |
Oct
(11) |
Nov
(9) |
Dec
(1) |
| 2018 |
Jan
(2) |
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
|
Jul
(10) |
Aug
|
Sep
(1) |
Oct
(2) |
Nov
(12) |
Dec
(4) |
| 2019 |
Jan
(3) |
Feb
(21) |
Mar
(17) |
Apr
(13) |
May
(6) |
Jun
(4) |
Jul
|
Aug
(65) |
Sep
|
Oct
(4) |
Nov
(7) |
Dec
|
| 2020 |
Jan
(23) |
Feb
(6) |
Mar
(14) |
Apr
(25) |
May
(11) |
Jun
(9) |
Jul
(7) |
Aug
(7) |
Sep
(1) |
Oct
(4) |
Nov
(4) |
Dec
|
| 2021 |
Jan
(8) |
Feb
(11) |
Mar
(1) |
Apr
(6) |
May
(30) |
Jun
(60) |
Jul
(43) |
Aug
(23) |
Sep
(16) |
Oct
|
Nov
(7) |
Dec
(13) |
| 2022 |
Jan
(7) |
Feb
(2) |
Mar
(17) |
Apr
(16) |
May
(9) |
Jun
(2) |
Jul
(18) |
Aug
|
Sep
(3) |
Oct
(1) |
Nov
(2) |
Dec
|
| 2023 |
Jan
(7) |
Feb
|
Mar
(11) |
Apr
|
May
(1) |
Jun
|
Jul
|
Aug
|
Sep
(7) |
Oct
(5) |
Nov
(2) |
Dec
|
| 2024 |
Jan
|
Feb
(4) |
Mar
(8) |
Apr
(5) |
May
(5) |
Jun
(12) |
Jul
(2) |
Aug
(12) |
Sep
(25) |
Oct
(47) |
Nov
(46) |
Dec
(3) |
| 2025 |
Jan
(6) |
Feb
(14) |
Mar
(8) |
Apr
(23) |
May
(34) |
Jun
(44) |
Jul
(8) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Alex O. <no...@gi...> - 2025-05-10 13:56:16
|
Branch: refs/heads/bidi Home: https://github.com/internetarchive/heritrix3 Commit: 643bf91323dc970ec19cd90e27c8bae2c5e0604f https://github.com/internetarchive/heritrix3/commit/643bf91323dc970ec19cd90e27c8bae2c5e0604f Author: Alex Osborne <aos...@nl...> Date: 2025-05-05 (Mon, 05 May 2025) Changed paths: A commons/src/main/java/org/archive/net/WebdriverBiDi.java M modules/pom.xml A modules/src/main/java/org/archive/modules/extractor/ExtractorWebdriverBiDi.java M modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java Log Message: ----------- wip Commit: 3834db97c35f9e332b077c3cef0b08580a6cebd2 https://github.com/internetarchive/heritrix3/commit/3834db97c35f9e332b077c3cef0b08580a6cebd2 Author: Alex Osborne <aos...@nl...> Date: 2025-05-06 (Tue, 06 May 2025) Changed paths: M commons/src/main/java/org/archive/net/WebdriverBiDi.java A modules/src/main/java/org/archive/modules/extractor/ExtractorBrowser.java R modules/src/main/java/org/archive/modules/extractor/ExtractorWebdriverBiDi.java Log Message: ----------- wip Commit: 8fc11db6c9a5924bf57b1adfd9265ccef4aa4aa3 https://github.com/internetarchive/heritrix3/commit/8fc11db6c9a5924bf57b1adfd9265ccef4aa4aa3 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: R commons/src/main/java/org/archive/net/WebdriverBiDi.java A commons/src/main/java/org/archive/net/webdriver/BiDiEvent.java A commons/src/main/java/org/archive/net/webdriver/BiDiJson.java A commons/src/main/java/org/archive/net/webdriver/BiDiModule.java A commons/src/main/java/org/archive/net/webdriver/BrowsingContext.java A commons/src/main/java/org/archive/net/webdriver/LocalWebDriverBiDi.java A commons/src/main/java/org/archive/net/webdriver/Network.java A commons/src/main/java/org/archive/net/webdriver/Script.java A commons/src/main/java/org/archive/net/webdriver/Session.java A commons/src/main/java/org/archive/net/webdriver/WebDriverBiDi.java A commons/src/main/java/org/archive/util/IdleBarrier.java A engine/src/main/java/org/archive/crawler/browser/BrowserPage.java A engine/src/main/java/org/archive/crawler/browser/BrowserProcessor.java A modules/src/main/java/org/archive/modules/behaviors/Behavior.java A modules/src/main/java/org/archive/modules/behaviors/ExtractLinksBehavior.java A modules/src/main/java/org/archive/modules/behaviors/Page.java A modules/src/main/java/org/archive/modules/behaviors/ScrollDownBehavior.java R modules/src/main/java/org/archive/modules/extractor/ExtractorBrowser.java M modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java Log Message: ----------- wip Commit: 23acbfef65ea1b3995942f986d2241d07759bb65 https://github.com/internetarchive/heritrix3/commit/23acbfef65ea1b3995942f986d2241d07759bb65 Author: Alex Osborne <aos...@nl...> Date: 2025-05-10 (Sat, 10 May 2025) Changed paths: M commons/pom.xml A commons/src/main/java/org/archive/net/MitmProxy.java M engine/src/main/java/org/archive/crawler/browser/BrowserPage.java M engine/src/main/java/org/archive/crawler/browser/BrowserProcessor.java M modules/pom.xml Log Message: ----------- wip Compare: https://github.com/internetarchive/heritrix3/compare/643bf91323dc%5E...23acbfef65ea To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-09 13:06:15
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 4465c1b9f62c611f3e89740be2d05cd8595f0df6 https://github.com/internetarchive/heritrix3/commit/4465c1b9f62c611f3e89740be2d05cd8595f0df6 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M engine/pom.xml Log Message: ----------- Bump restlet from 2.6.0-m2 to 2.6.0-rc1 Commit: 227d51f467d53b94ff1b05a23070e4b2a5107adf https://github.com/internetarchive/heritrix3/commit/227d51f467d53b94ff1b05a23070e4b2a5107adf Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M pom.xml Log Message: ----------- Bump jetty from 12.0.16 to 12.0.17 Commit: d5e91eb1f3919ce0d9e640bfc62757fe2ba91acb https://github.com/internetarchive/heritrix3/commit/d5e91eb1f3919ce0d9e640bfc62757fe2ba91acb Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M modules/pom.xml Log Message: ----------- Bump pdfbox from 3.0.4 to 3.0.5 Commit: 083a60b04c89425d292fe2cd0883351e86140f15 https://github.com/internetarchive/heritrix3/commit/083a60b04c89425d292fe2cd0883351e86140f15 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M contrib/pom.xml Log Message: ----------- Bump gson from 2.12.1 to 2.13.1 Commit: d25a0b96ca7cfe801dc9522952935d35f063f933 https://github.com/internetarchive/heritrix3/commit/d25a0b96ca7cfe801dc9522952935d35f063f933 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump spring from 6.2.5 to 6.2.6 Commit: bd8d6fb2c593f037151c5f01ff0aaf92321864c5 https://github.com/internetarchive/heritrix3/commit/bd8d6fb2c593f037151c5f01ff0aaf92321864c5 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-io from 2.18.0 to 2.19.0 Commit: eb1205f6d588fe6b40b0bf656f5121be298c75a6 https://github.com/internetarchive/heritrix3/commit/eb1205f6d588fe6b40b0bf656f5121be298c75a6 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M commons/pom.xml R commons/src/main/java/org/archive/util/TestUtils.java R commons/src/main/java/org/archive/util/fingerprint/LongFPSetTestCase.java M commons/src/test/java/org/archive/bdb/StoredQueueTest.java R commons/src/test/java/org/archive/io/SinkHandlerTest.java M commons/src/test/java/org/archive/settings/file/BdbModuleTest.java M commons/src/test/java/org/archive/settings/file/PrefixFinderTest.java M commons/src/test/java/org/archive/spring/PathSharingContextTest.java M commons/src/test/java/org/archive/surt/SURTTokenizerTest.java M commons/src/test/java/org/archive/util/BloomFilterTest.java M commons/src/test/java/org/archive/util/LongToIntConsistentHashTest.java M commons/src/test/java/org/archive/util/ObjectIdentityBdbManualCacheTest.java M commons/src/test/java/org/archive/util/PaddingStringBufferTest.java M commons/src/test/java/org/archive/util/SURTTest.java M commons/src/test/java/org/archive/util/SurtPrefixSetTest.java M commons/src/test/java/org/archive/util/TextUtilsTest.java M commons/src/test/java/org/archive/util/UriUtilsTest.java M commons/src/test/java/org/archive/util/fingerprint/ArrayLongFPCacheTest.java M commons/src/test/java/org/archive/util/fingerprint/LongFPSetCacheTest.java A commons/src/test/java/org/archive/util/fingerprint/LongFPSetTestCase.java M commons/src/test/java/org/archive/util/fingerprint/MemLongFPSetTest.java M commons/src/test/java/org/archive/util/ms/DocTest.java M commons/src/test/java/org/archive/util/ms/PieceReaderTest.java M contrib/pom.xml M contrib/src/test/java/org/archive/modules/extractor/ExtractorPDFContentTest.java M contrib/src/test/java/org/archive/modules/extractor/ExtractorYoutubeDLTest.java M contrib/src/test/java/org/archive/modules/extractor/ExtractorYoutubeFormatStreamTest.java M contrib/src/test/java/org/archive/modules/recrawl/wbm/WbmPersistLoadProcessorTest.java M dist/src/test/java/org/archive/crawler/BasicProfileTest.java M engine/pom.xml M engine/src/test/java/org/archive/crawler/datamodel/CandidateURITest.java M engine/src/test/java/org/archive/crawler/datamodel/CrawlURITest.java M engine/src/test/java/org/archive/crawler/framework/CrawlControllerTest.java M engine/src/test/java/org/archive/crawler/framework/CrawlLimitEnforcerTest.java M engine/src/test/java/org/archive/crawler/framework/CrawlerProcessorTestBase.java M engine/src/test/java/org/archive/crawler/framework/EngineTest.java M engine/src/test/java/org/archive/crawler/frontier/BdbMultipleWorkQueuesTest.java M engine/src/test/java/org/archive/crawler/frontier/FrontierJournalTest.java M engine/src/test/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicyTest.java M engine/src/test/java/org/archive/crawler/prefetch/QuotaEnforcerTest.java M engine/src/test/java/org/archive/crawler/restlet/ProfileCrawlerBeansTest.java M engine/src/test/java/org/archive/crawler/restlet/ScriptingConsoleTest.java M engine/src/test/java/org/archive/crawler/restlet/XmlMarshallerTest.java M engine/src/test/java/org/archive/crawler/selftest/BackgroundImageExtractionSelfTestCase.java M engine/src/test/java/org/archive/crawler/selftest/BadURIsStopPageParsingSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/CharsetSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FramesSelfTestCase.java M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/MaxLinkHopsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence1SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence3SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence4SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/RandomServletTest.java M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java M engine/src/test/java/org/archive/crawler/selftest/SimpleSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java M engine/src/test/java/org/archive/crawler/util/BdbUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/BloomUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/FPUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/TopNSetTest.java M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java M modules/pom.xml M modules/src/main/java/org/archive/modules/extractor/ContentExtractorTestBase.java M modules/src/main/java/org/archive/modules/extractor/StringExtractorTestBase.java M modules/src/main/java/org/archive/state/ModuleTestBase.java M modules/src/test/java/org/archive/modules/canonicalize/FixupQueryStringTest.java M modules/src/test/java/org/archive/modules/canonicalize/LowercaseRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/RegexRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/RulesCanonicalizationPolicyTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripSessionCFIDsTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripSessionIDsTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripUserinfoRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripWWWNRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripWWWRuleTest.java M modules/src/test/java/org/archive/modules/credential/CredentialStoreTest.java M modules/src/test/java/org/archive/modules/deciderules/MatchesListRegexDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/MatchesStatusCodeDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/NotMatchesStatusCodeDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/ViaSurtPrefixedDecideRuleTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorHTMLTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorMultipleRegexTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorSWFTest.java M modules/src/test/java/org/archive/modules/extractor/JerichoExtractorHTMLTest.java M modules/src/test/java/org/archive/modules/extractor/PDFParserTest.java M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java M modules/src/test/java/org/archive/modules/fetcher/CookieStoreTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchFTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java M modules/src/test/java/org/archive/modules/forms/FormLoginProcessorTest.java M modules/src/test/java/org/archive/modules/net/CrawlHostTest.java M modules/src/test/java/org/archive/modules/net/CrawlServerTest.java M modules/src/test/java/org/archive/modules/net/FirstNamedRobotsPolicyTest.java M modules/src/test/java/org/archive/modules/net/RobotsPolicyTest.java M modules/src/test/java/org/archive/modules/net/RobotstxtTest.java M modules/src/test/java/org/archive/modules/net/ServerCacheTest.java M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java M modules/src/test/java/org/archive/modules/writer/ARCWriterProcessorTest.java M modules/src/test/java/org/archive/modules/writer/WARCWriterChainProcessorTest.java M modules/src/test/java/org/archive/modules/writer/WARCWriterProcessorTest.java M pom.xml Log Message: ----------- Upgrade all tests to junit 5 Commit: f5732e1a98c3dddd65bc717cd4aa498390978f8b https://github.com/internetarchive/heritrix3/commit/f5732e1a98c3dddd65bc717cd4aa498390978f8b Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump jsch from 0.2.26 to 2.27.0 Commit: 8e177f778ba57baadd69d156c89739e53ee91f74 https://github.com/internetarchive/heritrix3/commit/8e177f778ba57baadd69d156c89739e53ee91f74 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M CHANGELOG.md Log Message: ----------- Update CHANGELOG for 3.9.0 Commit: 1e502fba10c23900ca532ab8e74ea0fb8925171e https://github.com/internetarchive/heritrix3/commit/1e502fba10c23900ca532ab8e74ea0fb8925171e Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M .github/workflows/docker-image.yml M .github/workflows/maven.yml Log Message: ----------- Limit permissions on github actions Commit: 8692bdf6554debb60b7f699941a9df8bf5e93f04 https://github.com/internetarchive/heritrix3/commit/8692bdf6554debb60b7f699941a9df8bf5e93f04 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M modules/src/main/java/org/archive/modules/warc/HttpRequestRecordBuilder.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java Log Message: ----------- Add WARC-Protocol to request records too when using HTTP/2 or HTTP/3 While this could be inferred from the response, it's more accurate to include them on the request as the request was not really HTTP/1.1. Commit: 4a2cdfaa816de02a8c0c6d0995f6fad00c857081 https://github.com/internetarchive/heritrix3/commit/4a2cdfaa816de02a8c0c6d0995f6fad00c857081 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java Log Message: ----------- FetchHTTP2: Print the jetty-quiche-native warning earlier at build time Commit: e09106cc157eca828ca39f79f79c9924ab6b9b65 https://github.com/internetarchive/heritrix3/commit/e09106cc157eca828ca39f79f79c9924ab6b9b65 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M docs/bean-reference.rst M docs/configuring-jobs.rst Log Message: ----------- Document HTTP/2 and HTTP/3 support Commit: d60161b6be45dfdeb773d17038f4eb16d2e2a37c https://github.com/internetarchive/heritrix3/commit/d60161b6be45dfdeb773d17038f4eb16d2e2a37c Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M .github/workflows/docker-image.yml M .github/workflows/maven.yml M CHANGELOG.md M commons/pom.xml R commons/src/main/java/org/archive/util/TestUtils.java R commons/src/main/java/org/archive/util/fingerprint/LongFPSetTestCase.java M commons/src/test/java/org/archive/bdb/StoredQueueTest.java R commons/src/test/java/org/archive/io/SinkHandlerTest.java M commons/src/test/java/org/archive/settings/file/BdbModuleTest.java M commons/src/test/java/org/archive/settings/file/PrefixFinderTest.java M commons/src/test/java/org/archive/spring/PathSharingContextTest.java M commons/src/test/java/org/archive/surt/SURTTokenizerTest.java M commons/src/test/java/org/archive/util/BloomFilterTest.java M commons/src/test/java/org/archive/util/LongToIntConsistentHashTest.java M commons/src/test/java/org/archive/util/ObjectIdentityBdbManualCacheTest.java M commons/src/test/java/org/archive/util/PaddingStringBufferTest.java M commons/src/test/java/org/archive/util/SURTTest.java M commons/src/test/java/org/archive/util/SurtPrefixSetTest.java M commons/src/test/java/org/archive/util/TextUtilsTest.java M commons/src/test/java/org/archive/util/UriUtilsTest.java M commons/src/test/java/org/archive/util/fingerprint/ArrayLongFPCacheTest.java M commons/src/test/java/org/archive/util/fingerprint/LongFPSetCacheTest.java A commons/src/test/java/org/archive/util/fingerprint/LongFPSetTestCase.java M commons/src/test/java/org/archive/util/fingerprint/MemLongFPSetTest.java M commons/src/test/java/org/archive/util/ms/DocTest.java M commons/src/test/java/org/archive/util/ms/PieceReaderTest.java M contrib/pom.xml M contrib/src/test/java/org/archive/modules/extractor/ExtractorPDFContentTest.java M contrib/src/test/java/org/archive/modules/extractor/ExtractorYoutubeDLTest.java M contrib/src/test/java/org/archive/modules/extractor/ExtractorYoutubeFormatStreamTest.java M contrib/src/test/java/org/archive/modules/recrawl/wbm/WbmPersistLoadProcessorTest.java M dist/src/test/java/org/archive/crawler/BasicProfileTest.java M docs/bean-reference.rst M docs/configuring-jobs.rst M engine/pom.xml M engine/src/test/java/org/archive/crawler/datamodel/CandidateURITest.java M engine/src/test/java/org/archive/crawler/datamodel/CrawlURITest.java M engine/src/test/java/org/archive/crawler/framework/CrawlControllerTest.java M engine/src/test/java/org/archive/crawler/framework/CrawlLimitEnforcerTest.java M engine/src/test/java/org/archive/crawler/framework/CrawlerProcessorTestBase.java M engine/src/test/java/org/archive/crawler/framework/EngineTest.java M engine/src/test/java/org/archive/crawler/frontier/BdbMultipleWorkQueuesTest.java M engine/src/test/java/org/archive/crawler/frontier/FrontierJournalTest.java M engine/src/test/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicyTest.java M engine/src/test/java/org/archive/crawler/prefetch/QuotaEnforcerTest.java M engine/src/test/java/org/archive/crawler/restlet/ProfileCrawlerBeansTest.java M engine/src/test/java/org/archive/crawler/restlet/ScriptingConsoleTest.java M engine/src/test/java/org/archive/crawler/restlet/XmlMarshallerTest.java M engine/src/test/java/org/archive/crawler/selftest/BackgroundImageExtractionSelfTestCase.java M engine/src/test/java/org/archive/crawler/selftest/BadURIsStopPageParsingSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/CharsetSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FramesSelfTestCase.java M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/MaxLinkHopsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence1SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence3SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence4SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/RandomServletTest.java M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java M engine/src/test/java/org/archive/crawler/selftest/SimpleSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java M engine/src/test/java/org/archive/crawler/util/BdbUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/BloomUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/FPUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/TopNSetTest.java M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java M modules/pom.xml M modules/src/main/java/org/archive/modules/extractor/ContentExtractorTestBase.java M modules/src/main/java/org/archive/modules/extractor/StringExtractorTestBase.java M modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java M modules/src/main/java/org/archive/modules/warc/HttpRequestRecordBuilder.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java M modules/src/main/java/org/archive/state/ModuleTestBase.java M modules/src/test/java/org/archive/modules/canonicalize/FixupQueryStringTest.java M modules/src/test/java/org/archive/modules/canonicalize/LowercaseRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/RegexRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/RulesCanonicalizationPolicyTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripSessionCFIDsTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripSessionIDsTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripUserinfoRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripWWWNRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripWWWRuleTest.java M modules/src/test/java/org/archive/modules/credential/CredentialStoreTest.java M modules/src/test/java/org/archive/modules/deciderules/MatchesListRegexDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/MatchesStatusCodeDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/NotMatchesStatusCodeDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/ViaSurtPrefixedDecideRuleTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorHTMLTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorMultipleRegexTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorSWFTest.java M modules/src/test/java/org/archive/modules/extractor/JerichoExtractorHTMLTest.java M modules/src/test/java/org/archive/modules/extractor/PDFParserTest.java M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java M modules/src/test/java/org/archive/modules/fetcher/CookieStoreTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchFTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java M modules/src/test/java/org/archive/modules/forms/FormLoginProcessorTest.java M modules/src/test/java/org/archive/modules/net/CrawlHostTest.java M modules/src/test/java/org/archive/modules/net/CrawlServerTest.java M modules/src/test/java/org/archive/modules/net/FirstNamedRobotsPolicyTest.java M modules/src/test/java/org/archive/modules/net/RobotsPolicyTest.java M modules/src/test/java/org/archive/modules/net/RobotstxtTest.java M modules/src/test/java/org/archive/modules/net/ServerCacheTest.java M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java M modules/src/test/java/org/archive/modules/writer/ARCWriterProcessorTest.java M modules/src/test/java/org/archive/modules/writer/WARCWriterChainProcessorTest.java M modules/src/test/java/org/archive/modules/writer/WARCWriterProcessorTest.java M pom.xml Log Message: ----------- Merge pull request #650 from internetarchive/deps-3.9 Upgrade dependencies (notably junit 5) for 3.9.0 release Compare: https://github.com/internetarchive/heritrix3/compare/1e3b0f6c39fc...d60161b6be45 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-09 13:06:13
|
Branch: refs/heads/deps-3.9 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-09 12:04:19
|
Branch: refs/heads/deps-3.9 Home: https://github.com/internetarchive/heritrix3 Commit: e09106cc157eca828ca39f79f79c9924ab6b9b65 https://github.com/internetarchive/heritrix3/commit/e09106cc157eca828ca39f79f79c9924ab6b9b65 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M docs/bean-reference.rst M docs/configuring-jobs.rst Log Message: ----------- Document HTTP/2 and HTTP/3 support To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-09 11:41:24
|
Branch: refs/heads/deps-3.9 Home: https://github.com/internetarchive/heritrix3 Commit: 8692bdf6554debb60b7f699941a9df8bf5e93f04 https://github.com/internetarchive/heritrix3/commit/8692bdf6554debb60b7f699941a9df8bf5e93f04 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M modules/src/main/java/org/archive/modules/warc/HttpRequestRecordBuilder.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java Log Message: ----------- Add WARC-Protocol to request records too when using HTTP/2 or HTTP/3 While this could be inferred from the response, it's more accurate to include them on the request as the request was not really HTTP/1.1. Commit: 4a2cdfaa816de02a8c0c6d0995f6fad00c857081 https://github.com/internetarchive/heritrix3/commit/4a2cdfaa816de02a8c0c6d0995f6fad00c857081 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java Log Message: ----------- FetchHTTP2: Print the jetty-quiche-native warning earlier at build time Commit: 586c082cedf8cc8559ced2b0b6d72085fd9979cc https://github.com/internetarchive/heritrix3/commit/586c082cedf8cc8559ced2b0b6d72085fd9979cc Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M docs/bean-reference.rst M docs/configuring-jobs.rst Log Message: ----------- Document HTTP/2 and HTTP/3 support Compare: https://github.com/internetarchive/heritrix3/compare/1e502fba10c2...586c082cedf8 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-09 10:00:06
|
Branch: refs/heads/deps-3.9 Home: https://github.com/internetarchive/heritrix3 Commit: 8e177f778ba57baadd69d156c89739e53ee91f74 https://github.com/internetarchive/heritrix3/commit/8e177f778ba57baadd69d156c89739e53ee91f74 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M CHANGELOG.md Log Message: ----------- Update CHANGELOG for 3.9.0 Commit: 1e502fba10c23900ca532ab8e74ea0fb8925171e https://github.com/internetarchive/heritrix3/commit/1e502fba10c23900ca532ab8e74ea0fb8925171e Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M .github/workflows/docker-image.yml M .github/workflows/maven.yml Log Message: ----------- Limit permissions on github actions Compare: https://github.com/internetarchive/heritrix3/compare/f5732e1a98c3...1e502fba10c2 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-09 09:20:01
|
Branch: refs/heads/deps-3.9 Home: https://github.com/internetarchive/heritrix3 Commit: f5732e1a98c3dddd65bc717cd4aa498390978f8b https://github.com/internetarchive/heritrix3/commit/f5732e1a98c3dddd65bc717cd4aa498390978f8b Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump jsch from 0.2.26 to 2.27.0 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-08 15:08:01
|
Branch: refs/heads/deps-3.9 Home: https://github.com/internetarchive/heritrix3 Commit: 4465c1b9f62c611f3e89740be2d05cd8595f0df6 https://github.com/internetarchive/heritrix3/commit/4465c1b9f62c611f3e89740be2d05cd8595f0df6 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M engine/pom.xml Log Message: ----------- Bump restlet from 2.6.0-m2 to 2.6.0-rc1 Commit: 227d51f467d53b94ff1b05a23070e4b2a5107adf https://github.com/internetarchive/heritrix3/commit/227d51f467d53b94ff1b05a23070e4b2a5107adf Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M pom.xml Log Message: ----------- Bump jetty from 12.0.16 to 12.0.17 Commit: d5e91eb1f3919ce0d9e640bfc62757fe2ba91acb https://github.com/internetarchive/heritrix3/commit/d5e91eb1f3919ce0d9e640bfc62757fe2ba91acb Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M modules/pom.xml Log Message: ----------- Bump pdfbox from 3.0.4 to 3.0.5 Commit: 083a60b04c89425d292fe2cd0883351e86140f15 https://github.com/internetarchive/heritrix3/commit/083a60b04c89425d292fe2cd0883351e86140f15 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M contrib/pom.xml Log Message: ----------- Bump gson from 2.12.1 to 2.13.1 Commit: d25a0b96ca7cfe801dc9522952935d35f063f933 https://github.com/internetarchive/heritrix3/commit/d25a0b96ca7cfe801dc9522952935d35f063f933 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump spring from 6.2.5 to 6.2.6 Commit: bd8d6fb2c593f037151c5f01ff0aaf92321864c5 https://github.com/internetarchive/heritrix3/commit/bd8d6fb2c593f037151c5f01ff0aaf92321864c5 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-io from 2.18.0 to 2.19.0 Commit: eb1205f6d588fe6b40b0bf656f5121be298c75a6 https://github.com/internetarchive/heritrix3/commit/eb1205f6d588fe6b40b0bf656f5121be298c75a6 Author: Alex Osborne <aos...@nl...> Date: 2025-05-09 (Fri, 09 May 2025) Changed paths: M commons/pom.xml R commons/src/main/java/org/archive/util/TestUtils.java R commons/src/main/java/org/archive/util/fingerprint/LongFPSetTestCase.java M commons/src/test/java/org/archive/bdb/StoredQueueTest.java R commons/src/test/java/org/archive/io/SinkHandlerTest.java M commons/src/test/java/org/archive/settings/file/BdbModuleTest.java M commons/src/test/java/org/archive/settings/file/PrefixFinderTest.java M commons/src/test/java/org/archive/spring/PathSharingContextTest.java M commons/src/test/java/org/archive/surt/SURTTokenizerTest.java M commons/src/test/java/org/archive/util/BloomFilterTest.java M commons/src/test/java/org/archive/util/LongToIntConsistentHashTest.java M commons/src/test/java/org/archive/util/ObjectIdentityBdbManualCacheTest.java M commons/src/test/java/org/archive/util/PaddingStringBufferTest.java M commons/src/test/java/org/archive/util/SURTTest.java M commons/src/test/java/org/archive/util/SurtPrefixSetTest.java M commons/src/test/java/org/archive/util/TextUtilsTest.java M commons/src/test/java/org/archive/util/UriUtilsTest.java M commons/src/test/java/org/archive/util/fingerprint/ArrayLongFPCacheTest.java M commons/src/test/java/org/archive/util/fingerprint/LongFPSetCacheTest.java A commons/src/test/java/org/archive/util/fingerprint/LongFPSetTestCase.java M commons/src/test/java/org/archive/util/fingerprint/MemLongFPSetTest.java M commons/src/test/java/org/archive/util/ms/DocTest.java M commons/src/test/java/org/archive/util/ms/PieceReaderTest.java M contrib/pom.xml M contrib/src/test/java/org/archive/modules/extractor/ExtractorPDFContentTest.java M contrib/src/test/java/org/archive/modules/extractor/ExtractorYoutubeDLTest.java M contrib/src/test/java/org/archive/modules/extractor/ExtractorYoutubeFormatStreamTest.java M contrib/src/test/java/org/archive/modules/recrawl/wbm/WbmPersistLoadProcessorTest.java M dist/src/test/java/org/archive/crawler/BasicProfileTest.java M engine/pom.xml M engine/src/test/java/org/archive/crawler/datamodel/CandidateURITest.java M engine/src/test/java/org/archive/crawler/datamodel/CrawlURITest.java M engine/src/test/java/org/archive/crawler/framework/CrawlControllerTest.java M engine/src/test/java/org/archive/crawler/framework/CrawlLimitEnforcerTest.java M engine/src/test/java/org/archive/crawler/framework/CrawlerProcessorTestBase.java M engine/src/test/java/org/archive/crawler/framework/EngineTest.java M engine/src/test/java/org/archive/crawler/frontier/BdbMultipleWorkQueuesTest.java M engine/src/test/java/org/archive/crawler/frontier/FrontierJournalTest.java M engine/src/test/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicyTest.java M engine/src/test/java/org/archive/crawler/prefetch/QuotaEnforcerTest.java M engine/src/test/java/org/archive/crawler/restlet/ProfileCrawlerBeansTest.java M engine/src/test/java/org/archive/crawler/restlet/ScriptingConsoleTest.java M engine/src/test/java/org/archive/crawler/restlet/XmlMarshallerTest.java M engine/src/test/java/org/archive/crawler/selftest/BackgroundImageExtractionSelfTestCase.java M engine/src/test/java/org/archive/crawler/selftest/BadURIsStopPageParsingSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/CharsetSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FramesSelfTestCase.java M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/MaxLinkHopsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence1SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence3SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/Precedence4SelfTest.java M engine/src/test/java/org/archive/crawler/selftest/RandomServletTest.java M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java M engine/src/test/java/org/archive/crawler/selftest/SimpleSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java M engine/src/test/java/org/archive/crawler/util/BdbUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/BloomUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/FPUriUniqFilterTest.java M engine/src/test/java/org/archive/crawler/util/TopNSetTest.java M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java M modules/pom.xml M modules/src/main/java/org/archive/modules/extractor/ContentExtractorTestBase.java M modules/src/main/java/org/archive/modules/extractor/StringExtractorTestBase.java M modules/src/main/java/org/archive/state/ModuleTestBase.java M modules/src/test/java/org/archive/modules/canonicalize/FixupQueryStringTest.java M modules/src/test/java/org/archive/modules/canonicalize/LowercaseRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/RegexRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/RulesCanonicalizationPolicyTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripSessionCFIDsTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripSessionIDsTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripUserinfoRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripWWWNRuleTest.java M modules/src/test/java/org/archive/modules/canonicalize/StripWWWRuleTest.java M modules/src/test/java/org/archive/modules/credential/CredentialStoreTest.java M modules/src/test/java/org/archive/modules/deciderules/MatchesListRegexDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/MatchesStatusCodeDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/NotMatchesStatusCodeDecideRuleTest.java M modules/src/test/java/org/archive/modules/deciderules/ViaSurtPrefixedDecideRuleTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorHTMLTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorMultipleRegexTest.java M modules/src/test/java/org/archive/modules/extractor/ExtractorSWFTest.java M modules/src/test/java/org/archive/modules/extractor/JerichoExtractorHTMLTest.java M modules/src/test/java/org/archive/modules/extractor/PDFParserTest.java M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java M modules/src/test/java/org/archive/modules/fetcher/CookieStoreTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchFTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java M modules/src/test/java/org/archive/modules/forms/FormLoginProcessorTest.java M modules/src/test/java/org/archive/modules/net/CrawlHostTest.java M modules/src/test/java/org/archive/modules/net/CrawlServerTest.java M modules/src/test/java/org/archive/modules/net/FirstNamedRobotsPolicyTest.java M modules/src/test/java/org/archive/modules/net/RobotsPolicyTest.java M modules/src/test/java/org/archive/modules/net/RobotstxtTest.java M modules/src/test/java/org/archive/modules/net/ServerCacheTest.java M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java M modules/src/test/java/org/archive/modules/writer/ARCWriterProcessorTest.java M modules/src/test/java/org/archive/modules/writer/WARCWriterChainProcessorTest.java M modules/src/test/java/org/archive/modules/writer/WARCWriterProcessorTest.java M pom.xml Log Message: ----------- Upgrade all tests to junit 5 Compare: https://github.com/internetarchive/heritrix3/compare/4465c1b9f62c%5E...eb1205f6d588 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-08 08:28:20
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 1e3b0f6c39fc937fd597276728d66681289eb911 https://github.com/internetarchive/heritrix3/commit/1e3b0f6c39fc937fd597276728d66681289eb911 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M .gitignore Log Message: ----------- Add /target, __pycache__, adhoc.keystore, heritrix_dmesg.log to .gitignore To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-08 08:25:46
|
Branch: refs/heads/http2 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-05-08 08:25:41
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: fcfef68aff741c7a0c36a97773b34a85f89f2d9f https://github.com/internetarchive/heritrix3/commit/fcfef68aff741c7a0c36a97773b34a85f89f2d9f Author: Alex Osborne <aos...@nl...> Date: 2025-04-29 (Tue, 29 Apr 2025) Changed paths: M modules/pom.xml A modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java M modules/src/main/java/org/archive/modules/net/CrawlServer.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java A modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java Log Message: ----------- FetchHTTP2: A new fetch module for HTTP/2 and HTTP/3 This uses Jetty HttpClient since it speaks both protocols, and we already have it as a dependency via Restlet. This doesn't support all the options of FetchHTTP, notably proxy and POST requests are missing. Jetty currently has the HTTP/3 client marked as "experimental, not for production use" so we disable it by default and don't ship the large quiche native jar it requires. It does seem to work OK though, at least in my limited testing so far. The HTTP/3 support currently only responds to Alt-Svc headers not other ways of discovering HTTP/3 availability (e.g. HTTPS DNS record). Fetches that were made via HTTP/2 or HTTP/3 are annotated 'h2' and 'h3' in the crawl.log. The messages are recorded in the WARC files using HTTP/1.1 syntax with a WARC-Protocol header. FetchHTTP2 also currently records HTTP/1.1 messages without transfer-encoding rather than the raw wire messages. Commit: 9807b93db3d5901caca1cd8f67e0297f727cfb91 https://github.com/internetarchive/heritrix3/commit/9807b93db3d5901caca1cd8f67e0297f727cfb91 Author: Alex Osborne <aos...@nl...> Date: 2025-05-08 (Thu, 08 May 2025) Changed paths: M modules/pom.xml A modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java M modules/src/main/java/org/archive/modules/net/CrawlServer.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java A modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java Log Message: ----------- Merge pull request #649 from internetarchive/http2 FetchHTTP2: A new fetch module for HTTP/2 and HTTP/3 Compare: https://github.com/internetarchive/heritrix3/compare/bc9b21e2ee4d...9807b93db3d5 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-29 03:49:34
|
Branch: refs/heads/http2 Home: https://github.com/internetarchive/heritrix3 Commit: fcfef68aff741c7a0c36a97773b34a85f89f2d9f https://github.com/internetarchive/heritrix3/commit/fcfef68aff741c7a0c36a97773b34a85f89f2d9f Author: Alex Osborne <aos...@nl...> Date: 2025-04-29 (Tue, 29 Apr 2025) Changed paths: M modules/pom.xml A modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java M modules/src/main/java/org/archive/modules/net/CrawlServer.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java A modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java Log Message: ----------- FetchHTTP2: A new fetch module for HTTP/2 and HTTP/3 This uses Jetty HttpClient since it speaks both protocols, and we already have it as a dependency via Restlet. This doesn't support all the options of FetchHTTP, notably proxy and POST requests are missing. Jetty currently has the HTTP/3 client marked as "experimental, not for production use" so we disable it by default and don't ship the large quiche native jar it requires. It does seem to work OK though, at least in my limited testing so far. The HTTP/3 support currently only responds to Alt-Svc headers not other ways of discovering HTTP/3 availability (e.g. HTTPS DNS record). Fetches that were made via HTTP/2 or HTTP/3 are annotated 'h2' and 'h3' in the crawl.log. The messages are recorded in the WARC files using HTTP/1.1 syntax with a WARC-Protocol header. FetchHTTP2 also currently records HTTP/1.1 messages without transfer-encoding rather than the raw wire messages. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-29 03:48:30
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: bc259728a0583709e9a17bab0236339381c1f289 https://github.com/internetarchive/heritrix3/commit/bc259728a0583709e9a17bab0236339381c1f289 Author: Alex Osborne <aos...@nl...> Date: 2025-04-24 (Thu, 24 Apr 2025) Changed paths: M engine/pom.xml M engine/src/main/java/org/archive/crawler/Heritrix.java A engine/src/main/java/org/archive/crawler/restlet/NoSniHostCheckHttpsServerHelper.java M engine/src/test/java/org/archive/crawler/selftest/CheckpointSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthServlet.java M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/RandomServlet.java M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentServlet.java M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java M modules/pom.xml M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java M pom.xml Log Message: ----------- Update to Jetty 12.0.16 and Restlet 2.6.0-M2 The Jetty API has changed, which mostly affects test code. Jetty now does a strict SNI host check which unfortunately causes it to return "SNI error" for our existing ad-hoc certificates. For now, I've disabled it to avoid breaking existing deployments but added a --sni-host-check command-line option so you can re-enable it if you've configured your own certificate appropriately. Commit: 0f5358ffef3761b93d969737a7d32a772e1f5543 https://github.com/internetarchive/heritrix3/commit/0f5358ffef3761b93d969737a7d32a772e1f5543 Author: Alex Osborne <aos...@nl...> Date: 2025-04-28 (Mon, 28 Apr 2025) Changed paths: M engine/pom.xml Log Message: ----------- Exclude jetty-quiche-native from restlet It's very large and we don't use Restlet's HTTP/3 support currently. Commit: db16b6096079b009ee241325c88fa8cd10557b0d https://github.com/internetarchive/heritrix3/commit/db16b6096079b009ee241325c88fa8cd10557b0d Author: Alex Osborne <aos...@nl...> Date: 2025-04-28 (Mon, 28 Apr 2025) Changed paths: M engine/src/main/java/org/archive/crawler/restlet/JobResource.java M engine/src/main/java/org/archive/crawler/restlet/models/CrawlJobModel.java M engine/src/main/resources/org/archive/crawler/restlet/Job.ftl Log Message: ----------- Fix 'anypath' URL generation and avoid unnecessary usages of it Restlet 2.6 refuses paths with double slash in the static path and we were inadvertently generating them. Commit: bc9b21e2ee4d44feb94b98ab264dd5caf269cf6a https://github.com/internetarchive/heritrix3/commit/bc9b21e2ee4d44feb94b98ab264dd5caf269cf6a Author: Alex Osborne <aos...@nl...> Date: 2025-04-29 (Tue, 29 Apr 2025) Changed paths: M engine/pom.xml M engine/src/main/java/org/archive/crawler/Heritrix.java M engine/src/main/java/org/archive/crawler/restlet/JobResource.java A engine/src/main/java/org/archive/crawler/restlet/NoSniHostCheckHttpsServerHelper.java M engine/src/main/java/org/archive/crawler/restlet/models/CrawlJobModel.java M engine/src/main/resources/org/archive/crawler/restlet/Job.ftl M engine/src/test/java/org/archive/crawler/selftest/CheckpointSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthServlet.java M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/RandomServlet.java M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentServlet.java M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java M modules/pom.xml M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java M pom.xml Log Message: ----------- Merge pull request #648 from internetarchive/jetty-12 Update to Jetty 12.0.16 and Restlet 2.6.0-M2 Compare: https://github.com/internetarchive/heritrix3/compare/d73e2f6b8790...bc9b21e2ee4d To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-29 03:48:11
|
Branch: refs/heads/jetty-12 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-28 12:18:35
|
Branch: refs/heads/http2 Home: https://github.com/internetarchive/heritrix3 Commit: 88e6c0b551eada7e657481f6c8f8ec3c88eaa1af https://github.com/internetarchive/heritrix3/commit/88e6c0b551eada7e657481f6c8f8ec3c88eaa1af Author: Alex Osborne <aos...@nl...> Date: 2025-04-28 (Mon, 28 Apr 2025) Changed paths: M modules/pom.xml A modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java M modules/src/main/java/org/archive/modules/net/CrawlServer.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java A modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java Log Message: ----------- FetchHTTP2: A new fetch module for HTTP/2 and HTTP/3 This uses Jetty HttpClient since it speaks both protocols, and we already have it as a dependency via Restlet. This doesn't support all the options of FetchHTTP, notably proxy and POST requests are missing. Jetty currently has the HTTP/3 client marked as "experimental, not for production use" so we disable it by default and don't ship the large quiche native jar it requires. It does seem to work OK though, at least in my limited testing so far. The HTTP/3 support currently only responds to Alt-Svc headers not other ways of discovering HTTP/3 availability (e.g. HTTPS DNS record). Fetches that were made via HTTP/2 or HTTP/3 are annotated 'h2' and 'h3' in the crawl.log. The messages are recorded in the WARC files using HTTP/1.1 syntax with a WARC-Protocol header. FetchHTTP2 also currently records HTTP/1.1 messages without transfer-encoding rather than the raw wire messages. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-28 12:17:09
|
Branch: refs/heads/http2 Home: https://github.com/internetarchive/heritrix3 Commit: 4002fb217d1db6df312db2cd5367946fdfbb50ef https://github.com/internetarchive/heritrix3/commit/4002fb217d1db6df312db2cd5367946fdfbb50ef Author: Alex Osborne <aos...@nl...> Date: 2025-04-28 (Mon, 28 Apr 2025) Changed paths: M modules/pom.xml A modules/src/main/java/org/archive/modules/fetcher/FetchHTTP2.java M modules/src/main/java/org/archive/modules/net/CrawlServer.java M modules/src/main/java/org/archive/modules/warc/HttpResponseRecordBuilder.java A modules/src/test/java/org/archive/modules/fetcher/FetchHTTP2Test.java Log Message: ----------- FetchHTTP2: A new fetch module for HTTP/2 and HTTP/3 This uses Jetty HttpClient since it speaks both protocols, and we already have it as a dependency via Restlet. This doesn't support all the options of FetchHTTP, notably proxy and POST requests are missing. Jetty currently has the HTTP/3 client marked as "experimental, not for production use" so we disable it by default and don't ship the large quiche native jar it requires. It does seem to work OK though, at least in my limited testing so far. The HTTP/3 support currently only responds to Alt-Svc headers not other ways of discovering HTTP/3 availability (e.g. HTTPS DNS record). Fetches that were made via HTTP/2 or HTTP/3 are annotated 'h2' and 'h3' in the crawl.log. The messages are recorded in the WARC files using HTTP/1.1 syntax with a WARC-Protocol header. FetchHTTP2 also currently records HTTP/1.1 messages without transfer-encoding rather than the raw wire messages. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-28 08:10:25
|
Branch: refs/heads/jetty-12 Home: https://github.com/internetarchive/heritrix3 Commit: db16b6096079b009ee241325c88fa8cd10557b0d https://github.com/internetarchive/heritrix3/commit/db16b6096079b009ee241325c88fa8cd10557b0d Author: Alex Osborne <aos...@nl...> Date: 2025-04-28 (Mon, 28 Apr 2025) Changed paths: M engine/src/main/java/org/archive/crawler/restlet/JobResource.java M engine/src/main/java/org/archive/crawler/restlet/models/CrawlJobModel.java M engine/src/main/resources/org/archive/crawler/restlet/Job.ftl Log Message: ----------- Fix 'anypath' URL generation and avoid unnecessary usages of it Restlet 2.6 refuses paths with double slash in the static path and we were inadvertently generating them. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-28 07:30:13
|
Branch: refs/heads/jetty-12 Home: https://github.com/internetarchive/heritrix3 Commit: 0f5358ffef3761b93d969737a7d32a772e1f5543 https://github.com/internetarchive/heritrix3/commit/0f5358ffef3761b93d969737a7d32a772e1f5543 Author: Alex Osborne <aos...@nl...> Date: 2025-04-28 (Mon, 28 Apr 2025) Changed paths: M engine/pom.xml Log Message: ----------- Exclude jetty-quiche-native from restlet It's very large and we don't use Restlet's HTTP/3 support currently. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-24 08:41:20
|
Branch: refs/heads/jetty-12 Home: https://github.com/internetarchive/heritrix3 Commit: bc259728a0583709e9a17bab0236339381c1f289 https://github.com/internetarchive/heritrix3/commit/bc259728a0583709e9a17bab0236339381c1f289 Author: Alex Osborne <aos...@nl...> Date: 2025-04-24 (Thu, 24 Apr 2025) Changed paths: M engine/pom.xml M engine/src/main/java/org/archive/crawler/Heritrix.java A engine/src/main/java/org/archive/crawler/restlet/NoSniHostCheckHttpsServerHelper.java M engine/src/test/java/org/archive/crawler/selftest/CheckpointSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/FormAuthServlet.java M engine/src/test/java/org/archive/crawler/selftest/FormLoginSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/HttpAuthSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/RandomServlet.java M engine/src/test/java/org/archive/crawler/selftest/SelfTestBase.java M engine/src/test/java/org/archive/crawler/selftest/StatisticsSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentSelfTest.java M engine/src/test/java/org/archive/crawler/selftest/UserAgentServlet.java M engine/src/test/java/org/archive/modules/fetcher/FormAuthTest.java M modules/pom.xml M modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTestServers.java M modules/src/test/java/org/archive/modules/recrawl/ContentDigestHistoryTest.java M pom.xml Log Message: ----------- Update to Jetty 12.0.16 and Restlet 2.6.0-M2 The Jetty API has changed, which mostly affects test code. Jetty now does a strict SNI host check which unfortunately causes it to return "SNI error" for our existing ad-hoc certificates. For now, I've disabled it to avoid breaking existing deployments but added a --sni-host-check command-line option so you can re-enable it if you've configured your own certificate appropriately. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-24 02:02:59
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: d73e2f6b87909f545b21d76ff2825055c190f12d https://github.com/internetarchive/heritrix3/commit/d73e2f6b87909f545b21d76ff2825055c190f12d Author: Alex Osborne <aos...@nl...> Date: 2025-04-24 (Thu, 24 Apr 2025) Changed paths: M CHANGELOG.md Log Message: ----------- Update CHANGELOG.md for #647 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-24 01:58:59
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: c7784f18e9c13a6797f7aeabaec9d2c152fc9139 https://github.com/internetarchive/heritrix3/commit/c7784f18e9c13a6797f7aeabaec9d2c152fc9139 Author: Adam Miller <ad...@ar...> Date: 2025-04-21 (Mon, 21 Apr 2025) Changed paths: M commons/src/main/java/org/archive/bdb/KryoBinding.java Log Message: ----------- feat: Add serializer for Histotable used by HighestUriPrecedenceProvider Commit: 75377c5a3be4c35f342e26079ac7ff0847846e9a https://github.com/internetarchive/heritrix3/commit/75377c5a3be4c35f342e26079ac7ff0847846e9a Author: Adam Miller <ad...@ar...> Date: 2025-04-21 (Mon, 21 Apr 2025) Changed paths: M commons/src/main/java/org/archive/bdb/KryoBinding.java Log Message: ----------- fix: FieldSerializer wasn't passing unit tests. Switch to JavaSerializer Commit: e7fe566919d9748bf6514c9ed6d9c7544793face https://github.com/internetarchive/heritrix3/commit/e7fe566919d9748bf6514c9ed6d9c7544793face Author: Adam Miller <ad...@ar...> Date: 2025-04-22 (Tue, 22 Apr 2025) Changed paths: M commons/src/main/java/org/archive/bdb/KryoBinding.java M engine/src/main/java/org/archive/crawler/frontier/BdbWorkQueue.java M engine/src/main/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicy.java Log Message: ----------- fix: autoregister Histotable and HighestUriPrecedenceProvider Commit: cb98bfc522dfa242cd7ad7fe55e3d947068dbf29 https://github.com/internetarchive/heritrix3/commit/cb98bfc522dfa242cd7ad7fe55e3d947068dbf29 Author: Adam Miller <ad...@ar...> Date: 2025-04-22 (Tue, 22 Apr 2025) Changed paths: M engine/src/main/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicy.java Log Message: ----------- chore: fix line endings Commit: fdada4c5ecc11bf524d6ca1faf924da347a5537d https://github.com/internetarchive/heritrix3/commit/fdada4c5ecc11bf524d6ca1faf924da347a5537d Author: Adam Miller <ad...@ar...> Date: 2025-04-23 (Wed, 23 Apr 2025) Changed paths: M engine/src/main/java/org/archive/crawler/frontier/BdbWorkQueue.java Log Message: ----------- chore: formatting Commit: 02c4c8ee09a71257531174ccb09a78feaae3071a https://github.com/internetarchive/heritrix3/commit/02c4c8ee09a71257531174ccb09a78feaae3071a Author: Adam Miller <ad...@ar...> Date: 2025-04-23 (Wed, 23 Apr 2025) Changed paths: M engine/src/test/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicyTest.java Log Message: ----------- feat: add unit test for HighestUriPrecedenceProvider Kryo serialization Commit: 91cd4b815c134c162202aefaec980318c8663d59 https://github.com/internetarchive/heritrix3/commit/91cd4b815c134c162202aefaec980318c8663d59 Author: Alex Osborne <aos...@nl...> Date: 2025-04-24 (Thu, 24 Apr 2025) Changed paths: M commons/src/main/java/org/archive/bdb/KryoBinding.java M engine/src/main/java/org/archive/crawler/frontier/BdbWorkQueue.java M engine/src/main/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicy.java M engine/src/test/java/org/archive/crawler/frontier/precedence/HighestUriQueuePrecedencePolicyTest.java Log Message: ----------- Merge pull request #647 from adam-miller/add-histotable-serializer-for-HighestUriPrecedenceProvider Add histotable serializer for highest uri precedence provider Compare: https://github.com/internetarchive/heritrix3/compare/e9b60404a68b...91cd4b815c13 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-01 12:38:17
|
Branch: refs/heads/easymock-5.4.0 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-01 08:44:17
|
Branch: refs/tags/3.8.0 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-01 08:44:16
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: e9b60404a68ba82ec8a5eadcde6d05c7f7798071 https://github.com/internetarchive/heritrix3/commit/e9b60404a68ba82ec8a5eadcde6d05c7f7798071 Author: Alex Osborne <aos...@nl...> Date: 2025-04-01 (Tue, 01 Apr 2025) Changed paths: M commons/pom.xml M contrib/pom.xml M dist/pom.xml M engine/pom.xml M modules/pom.xml M pom.xml Log Message: ----------- [maven-release-plugin] prepare for next development iteration To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-04-01 08:44:10
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 2323e2251e93f404bf66cfc99980c8b18f9a41be https://github.com/internetarchive/heritrix3/commit/2323e2251e93f404bf66cfc99980c8b18f9a41be Author: Alex Osborne <aos...@nl...> Date: 2025-04-01 (Tue, 01 Apr 2025) Changed paths: M commons/pom.xml M contrib/pom.xml M dist/pom.xml M engine/pom.xml M modules/pom.xml M pom.xml Log Message: ----------- [maven-release-plugin] prepare release 3.8.0 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
45 messages has been excluded from this view by a project administrator.
