Menu
▾
▴
archive-crawler-cvs — cvs commits
You can subscribe to this list here.
| 2003 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
(2) |
Sep
(50) |
Oct
(197) |
Nov
(305) |
Dec
(295) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2004 |
Jan
(429) |
Feb
(694) |
Mar
(443) |
Apr
(479) |
May
(357) |
Jun
(74) |
Jul
(218) |
Aug
(162) |
Sep
(156) |
Oct
(340) |
Nov
(132) |
Dec
(224) |
| 2005 |
Jan
(170) |
Feb
(122) |
Mar
(265) |
Apr
(215) |
May
(139) |
Jun
(247) |
Jul
(179) |
Aug
(116) |
Sep
(103) |
Oct
(125) |
Nov
(97) |
Dec
(221) |
| 2006 |
Jan
(132) |
Feb
(18) |
Mar
(23) |
Apr
(35) |
May
(71) |
Jun
(268) |
Jul
(220) |
Aug
(376) |
Sep
(181) |
Oct
(71) |
Nov
(131) |
Dec
(172) |
| 2007 |
Jan
(125) |
Feb
(79) |
Mar
(90) |
Apr
(76) |
May
(91) |
Jun
(64) |
Jul
(113) |
Aug
(96) |
Sep
(40) |
Oct
(30) |
Nov
(85) |
Dec
(56) |
| 2008 |
Jan
(37) |
Feb
(79) |
Mar
(22) |
Apr
(6) |
May
(13) |
Jun
(22) |
Jul
(83) |
Aug
(50) |
Sep
(8) |
Oct
(32) |
Nov
(55) |
Dec
(28) |
| 2009 |
Jan
(15) |
Feb
(30) |
Mar
(28) |
Apr
(69) |
May
(82) |
Jun
(19) |
Jul
(64) |
Aug
(71) |
Sep
(53) |
Oct
(84) |
Nov
(105) |
Dec
(40) |
| 2010 |
Jan
(11) |
Feb
(19) |
Mar
(24) |
Apr
(58) |
May
(15) |
Jun
(35) |
Jul
(14) |
Aug
(13) |
Sep
(31) |
Oct
(15) |
Nov
(39) |
Dec
(10) |
| 2011 |
Jan
(59) |
Feb
(32) |
Mar
(10) |
Apr
(37) |
May
(20) |
Jun
(21) |
Jul
(39) |
Aug
(9) |
Sep
(31) |
Oct
(29) |
Nov
(3) |
Dec
(1) |
| 2012 |
Jan
(7) |
Feb
(4) |
Mar
(5) |
Apr
(12) |
May
(5) |
Jun
(8) |
Jul
(9) |
Aug
(6) |
Sep
(15) |
Oct
(1) |
Nov
(3) |
Dec
(9) |
| 2013 |
Jan
(9) |
Feb
(2) |
Mar
(41) |
Apr
(13) |
May
(9) |
Jun
(20) |
Jul
(5) |
Aug
(22) |
Sep
(5) |
Oct
(3) |
Nov
(13) |
Dec
(8) |
| 2014 |
Jan
(27) |
Feb
(16) |
Mar
(7) |
Apr
(14) |
May
(10) |
Jun
(2) |
Jul
(16) |
Aug
(6) |
Sep
(6) |
Oct
(11) |
Nov
(7) |
Dec
|
| 2015 |
Jan
|
Feb
(7) |
Mar
(4) |
Apr
|
May
(2) |
Jun
|
Jul
|
Aug
(2) |
Sep
(2) |
Oct
(5) |
Nov
(1) |
Dec
|
| 2016 |
Jan
(15) |
Feb
(5) |
Mar
(4) |
Apr
(1) |
May
(7) |
Jun
(16) |
Jul
(6) |
Aug
(2) |
Sep
|
Oct
(1) |
Nov
|
Dec
|
| 2017 |
Jan
|
Feb
(1) |
Mar
(3) |
Apr
|
May
(4) |
Jun
(25) |
Jul
|
Aug
|
Sep
(4) |
Oct
(11) |
Nov
(9) |
Dec
(1) |
| 2018 |
Jan
(2) |
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
|
Jul
(10) |
Aug
|
Sep
(1) |
Oct
(2) |
Nov
(12) |
Dec
(4) |
| 2019 |
Jan
(3) |
Feb
(21) |
Mar
(17) |
Apr
(13) |
May
(6) |
Jun
(4) |
Jul
|
Aug
(65) |
Sep
|
Oct
(4) |
Nov
(7) |
Dec
|
| 2020 |
Jan
(23) |
Feb
(6) |
Mar
(14) |
Apr
(25) |
May
(11) |
Jun
(9) |
Jul
(7) |
Aug
(7) |
Sep
(1) |
Oct
(4) |
Nov
(4) |
Dec
|
| 2021 |
Jan
(8) |
Feb
(11) |
Mar
(1) |
Apr
(6) |
May
(30) |
Jun
(60) |
Jul
(43) |
Aug
(23) |
Sep
(16) |
Oct
|
Nov
(7) |
Dec
(13) |
| 2022 |
Jan
(7) |
Feb
(2) |
Mar
(17) |
Apr
(16) |
May
(9) |
Jun
(2) |
Jul
(18) |
Aug
|
Sep
(3) |
Oct
(1) |
Nov
(2) |
Dec
|
| 2023 |
Jan
(7) |
Feb
|
Mar
(11) |
Apr
|
May
(1) |
Jun
|
Jul
|
Aug
|
Sep
(7) |
Oct
(5) |
Nov
(2) |
Dec
|
| 2024 |
Jan
|
Feb
(4) |
Mar
(8) |
Apr
(5) |
May
(5) |
Jun
(12) |
Jul
(2) |
Aug
(12) |
Sep
(25) |
Oct
(47) |
Nov
(46) |
Dec
(3) |
| 2025 |
Jan
(6) |
Feb
(14) |
Mar
(8) |
Apr
(23) |
May
(34) |
Jun
(44) |
Jul
(8) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Alex O. <no...@gi...> - 2025-02-03 05:09:22
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 8cf3e476d1a9f628388cec82f2e507af8a0fa12e https://github.com/internetarchive/heritrix3/commit/8cf3e476d1a9f628388cec82f2e507af8a0fa12e Author: Alex Osborne <aos...@nl...> Date: 2025-02-03 (Mon, 03 Feb 2025) Changed paths: M CHANGELOG.md M modules/pom.xml Log Message: ----------- Bump ftpserver-core from 1.2.0 to 1.2.1 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-02-03 05:06:24
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: ed02038e8b8752c743e564126880508c41946a67 https://github.com/internetarchive/heritrix3/commit/ed02038e8b8752c743e564126880508c41946a67 Author: Alex Osborne <aos...@nl...> Date: 2025-02-03 (Mon, 03 Feb 2025) Changed paths: M CHANGELOG.md Log Message: ----------- Update CHANGELOG for 3.7.0 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-02-03 03:02:56
|
Branch: refs/heads/update-deps-for-3.7 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-02-03 03:02:49
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: bd5927252e373d29e84bb18607b4dfec03254592 https://github.com/internetarchive/heritrix3/commit/bd5927252e373d29e84bb18607b4dfec03254592 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M contrib/pom.xml Log Message: ----------- Bump amqp-client from 5.23.0 to 5.24.0 Commit: f844b968b9213f76936f06feeb34a56133de09b3 https://github.com/internetarchive/heritrix3/commit/f844b968b9213f76936f06feeb34a56133de09b3 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M engine/pom.xml Log Message: ----------- Bump restlet from 2.5.0-rc1 to 2.5.0 Commit: 1041fc67ed08dc0e380afe9daa332dedd95622ee https://github.com/internetarchive/heritrix3/commit/1041fc67ed08dc0e380afe9daa332dedd95622ee Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M engine/pom.xml Log Message: ----------- Bump freemarker from 2.3.33 to 2.3.34 Commit: 9b0d4033dcfefa1650cce119434208f1a555cc93 https://github.com/internetarchive/heritrix3/commit/9b0d4033dcfefa1650cce119434208f1a555cc93 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M pom.xml Log Message: ----------- Bump jetty from 9.4.56.v20240826 to 9.4.57.v20241219 Commit: c8cedef792863f772cf21e4fbf00fd04b5586433 https://github.com/internetarchive/heritrix3/commit/c8cedef792863f772cf21e4fbf00fd04b5586433 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump jsch from 0.2.21 to 0.2.22 Commit: c54684279f6b0686cc75ffee45ff8a55d0883654 https://github.com/internetarchive/heritrix3/commit/c54684279f6b0686cc75ffee45ff8a55d0883654 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-codec from 1.17.1 to 1.17.2 Commit: 3c5074da394e267700dc712bb63cc9d51c99753c https://github.com/internetarchive/heritrix3/commit/3c5074da394e267700dc712bb63cc9d51c99753c Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump spring from 6.1.15 to 6.1.16 Commit: 48ac7484f0da62815a6e4830e22bf5fe759c4727 https://github.com/internetarchive/heritrix3/commit/48ac7484f0da62815a6e4830e22bf5fe759c4727 Author: Alex Osborne <aos...@nl...> Date: 2025-02-03 (Mon, 03 Feb 2025) Changed paths: M commons/pom.xml M contrib/pom.xml M engine/pom.xml M pom.xml Log Message: ----------- Merge pull request #639 from internetarchive/update-deps-for-3.7 Update dependencies for 3.7.0 release Compare: https://github.com/internetarchive/heritrix3/compare/42e4151bc6e6...48ac7484f0da To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-02-03 03:02:28
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: cd3f3f9e098d12e54880b76036fd3aa6c21834b1 https://github.com/internetarchive/heritrix3/commit/cd3f3f9e098d12e54880b76036fd3aa6c21834b1 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M dist/src/main/conf/logging.properties Log Message: ----------- Suppress 'WARNING Cookie rejected' messages in job.log These log messages started unhelpfully being copied into job.log in 3.6.0 due to the slf4j fix. They indicate the server sent a set-cookie header with an incorrect domain. It's correct for Heritrix to reject them. They're very common and not an indication of a problem with Heritrix itself so it's unnecessarily alarming to log them as job warnings. Fixes: 533d762db53e ("Include slf4j-jdk14 in heritrix-engine ...") Commit: 42e4151bc6e6e32b7db64ba34c6c4283746d738f https://github.com/internetarchive/heritrix3/commit/42e4151bc6e6e32b7db64ba34c6c4283746d738f Author: Alex Osborne <aos...@nl...> Date: 2025-02-03 (Mon, 03 Feb 2025) Changed paths: M dist/src/main/conf/logging.properties Log Message: ----------- Merge pull request #640 from internetarchive/suppress-cookie-rejected-logging Suppress 'WARNING Cookie rejected' messages in job.log Compare: https://github.com/internetarchive/heritrix3/compare/a4c98e4d27c9...42e4151bc6e6 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-02-03 03:02:28
|
Branch: refs/heads/suppress-cookie-rejected-logging Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-01-23 13:12:55
|
Branch: refs/heads/suppress-cookie-rejected-logging Home: https://github.com/internetarchive/heritrix3 Commit: cd3f3f9e098d12e54880b76036fd3aa6c21834b1 https://github.com/internetarchive/heritrix3/commit/cd3f3f9e098d12e54880b76036fd3aa6c21834b1 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M dist/src/main/conf/logging.properties Log Message: ----------- Suppress 'WARNING Cookie rejected' messages in job.log These log messages started unhelpfully being copied into job.log in 3.6.0 due to the slf4j fix. They indicate the server sent a set-cookie header with an incorrect domain. It's correct for Heritrix to reject them. They're very common and not an indication of a problem with Heritrix itself so it's unnecessarily alarming to log them as job warnings. Fixes: 533d762db53e ("Include slf4j-jdk14 in heritrix-engine ...") To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-01-23 12:33:52
|
Branch: refs/heads/update-deps-for-3.7 Home: https://github.com/internetarchive/heritrix3 Commit: bd5927252e373d29e84bb18607b4dfec03254592 https://github.com/internetarchive/heritrix3/commit/bd5927252e373d29e84bb18607b4dfec03254592 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M contrib/pom.xml Log Message: ----------- Bump amqp-client from 5.23.0 to 5.24.0 Commit: f844b968b9213f76936f06feeb34a56133de09b3 https://github.com/internetarchive/heritrix3/commit/f844b968b9213f76936f06feeb34a56133de09b3 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M engine/pom.xml Log Message: ----------- Bump restlet from 2.5.0-rc1 to 2.5.0 Commit: 1041fc67ed08dc0e380afe9daa332dedd95622ee https://github.com/internetarchive/heritrix3/commit/1041fc67ed08dc0e380afe9daa332dedd95622ee Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M engine/pom.xml Log Message: ----------- Bump freemarker from 2.3.33 to 2.3.34 Commit: 9b0d4033dcfefa1650cce119434208f1a555cc93 https://github.com/internetarchive/heritrix3/commit/9b0d4033dcfefa1650cce119434208f1a555cc93 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M pom.xml Log Message: ----------- Bump jetty from 9.4.56.v20240826 to 9.4.57.v20241219 Commit: c8cedef792863f772cf21e4fbf00fd04b5586433 https://github.com/internetarchive/heritrix3/commit/c8cedef792863f772cf21e4fbf00fd04b5586433 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump jsch from 0.2.21 to 0.2.22 Commit: c54684279f6b0686cc75ffee45ff8a55d0883654 https://github.com/internetarchive/heritrix3/commit/c54684279f6b0686cc75ffee45ff8a55d0883654 Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-codec from 1.17.1 to 1.17.2 Commit: 3c5074da394e267700dc712bb63cc9d51c99753c https://github.com/internetarchive/heritrix3/commit/3c5074da394e267700dc712bb63cc9d51c99753c Author: Alex Osborne <aos...@nl...> Date: 2025-01-23 (Thu, 23 Jan 2025) Changed paths: M commons/pom.xml Log Message: ----------- Bump spring from 6.1.15 to 6.1.16 Compare: https://github.com/internetarchive/heritrix3/compare/bd5927252e37%5E...3c5074da394e To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-01-22 03:21:12
|
Branch: refs/heads/rel-nofollow Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-01-22 03:21:09
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 4e8bda1a0757de7fd46485f0c94f8eadb241e1ec https://github.com/internetarchive/heritrix3/commit/4e8bda1a0757de7fd46485f0c94f8eadb241e1ec Author: Alex Osborne <aos...@nl...> Date: 2025-01-13 (Mon, 13 Jan 2025) Changed paths: M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.cxml M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy M modules/src/main/java/org/archive/modules/extractor/ExtractorHTML.java M modules/src/main/java/org/archive/modules/extractor/JerichoExtractorHTML.java M modules/src/test/java/org/archive/modules/extractor/ExtractorHTMLTest.java Log Message: ----------- ExtractorHTML: Add obeyRelNofollow option When enabled this option causes regular links annotated with rel=nofollow to not be extracted. This is useful for sites that use rel=nofollow to hint crawler traps. Commit: a4c98e4d27c97a8f2927b4cec30d03e3d72f5195 https://github.com/internetarchive/heritrix3/commit/a4c98e4d27c97a8f2927b4cec30d03e3d72f5195 Author: Alex Osborne <aos...@nl...> Date: 2025-01-22 (Wed, 22 Jan 2025) Changed paths: M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.cxml M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy M modules/src/main/java/org/archive/modules/extractor/ExtractorHTML.java M modules/src/main/java/org/archive/modules/extractor/JerichoExtractorHTML.java M modules/src/test/java/org/archive/modules/extractor/ExtractorHTMLTest.java Log Message: ----------- Merge pull request #638 from internetarchive/rel-nofollow ExtractorHTML: Add obeyRelNofollow option Compare: https://github.com/internetarchive/heritrix3/compare/4c4510a36485...a4c98e4d27c9 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-01-13 06:40:36
|
Branch: refs/heads/rel-nofollow Home: https://github.com/internetarchive/heritrix3 Commit: 4e8bda1a0757de7fd46485f0c94f8eadb241e1ec https://github.com/internetarchive/heritrix3/commit/4e8bda1a0757de7fd46485f0c94f8eadb241e1ec Author: Alex Osborne <aos...@nl...> Date: 2025-01-13 (Mon, 13 Jan 2025) Changed paths: M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.cxml M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy M modules/src/main/java/org/archive/modules/extractor/ExtractorHTML.java M modules/src/main/java/org/archive/modules/extractor/JerichoExtractorHTML.java M modules/src/test/java/org/archive/modules/extractor/ExtractorHTMLTest.java Log Message: ----------- ExtractorHTML: Add obeyRelNofollow option When enabled this option causes regular links annotated with rel=nofollow to not be extracted. This is useful for sites that use rel=nofollow to hint crawler traps. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2025-01-13 06:26:42
|
Branch: refs/heads/rel-nofollow Home: https://github.com/internetarchive/heritrix3 Commit: 46fc1ab085a186ebbbee580f3bc7f1e78f06b294 https://github.com/internetarchive/heritrix3/commit/46fc1ab085a186ebbbee580f3bc7f1e78f06b294 Author: Alex Osborne <aos...@nl...> Date: 2025-01-13 (Mon, 13 Jan 2025) Changed paths: M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.cxml M engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy M modules/src/main/java/org/archive/modules/extractor/ExtractorHTML.java M modules/src/test/java/org/archive/modules/extractor/ExtractorHTMLTest.java Log Message: ----------- ExtractorHTML: Add obeyRelNofollow option When enabled this option causes regular links annotated with rel=nofollow to not be extracted. This is useful for sites that use rel=nofollow to hint crawler traps. To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-12-24 03:12:12
|
Branch: refs/heads/groovy-config Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-12-24 03:12:08
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 19c24b90060877e71225f30c98e3dfbd33866c7b https://github.com/internetarchive/heritrix3/commit/19c24b90060877e71225f30c98e3dfbd33866c7b Author: Alex Osborne <aos...@nl...> Date: 2024-12-01 (Sun, 01 Dec 2024) Changed paths: M commons/pom.xml M commons/src/main/java/org/archive/spring/PathSharingContext.java A commons/src/test/java/org/archive/spring/PathSharingContextTest.java A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.cxml A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.groovy M engine/src/main/java/org/archive/crawler/framework/CrawlJob.java M engine/src/main/java/org/archive/crawler/framework/Engine.java A engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy A engine/src/test/java/org/archive/crawler/restlet/ProfileCrawlerBeansTest.java M modules/pom.xml M pom.xml Log Message: ----------- Add Groovy crawl configs This enables crawl configuration files to use Spring's [Groovy Bean Definition DSL] as an optional alternative to Spring XML. It uses the same bean configuration model but the syntax is more terse and human-readable. No more need for `&` in seed URLs. :-) ```groovy checkpointService(CheckpointService) { checkpointIntervalMinutes = 15 checkpointsDir = 'checkpoints' forgetAllButLatest = true } ``` It also enables some powerful scripting capabilities. For example, defining a custom DecideRule directly in the crawl scope: ```groovy scope(DecideRuleSequence) { rules = [ new RejectDecideRule(), // ACCEPT everything linked from a .pdf file new PredicatedDecideRule() { boolean evaluate(CrawlURI uri) { return uri.via?.path?.endsWith(".pdf") } }, // ... ] } ``` The main downsides are defining nested inner beans can be a bit awkward, some of the errors can be cryptic, and you can't just manipulate the config files with an XML parser. This commit includes a Groovy version of the default crawl profile for reference, but doesn't expose a way to use it in the UI yet. For now, you need to manually create a `crawler-beans.groovy` file in your job directory. [Groovy Bean Definition DSL]: https://docs.spring.io/spring-framework/reference/core/beans/basics.html#beans-factory-groovy Commit: 4c4510a36485b748b1afbadfafc5de3698dfaa5f https://github.com/internetarchive/heritrix3/commit/4c4510a36485b748b1afbadfafc5de3698dfaa5f Author: Alex Osborne <aos...@nl...> Date: 2024-12-24 (Tue, 24 Dec 2024) Changed paths: M commons/pom.xml M commons/src/main/java/org/archive/spring/PathSharingContext.java A commons/src/test/java/org/archive/spring/PathSharingContextTest.java A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.cxml A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.groovy M engine/src/main/java/org/archive/crawler/framework/CrawlJob.java M engine/src/main/java/org/archive/crawler/framework/Engine.java A engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy A engine/src/test/java/org/archive/crawler/restlet/ProfileCrawlerBeansTest.java M modules/pom.xml M pom.xml Log Message: ----------- Merge pull request #632 from internetarchive/groovy-config Add Groovy crawl configs Compare: https://github.com/internetarchive/heritrix3/compare/bfa8692d3b82...4c4510a36485 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-12-20 05:47:52
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: d13acddfc4ba15af85792c537169f3fe9ed1f334 https://github.com/internetarchive/heritrix3/commit/d13acddfc4ba15af85792c537169f3fe9ed1f334 Author: Alex Osborne <aos...@nl...> Date: 2024-12-20 (Fri, 20 Dec 2024) Changed paths: M commons/src/main/java/org/archive/io/CrawlerJournal.java M engine/src/main/java/org/archive/crawler/util/DiskFPMergeUriUniqFilter.java M engine/src/main/java/org/archive/crawler/util/FPMergeUriUniqFilter.java M engine/src/main/java/org/archive/crawler/util/MemFPMergeUriUniqFilter.java M modules/src/main/java/org/archive/modules/writer/Kw3WriterProcessor.java Log Message: ----------- Remove usages of fastutil fastutil is our largest dependency, consuming about a third of the total Heritrix distribution size but we only use a couple of trivial classes from it. FPMergeUriUniqFilter (which I'm not sure anyone uses anyway), uses LongArrayList so this change replaces it with a basic version that does just enough. The unsynchronized FastBufferedOutputStream usages are likely unnecessary these days thanks to the JVM's lock optimisations and for the one in CrawlerJournal, the GZIPOutputStream is still going to be synchronizing anyway. Commit: bfa8692d3b824087165a0dcc680d09f6f6fe0c38 https://github.com/internetarchive/heritrix3/commit/bfa8692d3b824087165a0dcc680d09f6f6fe0c38 Author: Alex Osborne <aos...@nl...> Date: 2024-12-20 (Fri, 20 Dec 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump webarchive-commons from 1.2.0 to 1.3.0 Compare: https://github.com/internetarchive/heritrix3/compare/2b2179d9c7d2...bfa8692d3b82 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-30 15:15:31
|
Branch: refs/heads/groovy-config Home: https://github.com/internetarchive/heritrix3 Commit: 19c24b90060877e71225f30c98e3dfbd33866c7b https://github.com/internetarchive/heritrix3/commit/19c24b90060877e71225f30c98e3dfbd33866c7b Author: Alex Osborne <aos...@nl...> Date: 2024-12-01 (Sun, 01 Dec 2024) Changed paths: M commons/pom.xml M commons/src/main/java/org/archive/spring/PathSharingContext.java A commons/src/test/java/org/archive/spring/PathSharingContextTest.java A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.cxml A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.groovy M engine/src/main/java/org/archive/crawler/framework/CrawlJob.java M engine/src/main/java/org/archive/crawler/framework/Engine.java A engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy A engine/src/test/java/org/archive/crawler/restlet/ProfileCrawlerBeansTest.java M modules/pom.xml M pom.xml Log Message: ----------- Add Groovy crawl configs This enables crawl configuration files to use Spring's [Groovy Bean Definition DSL] as an optional alternative to Spring XML. It uses the same bean configuration model but the syntax is more terse and human-readable. No more need for `&` in seed URLs. :-) ```groovy checkpointService(CheckpointService) { checkpointIntervalMinutes = 15 checkpointsDir = 'checkpoints' forgetAllButLatest = true } ``` It also enables some powerful scripting capabilities. For example, defining a custom DecideRule directly in the crawl scope: ```groovy scope(DecideRuleSequence) { rules = [ new RejectDecideRule(), // ACCEPT everything linked from a .pdf file new PredicatedDecideRule() { boolean evaluate(CrawlURI uri) { return uri.via?.path?.endsWith(".pdf") } }, // ... ] } ``` The main downsides are defining nested inner beans can be a bit awkward, some of the errors can be cryptic, and you can't just manipulate the config files with an XML parser. This commit includes a Groovy version of the default crawl profile for reference, but doesn't expose a way to use it in the UI yet. For now, you need to manually create a `crawler-beans.groovy` file in your job directory. [Groovy Bean Definition DSL]: https://docs.spring.io/spring-framework/reference/core/beans/basics.html#beans-factory-groovy To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-30 15:13:51
|
Branch: refs/heads/groovy-config Home: https://github.com/internetarchive/heritrix3 Commit: 7a57afad45f382c86bca804c63ac3836a7e018c7 https://github.com/internetarchive/heritrix3/commit/7a57afad45f382c86bca804c63ac3836a7e018c7 Author: Alex Osborne <aos...@nl...> Date: 2024-12-01 (Sun, 01 Dec 2024) Changed paths: M commons/pom.xml M commons/src/main/java/org/archive/spring/PathSharingContext.java A commons/src/test/java/org/archive/spring/PathSharingContextTest.java A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.cxml A commons/src/test/resources/org/archive/spring/PathSharingContextTestBeans.groovy M engine/src/main/java/org/archive/crawler/framework/CrawlJob.java M engine/src/main/java/org/archive/crawler/framework/Engine.java A engine/src/main/resources/org/archive/crawler/restlet/profile-crawler-beans.groovy A engine/src/test/java/org/archive/crawler/restlet/ProfileCrawlerBeansTest.java M modules/pom.xml M pom.xml Log Message: ----------- Add Groovy crawl configs This enables crawl configuration files to use Spring's [Groovy Bean Definition DSL] as an optional alternative to Spring XML. It uses the same bean configuration model but the syntax is more terse and human-readable. No more need for `&` in seed URLs. :-) ```groovy checkpointService(CheckpointService) { checkpointIntervalMinutes = 15 checkpointsDir = 'checkpoints' forgetAllButLatest = true } ``` It also enables some powerful scripting capabilities. For example, defining a custom DecideRule directly in the crawl scope: ```groovy scope(DecideRuleSequence) { rules = [ new RejectDecideRule(), // ACCEPT everything linked from a .pdf file new PredicatedDecideRule() { boolean evaluate(CrawlURI uri) { return uri.via?.path?.endsWith(".pdf") } }, // ... ] } ``` The main downsides are defining nested inner beans can be a bit awkward, some of the errors can be cryptic, and you can't just manipulate the config files with an XML parser. This commit includes a Groovy version of the default crawl profile for reference, but doesn't expose a way to use it in the UI yet. For now, you need to manually create a `crawler-beans.groovy` file in your job directory. [Groovy Bean Definition DSL]: https://docs.spring.io/spring-framework/reference/core/beans/basics.html#beans-factory-groovy To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 12:07:34
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 2b2179d9c7d2d59e7383ab3eadd9809912c98a07 https://github.com/internetarchive/heritrix3/commit/2b2179d9c7d2d59e7383ab3eadd9809912c98a07 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml M contrib/pom.xml M dist/pom.xml M engine/pom.xml M modules/pom.xml M pom.xml Log Message: ----------- Update pom.xml for 3.6.1-SNAPSHOT To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 12:01:44
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: be81b3a4079f729195f8098d2c484d67120641f0 https://github.com/internetarchive/heritrix3/commit/be81b3a4079f729195f8098d2c484d67120641f0 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml M contrib/pom.xml M dist/pom.xml M engine/pom.xml M modules/pom.xml M pom.xml Log Message: ----------- Update maven release plugins for Java compat To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 12:01:42
|
Branch: refs/tags/3.6.0 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 11:54:49
|
Branch: refs/tags/3.6.0 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 11:47:01
|
Branch: refs/tags/3.6.0 Home: https://github.com/internetarchive/heritrix3 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 11:46:57
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: 2d903ae772fd87a615e873b4c73dd307faa2383d https://github.com/internetarchive/heritrix3/commit/2d903ae772fd87a615e873b4c73dd307faa2383d Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml M contrib/pom.xml M dist/pom.xml M engine/pom.xml M modules/pom.xml M pom.xml Log Message: ----------- [maven-release-plugin] prepare release 3.6.0 Commit: c67ff98b2d8045768900b444b9258969947fc120 https://github.com/internetarchive/heritrix3/commit/c67ff98b2d8045768900b444b9258969947fc120 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml M contrib/pom.xml M dist/pom.xml M engine/pom.xml M modules/pom.xml M pom.xml Log Message: ----------- [maven-release-plugin] prepare for next development iteration Compare: https://github.com/internetarchive/heritrix3/compare/dd3616ea0796...c67ff98b2d80 To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 11:28:42
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: dd3616ea0796ccea9610d9ec18f4b1fc5d57e6fa https://github.com/internetarchive/heritrix3/commit/dd3616ea0796ccea9610d9ec18f4b1fc5d57e6fa Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M CHANGELOG.md Log Message: ----------- Update CHANGELOG for 3.6.0 release To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
|
From: Alex O. <no...@gi...> - 2024-11-29 10:25:01
|
Branch: refs/heads/master Home: https://github.com/internetarchive/heritrix3 Commit: a93761d0d5e1a29984587ea8c5e4b5929909c433 https://github.com/internetarchive/heritrix3/commit/a93761d0d5e1a29984587ea8c5e4b5929909c433 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M modules/pom.xml Log Message: ----------- Bump pdfbox from 3.0.1 to 3.0.3 Commit: 4fde0945e446937b518d58dd4cf3c0b722aed87d https://github.com/internetarchive/heritrix3/commit/4fde0945e446937b518d58dd4cf3c0b722aed87d Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump kryo from 5.6.0 to 5.6.2 Commit: da67120347f1c183fff43ce96c3b7d22bae08e15 https://github.com/internetarchive/heritrix3/commit/da67120347f1c183fff43ce96c3b7d22bae08e15 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-net from 3.9.0 to 3.11.1 Commit: d5fbb5ab89c3d8f7d99e824d96b27a15b72347d9 https://github.com/internetarchive/heritrix3/commit/d5fbb5ab89c3d8f7d99e824d96b27a15b72347d9 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-codec from 1.6 to 1.17.1 Commit: fdab1d7e0557d811e5feeed54c90b44816f17a97 https://github.com/internetarchive/heritrix3/commit/fdab1d7e0557d811e5feeed54c90b44816f17a97 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump dnsjava from 3.6.0 to 3.6.2 Commit: 631620c92be3aa76555e9c876969566a043a1d59 https://github.com/internetarchive/heritrix3/commit/631620c92be3aa76555e9c876969566a043a1d59 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M modules/pom.xml Log Message: ----------- Bump groovy from 4.0.21 to 4.0.24 Commit: 3ac2cedc8e1278084d48f7a09f08aee278c792a4 https://github.com/internetarchive/heritrix3/commit/3ac2cedc8e1278084d48f7a09f08aee278c792a4 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M pom.xml Log Message: ----------- Bump junit from 4.13.1 to 4.13.2 Commit: 4391f039a2ff41f984ac94521adf7419bf90d58e https://github.com/internetarchive/heritrix3/commit/4391f039a2ff41f984ac94521adf7419bf90d58e Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M pom.xml Log Message: ----------- Bump httpcomponents from 4.5.13 to 4.5.14 Commit: 9a4e3c37e8f327080b2cd19bbc24049e8cb9a038 https://github.com/internetarchive/heritrix3/commit/9a4e3c37e8f327080b2cd19bbc24049e8cb9a038 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M contrib/pom.xml Log Message: ----------- Remove redundant pdfbox dependency declaration from heritrix-contrib It's already pulled in via heritrix-modules, so we don't need to declare it again here. Commit: faf26adbb52dc1ef0ab50212ef09a4847af8c7a4 https://github.com/internetarchive/heritrix3/commit/faf26adbb52dc1ef0ab50212ef09a4847af8c7a4 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml M modules/pom.xml Log Message: ----------- Bump jsch from 0.1.54 (jcraft) to 0.2.21 (mwiede fork) The original project has been unmaintained since 2018 and doesn't support the algorithms to connect to current versions of openssh. Commit: add3ef58f7aea36bf1582ad56b2e99f085144877 https://github.com/internetarchive/heritrix3/commit/add3ef58f7aea36bf1582ad56b2e99f085144877 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-io from 2.14.0 to 2.18.0 Commit: ec7b03446cbe5feb0beb9f94f401925e5e4e66fe https://github.com/internetarchive/heritrix3/commit/ec7b03446cbe5feb0beb9f94f401925e5e4e66fe Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump commons-cli from 1.1 to 1.9.0 Commit: 577874752714c6bd8c89f7afd5544adef3e527e8 https://github.com/internetarchive/heritrix3/commit/577874752714c6bd8c89f7afd5544adef3e527e8 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M modules/pom.xml Log Message: ----------- Bump crawler-commons from 1.0 to 1.4 Commit: 6ff95c1bed42a183628c2237d66108ea2e5abd89 https://github.com/internetarchive/heritrix3/commit/6ff95c1bed42a183628c2237d66108ea2e5abd89 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M contrib/pom.xml Log Message: ----------- Remove redundant commons-codec dependency declaration from contrib Commit: 6a498014f3610e83cb7e1337887ba45f89d11a79 https://github.com/internetarchive/heritrix3/commit/6a498014f3610e83cb7e1337887ba45f89d11a79 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M contrib/pom.xml Log Message: ----------- Bump gson from 2.8.9 to 2.11.0 Commit: dceaa8517efda87bdb3758cc5fb0dafa232e7654 https://github.com/internetarchive/heritrix3/commit/dceaa8517efda87bdb3758cc5fb0dafa232e7654 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M contrib/pom.xml Log Message: ----------- Bump rabbitmq amqp-client from 5.18.0 to 5.23.0 Commit: ea0b4611ca69b1489b4271aee2d7ebc297a87e50 https://github.com/internetarchive/heritrix3/commit/ea0b4611ca69b1489b4271aee2d7ebc297a87e50 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M contrib/pom.xml Log Message: ----------- Bump kafka-clients from 3.8.0 to 3.9.0 Commit: 9c799fdfad1d5c95a6bb34506397a9ae4763dd1e https://github.com/internetarchive/heritrix3/commit/9c799fdfad1d5c95a6bb34506397a9ae4763dd1e Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M contrib/pom.xml Log Message: ----------- Remove unused java-websocket dependency Commit: d5b4391cce28f8e612670847664e353d0eda785f https://github.com/internetarchive/heritrix3/commit/d5b4391cce28f8e612670847664e353d0eda785f Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M modules/pom.xml M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java Log Message: ----------- Bump java-socks-proxy-server from 1.1.0 to 4.1.2 Commit: 1ef2a52a6151ca9c2addaea8218e6bdd7062b453 https://github.com/internetarchive/heritrix3/commit/1ef2a52a6151ca9c2addaea8218e6bdd7062b453 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M contrib/pom.xml Log Message: ----------- Bump easymock from 3.1 to 5.5.0 Commit: bd5fc39d9cc31f9f26fa23d9f2f64e0dca4a9b95 https://github.com/internetarchive/heritrix3/commit/bd5fc39d9cc31f9f26fa23d9f2f64e0dca4a9b95 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml M contrib/src/main/java/org/archive/modules/recrawl/FetchHistoryHelper.java M contrib/src/main/java/org/archive/modules/recrawl/wbm/WbmPersistLoadProcessor.java Log Message: ----------- Remove direct dependency on commons-logging The rest of Heritrix uses Java logging. It still gets pulled in transitively but at least we don't need to manage the version directly. Commit: 0a215f646763afca57c96759441c7cd6e3464ba7 https://github.com/internetarchive/heritrix3/commit/0a215f646763afca57c96759441c7cd6e3464ba7 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M engine/pom.xml M engine/src/main/java/org/archive/crawler/restlet/XmlMarshaller.java M engine/src/main/java/org/archive/crawler/restlet/models/ScriptModel.java M engine/src/test/java/org/archive/crawler/restlet/XmlMarshallerTest.java Log Message: ----------- Bump jaxb-runtime from 2.3.1 to 4.0.5 Commit: 6b1047385ec09e81db38f52aee3bdd45c6486e00 https://github.com/internetarchive/heritrix3/commit/6b1047385ec09e81db38f52aee3bdd45c6486e00 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml Log Message: ----------- Bump webarchive-commons from 1.1.10 to 1.2.0 Commit: 3fbf1bc8c09f4436167a8e99205fa779d06638f5 https://github.com/internetarchive/heritrix3/commit/3fbf1bc8c09f4436167a8e99205fa779d06638f5 Author: Alex Osborne <aos...@nl...> Date: 2024-11-29 (Fri, 29 Nov 2024) Changed paths: M commons/pom.xml M contrib/pom.xml M contrib/src/main/java/org/archive/modules/recrawl/FetchHistoryHelper.java M contrib/src/main/java/org/archive/modules/recrawl/wbm/WbmPersistLoadProcessor.java M engine/pom.xml M engine/src/main/java/org/archive/crawler/restlet/XmlMarshaller.java M engine/src/main/java/org/archive/crawler/restlet/models/ScriptModel.java M engine/src/test/java/org/archive/crawler/restlet/XmlMarshallerTest.java M modules/pom.xml M modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java M pom.xml Log Message: ----------- Merge pull request #631 from internetarchive/update-deps Update dependencies for 3.6.0 release Compare: https://github.com/internetarchive/heritrix3/compare/1195bed1a173...3fbf1bc8c09f To unsubscribe from these emails, change your notification settings at https://github.com/internetarchive/heritrix3/settings/notifications |
45 messages has been excluded from this view by a project administrator.
