Heritrix: Internet Archive Web Crawler

Tracker: Feature Requests

5 [jmx] Regularize crawl end state messages - ID: 1371202

Last Update: Comment added ( karl-ia )

Details:

Make it so archive-it can always find in the crawlend
state a dependable pattern -- e.g. All crawl end
messages -- start with "CRAWLENDED" -- so can identify
a crawlend message when it comes tripping by. Currently
crawl end messages don't have common pattern so have to
match against all currently known possible ending messages.

Submitted:

Michael Stack ( stack-sf ) - 2005-12-01 20:53

Priority:

Status:

Closed

Resolution:

None

Assigned:

Michael Stack

Category:

API

Group:

1.8.0

Visibility:

Public

Comments ( 2 )

Date: 2007-03-14 01:45 Sender: karl-ia This issue is now discussed in the new JIRA tracker at http://webteam.archive.org/jira/browse/HER-985 -- please add further comments at that location.
Date: 2005-12-06 01:54 Sender: stack-sf Logged In: YES user_id=924942 Make them all begin 'Finish'. Done as part of below commit. Closing. Fix for '[ 1371195 ] [jmx] Make downloaded data count have constant units'. Implement '[ 1371202 ] [jmx] Regularize crawl end state messages'. * src/java/org/archive/crawler/admin/CrawlJob.java Made it so all crawl finished state messges begin with 'Finished'. Changed format of stats returned so Longs, Integers and Doubles and so they are not formatted for display in UI but are raw data. * src/java/org/archive/crawler/admin/StatisticsTracker.java Make single line of two. * src/java/org/archive/crawler/framework/AbstractTracker.java Formatting.

Date: 2007-03-14 01:45
Sender: karl-ia

This issue is now discussed in the new JIRA tracker at
http://webteam.archive.org/jira/browse/HER-985 -- please add further
comments at that location.

Date: 2005-12-06 01:54
Sender: stack-sf

Logged In: YES
user_id=924942

Make them all begin 'Finish'. Done as part of below commit.
Closing.

Fix for '[ 1371195 ] [jmx] Make downloaded data count have
constant units'.
Implement '[ 1371202 ] [jmx] Regularize crawl end state
messages'.
* src/java/org/archive/crawler/admin/CrawlJob.java
Made it so all crawl finished state messges begin with
'Finished'.
Changed format of stats returned so Longs, Integers and
Doubles and so they
are not formatted for display in UI but are raw data.
* src/java/org/archive/crawler/admin/StatisticsTracker.java
Make single line of two.
* src/java/org/archive/crawler/framework/AbstractTracker.java
Formatting.

Attached File

Changes ( 3 )

Field	Old Value	Date	By
status_id	Open	2005-12-06 01:54	stack-sf
artifact_group_id	None	2005-12-06 01:54	stack-sf
close_date	-	2005-12-06 01:54	stack-sf

Heritrix: Internet Archive Web Crawler

Tracker: Feature Requests

Comments ( 2 )

Attached File

No Files Currently Attached

Changes ( 3 )

About SourceForge

Find Software

Develop Software

Community

Help