Share

Heritrix: Internet Archive Web Crawler

Tracker: Bugs

9 Non-default 'logs' location doesn't show in web UI - ID: 1058565
Last Update: Comment added ( karl-ia )

On one of the NARA crawls, using a non-default 'logs'
location to better spread disk IO over independent
disks, the 'logs' pages of the web UI don't show
anything. The logs are fine on disk. It's likely that
the UI isn't properly consulting the configured location.


Gordon Mohr ( gojomo ) - 2004-11-02 02:57

9

Closed

Fixed

Michael Stack

Usability/UI

None

Public


Comments ( 6 )

Date: 2007-03-14 00:17
Sender: karl-ia


This issue is now discussed in the new JIRA tracker at
http://webteam.archive.org/jira/browse/HER-276 -- please add further
comments at that location.


Date: 2004-11-03 23:30
Sender: stack-sfProject Admin

Logged In: YES
user_id=924942

Commit message below. Includes fix for the case Gordon just
found where a path relative to the disk dir is specified.

Fix for '[ 1058565 ] Non-default 'logs' location doesn't
show in web UI'.
* src/webapps/admin/logs.jsp
The logging directory can be an absolute path, a path
relative to the
data directory or an unspecified path (The default).
Only the latter used
work when logs were accessed from the UI. This commit
makes it so logs
will be found if any of the above three locations.



Date: 2004-11-03 23:00
Sender: gojomoProject Admin

Logged In: YES
user_id=144912

Patch works well for case where 'logs' setting is absolute
path. However, in testing, I discovered another case which
is a problem both pre- and post- patch, if a 'disk' setting
(usually blank) is used.

Motivation of 'disk' setting is: if present, 'disk'
specifies a place, either absolute or relative to job dir,
for all other paths to be resolved against. See
CrawlController.getSettingsDir() for implementation.

Unfortunately no version of logs.jsp has considered 'disk'
setting. On the bright side, this setting is rarely used.
Looks like a true fix would involve duplicating the logic of
CrawlController.getSettingsDir() to logs.jsp (ugh!) or to
utility methods in CrawlJob(Handler) or SettingsHandler.
True fix can probably be deferred.

Proposed patch is OK for original test case (absolute 'logs'
setting), but ultimate fix would ideally handle 'disk' too
and without any more code (and possibly less) in logs.jsp.
Feel free to commit patch for 1.2 and leave issue open at
lower priority for later, or see if there's a clean way to
tackle 'disk' as well.


Date: 2004-11-03 20:23
Sender: stack-sfProject Admin

Logged In: YES
user_id=924942

Assigning to gordon for review. Assign back when done.


Date: 2004-11-02 20:47
Sender: stack-sfProject Admin

Logged In: YES
user_id=924942

Retry attachiment of patch.


Date: 2004-11-02 20:46
Sender: stack-sfProject Admin

Logged In: YES
user_id=924942

Here's a fix attached.


Attached File ( 1 )

Filename Description Download
diff.patch Retry Download

Changes ( 8 )

Field Old Value Date By
close_date - 2004-11-03 23:30 stack-sf
resolution_id None 2004-11-03 23:30 stack-sf
status_id Open 2004-11-03 23:30 stack-sf
assigned_to gojomo 2004-11-03 23:00 gojomo
assigned_to stack-sf 2004-11-03 20:23 stack-sf
priority 6 2004-11-03 19:09 gojomo
File Added 107403: diff.patch 2004-11-02 20:47 stack-sf
assigned_to nobody 2004-11-02 20:46 stack-sf