Heritrix: Internet Archive Web Crawler

Tracker: Bugs

8 unwritable ARCs directory barely noticeable - ID: 1108153

Last Update: Comment added ( karl-ia )

Details:

Started a crawl, specifying an ARC-writing directory
that I didn't realize the crawler process had no write
access to. Checking crawl, all looked well, collected
140GB over 2 days... then noticed disk not filling. The
only place any error due to no ARCs being written
appears is in the local-errors log. It needs to be much
more prominent -- at least an 'Alert'.

Submitted:

Gordon Mohr ( gojomo ) - 2005-01-24 06:28

Priority:

Status:

Closed

Resolution:

Fixed

Assigned:

Nobody/Anonymous

Category:

None

Group:

None

Visibility:

Public

Comments ( 2 )

Date: 2007-03-14 00:20 Sender: karl-ia This issue is now discussed in the new JIRA tracker at http://webteam.archive.org/jira/browse/HER-344 -- please add further comments at that location.
Date: 2005-02-15 03:06 Sender: stack-sf Logged In: YES user_id=924942 Fixed. Commit below. Closing. Fix for '[ 1108153 ] unwritable ARCs directory barely noticeable' * src/java/org/archive/crawler/writer/ARCWriterProcessor.java Add a UI alert if trouble writing an ARC Record. * src/java/org/archive/io/arc/ARCWriter.java Fix NPE that happens if we can't find directory to write to.

Attached File

Changes ( 3 )

Field	Old Value	Date	By
status_id	Open	2005-02-15 03:06	stack-sf
resolution_id	None	2005-02-15 03:06	stack-sf
close_date	-	2005-02-15 03:06	stack-sf

Heritrix: Internet Archive Web Crawler

Tracker: Bugs

Comments ( 2 )

Attached File

No Files Currently Attached

Changes ( 3 )

About SourceForge

Find Software

Develop Software

Community

Help