Should be possible to set a size limit on fetches

Brought to you by: sxw

#11 Should be possible to set a size limit on fetches

Status: open

Owner: nobody

Labels: harvest-ng (30)

Priority: 5

Updated: 2000-02-21

Created: 2000-02-18

Creator: Simon Wilkinson

Private: No

Discussion

Simon Wilkinson - 2000-02-18

To continue ...

The old Harvest placed a limit on the \"maximum\" size of
a file that it would download - this allows some sanity
checking of data, and prevents bad servers from filling up
a database, or breaking the gatherer run.

LWP supports this through a max_size argument to the
UserAgent object, so it should be fairly easy to implement.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Simon Wilkinson - 2000-02-21

labels: 100100 --> harvest-ng
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Log in to post a comment.