[htdig-dev] [Task #87781] htdig Spidering

[SourceForge.net <no...@so...>]

Task #87781 has been updated. 

Project: ht://Dig
Subproject: Testing 3.2
Summary: htdig Spidering
Complete: 0%
Status: Open
Authority  : nealr
Assigned to: nobody

Description: Use the documenation to test each one of these config verbs

# spidering

max_hop_count

start_url

robotstxt_name(1)

check_unique_date(1)

check_unique_md5

md5_db

limit_normalized

limit_urls_to

exclude_urls

bad_querystr

url_rewrite_rules

url_part_aliases

local_urls

local_urls_only

local_user_urls

valid_extensions

bad_extensions

bad_local_extensions



-------------------------------------------------------
For more info, visit:

http://sourceforge.net/pm/task.php?func=detailtask&project_task_id=87781&group_id=4593&group_project_id=32485