Re: [htdig] Problem in Local digging htdig 3.1.6

[Tim C. <cl...@de...>]

It looks to me as if autoindexing is not turned on in Apache.  Htdig 
follows links, it doesn't just look at files in folders.  Links either 
need to be  provided  by the website itself (e.g., via an index page 
(which it didn't seem to find) or by using autoindexing,  which is 
fairly straightforward to turn on in Apache.

On Oct 15, 2004, at 10:52 AM, Lahiri, Pallab (Cognizant) wrote:

>
> I'm newbie to htdig. I would like the be able to just specify a 
> directory and have it recurse through looking
> at every valid file type and index it.
> I'm trying to dig local files using a start_url and local_url.
>
> relevant attrbs. in my htdig.conf are :
>
> start_url:   http://10.xx.xx.xx/
> local_urls_only: true
> local_urls: http://10.xx.xx.xx/=/opt/nwa/pallab/
> local_user_urls: http://10.xx.xx.xx/=/opt/nwa/pallab/
> limit_urls_to: ${start_url} /opt/nwa/pallab/
>
> When I do
> # ./htdig -vvv
>         1:1:http://10.xx.xx.xx/
> New server: 10.xx.xx.xx, 80
> Trying local files
>   tried local file /opt/nwa/pallab/robots.txt
>  pushed
> pick: 10.xx.xx.xx, # servers = 1
> 0:1:0:http://10.xx.xx.xx/: Trying local files
>   tried local file /opt/nwa/pallab/index.html
>  not found
> pick: 10.xx.xx.xx, 36.# servers = 1
>
> Please help.
>
> Thanks,
> pallab
>
> This e-mail and any files transmitted with it are for the sole use of 
> the intended recipient(s) and may contain confidential and privileged 
> information.
> If you are not the intended recipient, please contact the sender by 
> reply e-mail and destroy all copies of the original message.
> Any unauthorised review, use, disclosure, dissemination, forwarding, 
> printing or copying of this email or any action taken in reliance on 
> this e-mail is strictly
> prohibited and may be unlawful.
>
>   Visit us at http://www.cognizant.com
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by: IT Product Guide on 
> ITManagersJournal
> Use IT products in your business? Tell us what you think of them. Give 
> us
> Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out 
> more
> http://productguide.itmanagersjournal.com/guidepromo.tmpl
> _______________________________________________
> ht://Dig general mailing list: <htd...@li...>
> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
> List information (subscribe/unsubscribe, etc.)
> https://lists.sourceforge.net/lists/listinfo/htdig-general
>
>

Tim Cleary
Manager
Dean & Company
(703) 760-4375
cl...@de...