Re: [htdig] Using an external fetcher

[Anuradha R. <ARa...@vi...>]

On Sat, 2004-04-03 at 11:51, Martin Allert wrote:
> 
> On Fri, Apr 02, 2004 at 11:19:42AM -0500, Anuradha Ratnaweera wrote:
> >
> > I am trying to index a web site which runs IIS with NTLM
> > authentication and I managed to download and replicate that site
> > using cURL.
> 
> If you managed to mirror this site, you took curl with user/pass
> authentication, I guess. So IIS generated usual HTML files...  If this
> is your problem, try modifiying the rundig script and look for the
> htdig command line
> 
> htdig -i...
> 
> and change it to
> 
> htdig  -u username:password -i ...

Thaks for the prompt replies.

Unfortunately, the authentication type is NTLM (not BASIC).  And htdig
doesn't support NTLM.

I managed to workaround the problem by doing the download using CURL,
and running a server using that tree with the same name as the original.

Howerver, we are still looking for a "better" solution.  Most likely,
modifying the source to support an external downloader would be the best
alternative.  Will give it a try anytime soon :-)

	Anuradha

-- 

http://www.linux.lk/~anuradha/