Re: [htdig] indexing php-files

[Stephan H. <sh...@gm...>]

Hello Gabriele and other helpers,

At Tue, 24 Feb 2004 14:54:15 +0100 Gabriele Bartolini wrote:

> Hi Stephan,
> 
> Il ven, 2004-02-20 alle 19:08, Stephan Holl ha scritto:
> > Dear htdig-gurus,
> > 
> > My site has a global php-script (e.g. index.php), which includes
> > .inc-files containing the contents of the page depending of the
> > given URL-arguments.
> > Is it possible to set up search-function for this kind of
> > web-site-architecture which should repeat a link like this:
> > 	http://example.com/index.php?id=384634&no=453727&whatever=foo ?!
> 
> Yep, absolutely. As long as you produce HTML documents (content type
> is text/html) and URLs are not rejected according to your limits
> settings(i.e. limit_urls_to, exclude_urls, etc.).
> 
> Remember, the spider acts exactly the way a normal user agent does:
> this means the contents it will get is the same you can see by looking
> at the source code with your normal browser (explorer, mozilla, etc.).
> 

Realising the htdig acts like a spider my site gets indexed fine now!

Thank you for your helpful suggestions.

cheers

  Stephan

-- 
Stephan Holl

Check headers for GnuPG Key!
http://www.gdf-hannover.de

 18:33:48 up  1:53,  1 user,  load average: 0.51, 0.59, 0.43