From: Francis H. <fr...@rh...> - 2003-12-12 20:34:55
|
Another question: Is there any way to change the behavior of the spider based on what pages change more quickly? Let's say I wanted to spider my site once an hour but only index a few pages that change all the time, and then do a weekly spider of the entire site, would htdig let me do that? Thanks, Francis |