Re[2]: [htdig] How to avoid reindexing files already indexed

[Jonathan B. B. <jb...@ba...>]

Hello olinux,

Thanks.  All the pages I'm indexing are static HTML, and will never
change.


Sunday, March 28, 2004, 4:48:19 PM, you wrote:

o> --- Jim wrote:
>> On Mon, 22 Mar 2004, Jonathan B. Bayer wrote:
>> 
>> > HTdig is indexing several directories on my
>> system.  Some of these
>> > directories have over 100,000 documents.  A few
>> get added each day.
>> > 
>> > Right now htdig reindexes all the documents each
>> night.  Is it possible
>> > to have it ignore documents that it has already
>> indexed?
>> 
>> How are you running htdig? Typically unless you
>> provide a -i to

This is the command I am using:

/var/htdig/bin/rundig -a -s -c /var/htdig/conf/htdig.conf



>> htdig it tries to perform just an update. The rundig
>> script uses
>> the -i option by default, so you might want to look
>> at editing
>> that script if you are using it for your digs.
>> 
>> Jim


o> If you are using 3.2.0b5 then read this thread. Gilles
o>  presents a useful workaround for feeding URLs via
o> STDIN
o> http://sourceforge.net/mailarchive/forum.php?thread_id=3457663&forum_id=2688

I am using that version, and will look at this thread later today,
thanks.


o> I use this in my content management system to index a
o> new article when it is published. URLs are immediately
o> searchable - very cool. 

o> Josh




JBB
-- 
Best regards,
 Jonathan                            mailto:jb...@ba...