Re: [htdig-dev] Massive Memory consumption of htnotify..

[Jim C. <li...@yg...>]

On Friday, July 11, 2003, at 07:26 AM, Robert Ribnitz wrote:

> I am just letting you guys know that htnotify might contain a memory  
> leak, leading to it using huge amounts of memory, and even aborting  
> due to lack of memory.
>
> At the moment I dont know where to look for the problem, so help would  
> be appreciated.

There is a know issue with htnotify involving the manner in which it  
opens some streams. Up to this point, I don't recall anyone reporting  
the resulting problem as affecting Linux, but it has caused problems  
under both Solaris and OS X. I think the fact that it has not thus far  
affected other platforms is more an accident than anything else, so  
maybe something has changed that now makes your platform susceptible.  
The problem is discussed in the following thread.

http://www.geocrawler.com/mail/thread.php3?subject=%5Bhtdig- 
dev%5D+OS+X+10.2&list=8825

You might try specifying the htnotify_prefix_file and  
htnotify_suffix_file and creating the corresponding text files. If that  
eliminates the problem you are encountering, then most likely the bug  
described above is at the root of the problem.

There is a patch that partially corrects the problem; however it  
neglects to treat one special case and ignores entirely another section  
of the code that is susceptible to the same sort of problem. When I get  
a chance, I will take a stab at putting together a more complete patch.

Jim