[htdig-dev] profiling

[Greg L. <gr...@md...>]

	I am willing to enable profiling on my recent install of the 12/9 build of 
3.2 beta 4 to figure out some bottlenecks.  I just need to know how and 
what to look for in the results.  I have 10 or so collections ranging from 
200 - 500,000 documents.  I tried to search the site but the search has 
been down for a couple of days (Internal Server Error).   The system specs 
are: RedHat 7.2,  dual 1GHz processors, 1GB of RAM, 5 18GB SCSI hard 
drives, four are RAID 5 (with /opt/ on that partition).  If you guys can 
tell me how to re-compile and what to look for I can do it.  My initial 
digs (over an NFS mount) were taking from 8-10 times as long as 3.1.3.

	Features Requests:
	1.  When running htdig with the -s flag, it would be nice to see the 
number of documents indexed (I know it appears at the end of the dig, but 
it would be nice to have it here as well).
	2.  The statistics give no results when using local file access, at least 
the speed could be displayed.
	3.  When using local file access, there should be a message when htdig has 
to use http instead, and then the summaries should be displayed.

	My rough re-design of the site is still available at:
http://rhobard.com/htdig/
I still like it....


Gregory Lepore
Webmaster, State of Maryland
Supervisor, Archives of Maryland Online
410-260-6425