[Lxr-dev] [ lxr-Bugs-465131 ] Incremental update is slow

[<no...@so...>]

Bugs item #465131, was opened at 2001-09-26 02:26
You can respond by visiting: 
http://sourceforge.net/tracker/?func=detail&atid=390117&aid=465131&group_id=27350

Category: genxref
Group: current cvs
Status: Open
Resolution: None
Priority: 8
Submitted By: Malcolm Box (mbox)
Assigned to: Malcolm Box (mbox)
Summary: Incremental update is slow

Initial Comment:
Running an incremental update of the indexes is
painfully slow (using File.pm & Mysql.pm).

At least part of the cause is that for my repository,
it takes 1.62 seconds to return the status of a file
(ie whether this file needs indexing/referencing). 
Since there are more than 100,000 files in the
repository, this database access alone consumes
100000*2*1.62 seconds = 90 hours.

The fix is to create an index on the filename field of
the files table.  Mysql won't let me create one on
(filename,revision) because this is too large, but the
(filename) index reduces the time for the above query
to 0.02s (which appears to be mainly overhead).

The line to add to the end of initdb-mysql is:

create index filelookup on files (filename);

Presumably the other db backends would also benefit
from this.

----------------------------------------------------------------------

You can respond by visiting: 
http://sourceforge.net/tracker/?func=detail&atid=390117&aid=465131&group_id=27350