Run the tests of mtime (and 'make -V...' if needed) in parallel subprocesses, probably, a process per port category.
When done, concider closing issue [#10] and removing what is added for it.
An implementation using 'multyprocessig' module committed in [r108].
Full scan of the ports tree on a notebook with 4-core i7 processor is about 25 min, roughly half of the original 50 min before slitting the tree by categories, with Python 3.7. Verifiing that the cache is new is about 1 minute.
Python2.7 is 2 to 4 times slowlier.
Currently, the pool size is hardcoded as cpu_count() + 1, a switch for setting it might be useful.
Needs changes to docs.
An implementation using 'multyprocessig' module committed in [r108].
Full scan of the ports tree on a notebook with 4-core i7 processor is about 25 min, roughly half of the original 50 min before slitting the tree by categories, with Python 3.7. Verifiing that the cache is new is about 1 minute.
Python2.7 is 2 to 4 times slowlier.
Currently, the pool size is hardcoded as cpu_count() + 1, a switch for setting it might be useful.
Needs changes to docs.
Related
Commit: [r108]