Xavier,
This is a great development! Dependency handling systems for HPC application deployment, like Spack, have made for some pretty deep and complex modulefile trees as of late.
May I suggest a name change for the feature, though, if it isn't already committed?
I ask because the term "cookie" could be misunderstood, as it has connotations with communication protocols, notably HTTP. Following convention, a more grokable name for the feature would be "[file ]magic" or "[file ]signature" – see https://en.wikipedia.org/wiki/List_of_file_signatures . The page even includes "#%Module" in its list of examples.
Best wishes,
--
Michael Sternberg, Ph.D., Principal Scientific Computing Administrator
Center for Nanoscale Materials, Argonne National Laboratory
On Jan 14, 2022, at 00:43, Xavier Delaruelle <xav...@gm...> wrote:
Hello All,
Modules 5.1 work is ongoing. A new configuration option, mcookie_check, is introduced to skip the verification of each file in modulepath directories to determine if they are modulefiles or not. When this option is set to `eval`, file checks only occur when an attempt is made to evaluate these files, not when listing available modules. So if you fully control what files are saved under the modulepath directories you could get a nice speed improvement, especially for commands like 'module avail':
https://modules.readthedocs.io/en/latest/MIGRATING.html#reducing-number-of-i-o-operations
A full cookbook recipe is also available to describe the features of Modules that help to reduce the I/O load of walking through the available modulefiles:
https://modules.readthedocs.io/en/latest/cookbook/reduce-io-load.html#reduce-io-load
Regards,
Xavier
|