|
From: Singh, Puneet-2 (E. v. lists.hpsf.i. <pun...@li...> - 2026-01-06 11:51:06
|
Thank you for the update @Xavier Delaruelle<mailto:xav...@gm...> and happy new year. Could you please let us know the tentative release date for module version 5.7.0? Regards, Puneet From: Xavier Delaruelle <xav...@gm...> Sent: 06 January 2026 12:54 To: mod...@li... Subject: Re: [Modules] tcl module load slowness debug Dear All, I wish you a very happy new year 🎉 To kick off the year, I am pleased to share that recent work on Modules has significantly improved performance when evaluating large numbers of modulefiles. You can find all the details at the following ZjQcmQRYFpfptBannerStart This Message Is From an Untrusted Sender You have not previously corresponded with this sender. ZjQcmQRYFpfptBannerEnd Dear All, I wish you a very happy new year 🎉 To kick off the year, I am pleased to share that recent work on Modules has significantly improved performance when evaluating large numbers of modulefiles. You can find all the details at the following link: https://modules.readthedocs.io/en/latest/MIGRATING.html#improving-evaluation-performances This work will be part of next version (5.7.0) and is already available in the "main" git branch. We encourage you to review this update, especially if you’ve experienced slower module evaluations in the past or are planning upgrades. Best regards, Xavier Le lun. 8 déc. 2025 à 06:17, Xavier Delaruelle via lists.hpsf.io<https://urldefense.com/v3/__http:/lists.hpsf.io__;!!N3hqHg43uw!sZc6bjVVBmiDCOwdjqRoLts70ywqqLzfu67vV23yN0HIphd9qYcsk59x08nD0qVY4tgj6Vc4HaSb3arUEqpwEjme9keIEltNiFewbA$> <xav...@li...<mailto:gma...@li...>> a écrit : I have made some tests with a module tree generated by EasyBuild. Loading `R-bundle-Bioconductor/3.19-foss-2023b-R-4.4.1` module, that requires 136 additional modules, takes 1000ms on my local laptop (modulefiles stored on SSD). I have added this test setup into the "mb" command (Modules make bench utility) to track the performance of such module load over time. I have created an issue to work on this topic and improve the performance. Will try to get a 2x but I foresee that it will not be easy. https://github.com/envmodules/modules/issues/603<https://urldefense.com/v3/__https:/github.com/envmodules/modules/issues/603__;!!N3hqHg43uw!sZc6bjVVBmiDCOwdjqRoLts70ywqqLzfu67vV23yN0HIphd9qYcsk59x08nD0qVY4tgj6Vc4HaSb3arUEqpwEjme9keIElta6fShaQ$> When playing with my test setup, I have found that if the Tcl modulefiles are not generated for "EnvironmentModules" module tool, or generated by a version of EasyBuild prior 5.0, it takes 3000ms to load `R-bundle-Bioconductor` and its dependencies. This is due to the extensive use of "is-loaded" tests in these modulefiles. So if your modulefiles contains an "is-loaded" test prior each "module load" command, I strongly suggest to regenerate all these modulefiles to benefit from an immediate 3x improvement. Cheers, Xavier -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#6): https://lists.hpsf.io/g/modules-interest/message/6 Mute This Topic: https://lists.hpsf.io/mt/116608462/10150481 Group Owner: mod...@li... Unsubscribe: https://lists.hpsf.io/g/modules-interest/unsub [mod...@li...] -=-=-=-=-=-=-=-=-=-=-=- |
