modules-interest — Discussion forum for modules usage.

Re: [Modules] Using "Environment Modules" in a SLURM script

[<Xav...@CE...>]

Hi,

On Tue, 2021-02-02 at 12:24 +0100, Frank Thommen wrote:
> Hi,
> 
> On 02.02.21 11:40, Gestió Servidors wrote:
> > Hi,
> > 
> > After configuring “Environment Modules”, I have to declare
> > explicitly a 
> > “source /path/to/my/installation/modules/folder/init/bash” in my
> > SLURM 
> > script. I have read a possible solution could be BASH_ENV
> > environment 
> > variable, but after doing some test, I haven’t got any good
> > result. 
> > Could you help me?
> > 
> > Thanks.
> 
> you can set $BASH_ENV to a file which will be sourced at start of
> a 
> non-interactive, non-login shell (which your shell in the SLURM
> job 
> probably is).  You will have to somehow pass this environment
> variable 
> to your SLURM job.  SLURM's submission command most probably has
> an 
> appropriate option.

The option "--export" of SLURM [1] enables to propagate the
environment variables defined at the time of the job submission to
the launched application.

It is also important to ensure that Environment Modules is correctly
installed on all the cluster nodes and that all modulefiles are also
available on these nodes.

Regards,
Xavier

[1] https://slurm.schedmd.com/sbatch.html

Re: [Modules] Using "Environment Modules" in a SLURM script

[Frank T. <f.t...@dk...>]

Hi,

On 02.02.21 11:40, Gestió Servidors wrote:
> Hi,
> 
> After configuring “Environment Modules”, I have to declare explicitly a 
> “source /path/to/my/installation/modules/folder/init/bash” in my SLURM 
> script. I have read a possible solution could be BASH_ENV environment 
> variable, but after doing some test, I haven’t got any good result. 
> Could you help me?
> 
> Thanks.

you can set $BASH_ENV to a file which will be sourced at start of a 
non-interactive, non-login shell (which your shell in the SLURM job 
probably is).  You will have to somehow pass this environment variable 
to your SLURM job.  SLURM's submission command most probably has an 
appropriate option.

HTH, Frank

[Modules] Using "Environment Modules" in a SLURM script

[Gestió S. <sys...@ua...>]

Hi,

After configuring "Environment Modules", I have to declare explicitly a "source /path/to/my/installation/modules/folder/init/bash" in my SLURM script. I have read a possible solution could be BASH_ENV environment variable, but after doing some test, I haven't got any good result. Could you help me?

Thanks.

[Modules] Hiding loaded modules

[Xavier D. <xav...@gm...>]

Hello All,

On upcoming version of Modules (v4.7), the --hidden-loaded option will
be added to the module-hide modulefile command and it indicates that
designated hidden modules remain hidden after being loaded.

A demonstration of this new feature is available at:
https://modules.readthedocs.io/en/latest/MIGRATING.html#hiding-loaded-modules

Regards,
Xavier

[Modules] Module tags

[Xavier D. <xav...@gm...>]

Hello All,

In next feature release (v4.7), it will be possible to tag modules and view
the tags applying to them. Tags could be set specifically with `module-tag`
modulefile command or inherited from current module state or specific
action.

All details with small examples are available in documentation at

  https://modules.readthedocs.io/en/latest/MIGRATING.html#module-tags

Regards,
Xavier

Re: [Modules] conceptual question regarding startup/profile/LOADEDMODULES

[<Xav...@CE...>]

Hello,

Happy new year to everyone!

It seems quite unusual that /etc/profile script resets PATH. Is this
something specific to your installation or the default of your Unix
distribution (what OS and distribution are you using ?)

Best regards,
Xavier


On Mon, 2021-01-04 at 08:35 -0600, Paul FM via Modules-interest wrote:
> Make sure modules are loaded AFTER the PATH is reset (this should be
> automatic if you use a profile.d script to load the modules).
> Make sure new login methods do NOT inherit any of the module
> environment variables.
> 
> 
> My distro of Linux sets and uses $PROFILEREAD to avoid accidental
> overwrites of the PATH (in case user source /etc/profile at the wrong
> time).
> 
> Check yours for a similar variable,
> Then test that $PROFILEREAD  (or the variable your /etc/profile uses)
> is set before you initialize modules or load modules (or maybe just
> set it when you load them, depending on what your intention is).
> 
> 
> 
> --  On 1/4/2021 7:56 AM, Michael Krause wrote:
> > Hello,
> > 
> > I just migrated one of our larger systems and tripped over a weird
> > behavior that affected all of your users. Investigation left me
> > confused
> > because I had to disable something that appears to be a core
> > feature of
> > environment-modules:
> > 
> > When we start a new (login) shell, a tmux, or submit a batch job
> > the
> > following things happen:
> > 
> > 1. LOADEDMODULES environment variables is taken from surrounding
> > env
> > 2. /etc/profile resets PATH
> > 3. based on LOADEDMODULES, the module command thinks that some
> > modules
> > are loaded, when in fact they are not (because the PATH has been
> > reset)
> > 
> > I'm sure I am missing a concept here, but I don't know what. For
> > now I
> > just unset LOADEDMODULES in /etc/profile.d before module.sh but
> > this
> > feels.. wrong? Can anyone help me out?
> > 
> > best regards and a happy new year to everyone,
> > Michael Krause
> > 
> > 
> > _______________________________________________
> > Modules-interest mailing list
> > Mod...@li...
> > https://lists.sourceforge.net/lists/listinfo/modules-interest
> > 
> 
> 

Re: [Modules] conceptual question regarding startup/profile/LOADEDMODULES

[Paul FM <pa...@um...>]

Make sure modules are loaded AFTER the PATH is reset (this should be automatic if you use a profile.d script to load the modules).
Make sure new login methods do NOT inherit any of the module environment variables.


My distro of Linux sets and uses $PROFILEREAD to avoid accidental overwrites of the PATH (in case user source /etc/profile at the wrong time).

Check yours for a similar variable,
Then test that $PROFILEREAD  (or the variable your /etc/profile uses) is set before you initialize modules or load modules (or maybe just set it when you load them, depending on what your intention is).



--  On 1/4/2021 7:56 AM, Michael Krause wrote:
> Hello,
> 
> I just migrated one of our larger systems and tripped over a weird
> behavior that affected all of your users. Investigation left me confused
> because I had to disable something that appears to be a core feature of
> environment-modules:
> 
> When we start a new (login) shell, a tmux, or submit a batch job the
> following things happen:
> 
> 1. LOADEDMODULES environment variables is taken from surrounding env
> 2. /etc/profile resets PATH
> 3. based on LOADEDMODULES, the module command thinks that some modules
> are loaded, when in fact they are not (because the PATH has been reset)
> 
> I'm sure I am missing a concept here, but I don't know what. For now I
> just unset LOADEDMODULES in /etc/profile.d before module.sh but this
> feels.. wrong? Can anyone help me out?
> 
> best regards and a happy new year to everyone,
> Michael Krause
> 
> 
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest
> 

-- 
--------------------------------------------------------
The views and opinions expressed above are strictly
those of the author(s).  The content of this message has
not been reviewed nor approved by any entity whatsoever.
--------------------------------------------------------
Paul FM         Info: http://umn.edu/~paulfm/
--------------------------------------------------------

[Modules] conceptual question regarding startup/profile/LOADEDMODULES

[Michael K. <kr...@mp...>]

Hello,

I just migrated one of our larger systems and tripped over a weird
behavior that affected all of your users. Investigation left me confused
because I had to disable something that appears to be a core feature of
environment-modules:

When we start a new (login) shell, a tmux, or submit a batch job the
following things happen:

1. LOADEDMODULES environment variables is taken from surrounding env
2. /etc/profile resets PATH
3. based on LOADEDMODULES, the module command thinks that some modules
are loaded, when in fact they are not (because the PATH has been reset)

I'm sure I am missing a concept here, but I don't know what. For now I
just unset LOADEDMODULES in /etc/profile.d before module.sh but this
feels.. wrong? Can anyone help me out?

best regards and a happy new year to everyone,
Michael Krause

Re: [Modules] Specifying modules in a file?

[Paul FM <pa...@um...>]

The module and modulefile man pages are the primary man pages to look at.

I think that may be gone (however, you might want to look at the rc files listed in the man pages as an alternative method to do whatever you are trying to do).

The older (binary) versions had:

.moduleavailcache
.moduleavailcachedir

files in the top of each folder listed in $MODULEPATH

The older versions would scream if those files didn't exist (which is why I have 0 length files in our common modules folder - the old version would just enumerate like the current version if those files were empty).  There was some sort of date checking as well (if the date wasn't new enough on those files, it would enumerate and try to update them).





--  On 12/29/2020 12:34 PM, Frank Thommen wrote:
> 
> Dear all,
> 
> I seem to remember, that there is (or was) the possibility to specify the list of available modules in a textfile instead of letting `module` search through a directory hierarchy.  However I can't find an appropriate description in the documentation.  Is this feature still supported?  If yes, then I would appreciate if someone could hint me to the right webpage or manpage which documents this.
> 
> Thanks in advance
> Frank
> 
> 
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest

-- 
--------------------------------------------------------
The views and opinions expressed above are strictly
those of the author(s).  The content of this message has
not been reviewed nor approved by any entity whatsoever.
--------------------------------------------------------
Paul FM         Info: http://umn.edu/~paulfm/
--------------------------------------------------------

Re: [Modules] Specifying modules in a file?

[Xavier D. <xav...@gm...>]

Hello Frank,

What you describe could be possible with the use of the module-virtual
modulefile command [1] placed in a global rc file.

There is currently not a lot of document on such way to organize modules.
If you succeed with this approach it will be great to have your setup
described in a recipe for the cookbook [2]

Regards,
Xavier

[1]
https://modules.readthedocs.io/en/latest/modulefile.html#mfcmd-module-virtual
[2] https://modules.readthedocs.io/en/latest/cookbook.html

Le mar. 29 déc. 2020 à 20:01, Frank Thommen <f.t...@dk...>
a écrit :

>
> Dear all,
>
> I seem to remember, that there is (or was) the possibility to specify
> the list of available modules in a textfile instead of letting `module`
> search through a directory hierarchy.  However I can't find an
> appropriate description in the documentation.  Is this feature still
> supported?  If yes, then I would appreciate if someone could hint me to
> the right webpage or manpage which documents this.
>
> Thanks in advance
> Frank
>
>
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest
>

[Modules] Specifying modules in a file?

[Frank T. <f.t...@dk...>]

Dear all,

I seem to remember, that there is (or was) the possibility to specify 
the list of available modules in a textfile instead of letting `module` 
search through a directory hierarchy.  However I can't find an 
appropriate description in the documentation.  Is this feature still 
supported?  If yes, then I would appreciate if someone could hint me to 
the right webpage or manpage which documents this.

Thanks in advance
Frank

[Modules] Determining module implementation and version

[Xavier D. <xav...@gm...>]

Dear All,

New Modules variables are introduced to determine during the evaluation of
a modulefile or a modulerc what *module* implementation is currently in
use. The `ModuleTool` variable corresponds to the name of the *module*
implementation and is set to `Modules` for this project. The
`ModuleToolVersion` variable corresponds to the version number of the
implementation (e.g. `4.7.0`).

With these new variables it is possible to precisely know what *module*
command is in use then adapt modulefile code to handle a specific behavior
or leverage a new feature.

The modulefile command `versioncmp` is also introduced to provide a simple
way to compare two version strings and return if first version string is
less than, equal to or greater than second one.

    if {[info exists ModuleTool] && $ModuleTool eq {Modules}
        && [versioncmp $ModuleToolVersion 4.7] >= 0} {
        # here some code specific for Modules 4.7 and later versions
    }

The `ModuleTool` and `ModuleToolVersion` variables and the `versioncmp`
modulefile command are supported by the Lmod project [1] starting version
`8.4.8`.

This new feature is available in git repository and will be included in
next feature release (v4.7).

Regards,
Xavier

[1] https://github.com/TACC/Lmod/

Re: [Modules] Modules initialization at shell startup - Ubuntu

[Xavier D. <xav...@gm...>]

Hello Matic,

The configuration of your shell set in your account, should go through the
/etc/profile.d scripts to get the module function defined.

This point is usually achieved by sourcing /etc/bashrc script (which
evaluates /etc/profile.d/*.sh script) in your ~/.bashrc. As ~/.bashrc is
evaluated when connecting to your account with ssh.

Best,
Xavier


Le mer. 23 déc. 2020 à 20:01, Matic Kisovec <Mat...@ki...> a écrit :

> Dear all,
>
> I am having issues with Modules initialization at shell startup on Ubuntu
> 20.04.1 headless server. Modules are installed at the default location.
> I am only connecting over SSH.
>
> We wish to have the Modules available to all users. By following the
> installation instructions (Installing Modules on Unix>Configuration > 2.) I
> created the two symbolic links.
> Rebooted but  got 'command not found: module'. I tried using zsh and bash.
> Next I tried copying the profile.sh (and .csh) files to /etc/profile.d but
> the result was the same.
> I also edited the permissions to match those already in the profile.d
> folder.
>
> Am I missing something?
>
> Best,
> Matic
>
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest
>

[Modules] Modules initialization at shell startup - Ubuntu

[Matic K. <Mat...@ki...>]

Dear all,

I am having issues with Modules initialization at shell startup on Ubuntu 20.04.1 headless server. Modules are installed at the default location.
I am only connecting over SSH.

We wish to have the Modules available to all users. By following the installation instructions (Installing Modules on Unix>Configuration > 2.) I created the two symbolic links.
Rebooted but  got 'command not found: module'. I tried using zsh and bash.
Next I tried copying the profile.sh (and .csh) files to /etc/profile.d but the result was the same.
I also edited the permissions to match those already in the profile.d folder.

Am I missing something?

Best,
Matic

[Modules] Hide and forbid modules

[Xavier D. <xav...@gm...>]

Dear all,

If you are looking at how to give access to a software to a limited set of
users or how to provide some hints on the life cycle of your software
catalog, look at the Hide and forbid modules [1] recipe to learn how to
leverage the new module-hide and module-forbid commands for such use cases.

Regards,
Xavier

[1]
https://modules.readthedocs.io/en/stable/cookbook/hide-and-forbid-modules.html

[Modules] Modules 4.6.1 released

[Xavier D. <xav...@gm...>]

Hello All,

Modules 4.6.1 is out. This release brings a significant performance
improvement for the dynamic hiding/forbidding feature and several other
fixes.

The changes introduced in this bugfix release are detailed at:


https://timeline.noticeable.io/cbzeG7wTvAIqj21zbUmx/posts/modules-4-6-1-released

The list of all changes made in this new version are described in the NEWS
document. Details on the new features introduced in the 4.6 series are
provided in the MIGRATING document.

 http://modules.readthedocs.io/en/stable/MIGRATING.html
 http://modules.readthedocs.io/en/stable/NEWS.html

The tarball of this new version can be downloaded at:

 http://downloads.sourceforge.net/modules/modules-4.6.1.tar.gz

The zipball to install this new version on Windows platform can be
downloaded at:

 http://downloads.sourceforge.net/modules/modules-4.6.1-win.zip

If you encounter any issue, please let us know by creating a ticket on the
project bug tracker at:

 https://github.com/cea-hpc/modules/issues

Special thanks to all the people who reported issues.

Best regards,
Xavier

Re: [Modules] Fwd: enable Environment modules on Git bash in windows

[Contact <dv...@cr...>]

Hello,

Using modules through Git bash might request a specific tclsh version. 
In fact, Git bash emulates an Unix environment which implies that the 
default delimiter will : where it must be ; on Windows.
On my side, I solved the issue by recompiling tclsh with specific 
modification and I am now able to use modules from MS Dos, Cygwin and 
Git bash easily.

Regards,
Jacques

On 08/10/2020 09:19, Xav...@CE... wrote:
> Hello,
>
> So it seems that Windows Git Bash is running on MINGW.
>
> What you need to do is to install the requirements on this subsystem:
>
> tcl gcc autoconf make
>
> I do not know anything about Windows Git Bash, maybe someone on this
> mailing-list could help ? In any case, it seems some guidelines are
> available on google when searching for instance "git bash windows
> install gcc".
>
> Regards,
> Xavier
>
>
>
> On Thu, 2020-10-08 at 10:42 +0530, Mshruty srivastava wrote:
>>
>> --
>> Subject: Re: [Modules] enable Environment modules on Git bash in
>> windows
>> To: Environment Modules usage and discussion.
>> <mod...@li...>
>>
>>
>>
>> hello .. i  am new to this Modules  concept in Windows .  When i tried
>> the steps as mentioned by you, i am getting the below error:
>> image.png
>>
>> image.png
>>
>> image.png
>>
>>
>>
>> Please note i am trying to do this in Windows git bash . Could you
>> please reiterate the steps in detail.
>>
>>
>> Regards,
>> Shruty Srivastava
>>
>> On Wed, 7 Oct 2020 at 20:00, Xav...@CE...
>> <Xav...@ce...> wrote:
>>
>>          Hello,
>>          
>>          From what I found, Git bash runs through MSYS2. So you need to
>>          install
>>          the regular Modules dist ball and not the Windows-specific
>>          dist:
>>          
>>          https://sourceforge.net/projects/modules/files/Modules/modules-4.6.0/modules-4.6.0.tar.gz/download
>>          
>>          Once downloaded and unpacked on your git bash environment,
>>          ensure all
>>          the required dependencies are installed:
>>          
>>          $ pacman -S tcl gcc autoconf
>>          
>>          Build Modules:
>>          
>>          $ ./configure && make && make install
>>          
>>          Regards,
>>          Xavier
>>          
>>          
>>          On Wed, 2020-10-07 at 19:44 +0530, Mshruty srivastava wrote:
>>          > Hello .. i need to make environment
>>          > modules http://modules.sourceforge.net/ available on git
>>          bash in
>>          > windows .
>>          >
>>          > it's working using a normal cmd prompt, but i need to make
>>          it work
>>          > using Git bash terminal also. Currently i am getting "module
>>          command
>>          > not found"in git bash terminal . Could you please help me
>>          with the
>>          > steps to make modules available on git bash also. An early
>>          reply would
>>          > be highly appreciated.
>>          >
>>          >
>>          > _______________________________________________
>>          > Modules-interest mailing list
>>          > Mod...@li...
>>          >
>>          https://lists.sourceforge.net/lists/listinfo/modules-interest
>>          
>>          
>>          _______________________________________________
>>          Modules-interest mailing list
>>          Mod...@li...
>>          https://lists.sourceforge.net/lists/listinfo/modules-interest
>
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest

Re: [Modules] Fwd: enable Environment modules on Git bash in windows

[Contact <dv...@cr...>]

Hello,

Using modules through Git bash might request a specific tclsh version. 
In fact, Git bash emulates an Unix environment which implies that the 
default delimiter will : where it must be ; on Windows.
On my side, I solved the issue by recompiling tclsh with specific 
modification and I am now able to use modules from MS Dos, Cygwin and 
Git bash easily.

Regards,
Jacques


On 08/10/2020 09:19, Xav...@CE... wrote:
> Hello,
>
> So it seems that Windows Git Bash is running on MINGW.
>
> What you need to do is to install the requirements on this subsystem:
>
> tcl gcc autoconf make
>
> I do not know anything about Windows Git Bash, maybe someone on this
> mailing-list could help ? In any case, it seems some guidelines are
> available on google when searching for instance "git bash windows
> install gcc".
>
> Regards,
> Xavier
>
>
>
> On Thu, 2020-10-08 at 10:42 +0530, Mshruty srivastava wrote:
>>
>> --
>> Subject: Re: [Modules] enable Environment modules on Git bash in
>> windows
>> To: Environment Modules usage and discussion.
>> <mod...@li...>
>>
>>
>>
>> hello .. i  am new to this Modules  concept in Windows .  When i tried
>> the steps as mentioned by you, i am getting the below error:
>> image.png
>>
>> image.png
>>
>> image.png
>>
>>
>>
>> Please note i am trying to do this in Windows git bash . Could you
>> please reiterate the steps in detail.
>>
>>
>> Regards,
>> Shruty Srivastava
>>
>> On Wed, 7 Oct 2020 at 20:00, Xav...@CE...
>> <Xav...@ce...> wrote:
>>
>>          Hello,
>>          
>>          From what I found, Git bash runs through MSYS2. So you need to
>>          install
>>          the regular Modules dist ball and not the Windows-specific
>>          dist:
>>          
>>          https://sourceforge.net/projects/modules/files/Modules/modules-4.6.0/modules-4.6.0.tar.gz/download
>>          
>>          Once downloaded and unpacked on your git bash environment,
>>          ensure all
>>          the required dependencies are installed:
>>          
>>          $ pacman -S tcl gcc autoconf
>>          
>>          Build Modules:
>>          
>>          $ ./configure && make && make install
>>          
>>          Regards,
>>          Xavier
>>          
>>          
>>          On Wed, 2020-10-07 at 19:44 +0530, Mshruty srivastava wrote:
>>          > Hello .. i need to make environment
>>          > modules http://modules.sourceforge.net/ available on git
>>          bash in
>>          > windows .
>>          >
>>          > it's working using a normal cmd prompt, but i need to make
>>          it work
>>          > using Git bash terminal also. Currently i am getting "module
>>          command
>>          > not found"in git bash terminal . Could you please help me
>>          with the
>>          > steps to make modules available on git bash also. An early
>>          reply would
>>          > be highly appreciated.
>>          >
>>          >
>>          > _______________________________________________
>>          > Modules-interest mailing list
>>          > Mod...@li...
>>          >
>>          https://lists.sourceforge.net/lists/listinfo/modules-interest
>>          
>>          
>>          _______________________________________________
>>          Modules-interest mailing list
>>          Mod...@li...
>>          https://lists.sourceforge.net/lists/listinfo/modules-interest
>
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest

Re: [Modules] Fwd: enable Environment modules on Git bash in windows

[<Xav...@CE...>]

Hello,

So it seems that Windows Git Bash is running on MINGW.

What you need to do is to install the requirements on this subsystem:

tcl gcc autoconf make

I do not know anything about Windows Git Bash, maybe someone on this
mailing-list could help ? In any case, it seems some guidelines are
available on google when searching for instance "git bash windows
install gcc".

Regards,
Xavier



On Thu, 2020-10-08 at 10:42 +0530, Mshruty srivastava wrote:
> 
> 
> --
> Subject: Re: [Modules] enable Environment modules on Git bash in
> windows
> To: Environment Modules usage and discussion.
> <mod...@li...>
> 
> 
> 
> hello .. i  am new to this Modules  concept in Windows .  When i tried
> the steps as mentioned by you, i am getting the below error:
> image.png
> 
> image.png
> 
> image.png
> 
> 
> 
> Please note i am trying to do this in Windows git bash . Could you
> please reiterate the steps in detail.
> 
> 
> Regards,
> Shruty Srivastava
> 
> On Wed, 7 Oct 2020 at 20:00, Xav...@CE...
> <Xav...@ce...> wrote:
> 
>         Hello,
>         
>         From what I found, Git bash runs through MSYS2. So you need to
>         install
>         the regular Modules dist ball and not the Windows-specific
>         dist:
>         
>         https://sourceforge.net/projects/modules/files/Modules/modules-4.6.0/modules-4.6.0.tar.gz/download
>         
>         Once downloaded and unpacked on your git bash environment,
>         ensure all
>         the required dependencies are installed:
>         
>         $ pacman -S tcl gcc autoconf
>         
>         Build Modules:
>         
>         $ ./configure && make && make install
>         
>         Regards,
>         Xavier
>         
>         
>         On Wed, 2020-10-07 at 19:44 +0530, Mshruty srivastava wrote:
>         > Hello .. i need to make environment
>         > modules http://modules.sourceforge.net/ available on git
>         bash in
>         > windows .
>         > 
>         > it's working using a normal cmd prompt, but i need to make
>         it work
>         > using Git bash terminal also. Currently i am getting "module
>         command
>         > not found"in git bash terminal . Could you please help me
>         with the
>         > steps to make modules available on git bash also. An early
>         reply would
>         > be highly appreciated.
>         > 
>         > 
>         > _______________________________________________
>         > Modules-interest mailing list
>         > Mod...@li...
>         >
>         https://lists.sourceforge.net/lists/listinfo/modules-interest
>         
>         
>         _______________________________________________
>         Modules-interest mailing list
>         Mod...@li...
>         https://lists.sourceforge.net/lists/listinfo/modules-interest

Re: [Modules] enable Environment modules on Git bash in windows

[<Xav...@CE...>]

Hello,

From what I found, Git bash runs through MSYS2. So you need to install
the regular Modules dist ball and not the Windows-specific dist:

https://sourceforge.net/projects/modules/files/Modules/modules-4.6.0/modules-4.6.0.tar.gz/download

Once downloaded and unpacked on your git bash environment, ensure all
the required dependencies are installed:

$ pacman -S tcl gcc autoconf

Build Modules:

$ ./configure && make && make install

Regards,
Xavier


On Wed, 2020-10-07 at 19:44 +0530, Mshruty srivastava wrote:
> Hello .. i need to make environment
> modules http://modules.sourceforge.net/ available on git bash in
> windows .
> 
> it's working using a normal cmd prompt, but i need to make it work
> using Git bash terminal also. Currently i am getting "module command
> not found"in git bash terminal . Could you please help me with the
> steps to make modules available on git bash also. An early reply would
> be highly appreciated.
> 
> 
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest

[Modules] enable Environment modules on Git bash in windows

[Mshruty s. <shr...@gm...>]

Hello .. i need to make environment modules
http://modules.sourceforge.net/ available
on git bash in windows .

it's working using a normal cmd prompt, but i need to make it work using
Git bash terminal also. Currently i am getting "module command not found"in
git bash terminal . Could you please help me with the steps to make modules
available on git bash also. An early reply would be highly appreciated.

Re: [Modules] module apropos -- unexpected behavior and output

[Xavier D. <xav...@gm...>]

Hello,

The `apropos` sub-command evaluates all available modulefiles to find the
`module-whatis` commands they define. Errors occurring when evaluating
modulefiles are silenced.

Could you send me the full output of a `module apropos -D pytorch` run and
also the content of a modulefile outputting text like "No installation of
ZLIB (1.2.8) under"

Regards,
Xavier

Le lun. 21 sept. 2020 à 22:23, <be...@me...> a écrit :

> The command:
>
>         module apropos $STRING
>
> should show the "module-whatis" text from all modules where the module
> name or whatis line matches $STRING.
>
> With modules 4.1.2 and 4.5.3, the "module apropos" command seems to try
> to load ALL modules in $MODULESPATH, then produce the expected output.
>
> In our environment, the behavior of attempting to load each module results
> in a large number of warnings (modules that have been deprecated, software
> that's no longer installed or not available under the OS of the machine
> running "module apropos", dependency warnings, etc). Example below.
>
> ---------------------------------------------------------------------
> [bergman@login3 ~]$ module --version
>  Release 4.5.3 (2020-08-31)
> bergman@login3 ~]$ cd $MODULEPATH
> bergman@login3 modules]$ find . -type f -iname "*pytorch*" 2> /dev/null |
> grep -v "\.svn"
> python/anaconda/RLPytorch
> bergman@login3 modules]$ # excluding dirs without access permission, 1
> file with pytorch in the name
> bergman@login3 modules]$
> [bergman@cubic-login3 modules]$ grep -r module-whatis . 2> /dev/null |
> grep -v "\.svn" | grep -i pytorch|sed -e "s/:.*//" | sort -u
> ./python/anaconda/3.6.5+cv+slide
> ./python/anaconda/3.6.8+tfgpu+torch1.1
> ./python/anaconda/RLPytorch
> ./python/anaconda/uniphan
> ./pytorch/1.0.1
> bergman@login3 modules]$ ### Five modules with "pytorch" in their
> module-whatis line or name
> bergman@login3 modules]$ module apropos pytorch 1> /tmp/module-apropos.out
> bergman@login3 modules]$ ### The output file should have the directory
> header plus 5 lines
> bergman@login3 modules]$ wc -l /tmp/module-apropos.out
> 454 /tmp/module-apropos.out
> bergman@login3 modules]$ ### The output file actually has ~450 lines of
> warnings from our module files, plus the expected 5 lines of 'module-whatis'
> bergman@login3 modules]$
> bergman@login3 modules]$ tail /tmp/module-apropos.out
> No installation of VTK (6.2.0) under
> No installation of XGBOOST (60-58) under
> No installation of YASM (1.2.0) under
> No installation of ZLIB (1.2.8) under
> ------------------------------------------------------------------------------------------------------
> /usr/local/share/modules
> ------------------------------------------------------------------------------------------------------
> python/anaconda/3.6.5+cv+slide: Set up environment for Anaconda Python v3
> 3 and includes tensorflow-gpu as well as pytorch 1.1
> python/anaconda/3.6.8+tfgpu+torch1.1: Set up environment for Anaconda
> Python v3 3 and includes tensorflow-gpu as well as pytorch 1.1
> python/anaconda/RLPytorch: Set up environment for RLPytorch 1.0
> python/anaconda/uniphan: Set up environment for Anaconda Python v3 3 and
> includes tensorflow-gpu as well as pytorch 1.1
>        pytorch/1.0.1: Sets up the environment variables for pytorch 1.0 3
> from Git commit dbdc1f12cabcf0c0502965ad975dcd684d1e6fb5, Feb 13 2019
> 10:04AM
>
>
>
>
> _______________________________________________
> Modules-interest mailing list
> Mod...@li...
> https://lists.sourceforge.net/lists/listinfo/modules-interest
>

[Modules] module apropos -- unexpected behavior and output

[<be...@me...>]

The command:

	module apropos $STRING

should show the "module-whatis" text from all modules where the module
name or whatis line matches $STRING.

With modules 4.1.2 and 4.5.3, the "module apropos" command seems to try
to load ALL modules in $MODULESPATH, then produce the expected output.

In our environment, the behavior of attempting to load each module results
in a large number of warnings (modules that have been deprecated, software
that's no longer installed or not available under the OS of the machine
running "module apropos", dependency warnings, etc). Example below.

---------------------------------------------------------------------
[bergman@login3 ~]$ module --version
 Release 4.5.3 (2020-08-31)
bergman@login3 ~]$ cd $MODULEPATH
bergman@login3 modules]$ find . -type f -iname "*pytorch*" 2> /dev/null | grep -v "\.svn"
python/anaconda/RLPytorch
bergman@login3 modules]$ # excluding dirs without access permission, 1 file with pytorch in the name
bergman@login3 modules]$ 
[bergman@cubic-login3 modules]$ grep -r module-whatis . 2> /dev/null | grep -v "\.svn" | grep -i pytorch|sed -e "s/:.*//" | sort -u
./python/anaconda/3.6.5+cv+slide
./python/anaconda/3.6.8+tfgpu+torch1.1
./python/anaconda/RLPytorch
./python/anaconda/uniphan
./pytorch/1.0.1
bergman@login3 modules]$ ### Five modules with "pytorch" in their module-whatis line or name
bergman@login3 modules]$ module apropos pytorch 1> /tmp/module-apropos.out
bergman@login3 modules]$ ### The output file should have the directory header plus 5 lines
bergman@login3 modules]$ wc -l /tmp/module-apropos.out
454 /tmp/module-apropos.out
bergman@login3 modules]$ ### The output file actually has ~450 lines of warnings from our module files, plus the expected 5 lines of 'module-whatis'
bergman@login3 modules]$ 
bergman@login3 modules]$ tail /tmp/module-apropos.out
No installation of VTK (6.2.0) under 
No installation of XGBOOST (60-58) under 
No installation of YASM (1.2.0) under 
No installation of ZLIB (1.2.8) under 
------------------------------------------------------------------------------------------------------ /usr/local/share/modules ------------------------------------------------------------------------------------------------------
python/anaconda/3.6.5+cv+slide: Set up environment for Anaconda Python v3 3 and includes tensorflow-gpu as well as pytorch 1.1
python/anaconda/3.6.8+tfgpu+torch1.1: Set up environment for Anaconda Python v3 3 and includes tensorflow-gpu as well as pytorch 1.1
python/anaconda/RLPytorch: Set up environment for RLPytorch 1.0
python/anaconda/uniphan: Set up environment for Anaconda Python v3 3 and includes tensorflow-gpu as well as pytorch 1.1
       pytorch/1.0.1: Sets up the environment variables for pytorch 1.0 3 from Git commit dbdc1f12cabcf0c0502965ad975dcd684d1e6fb5, Feb 13 2019 10:04AM

[Modules] Modules 4.6.0 released

[Xavier D. <xav...@gm...>]

Hello All,

Modules 4.6.0 is here with many new stuff to handle the life cycle of your
modulefiles. It is as always backward-compatible with previous version 4
releases and primarily adds features and fixes bugs. Major new features
introduced in v4.6.0 since v4.5 are:

* Translating shell scripts into modulefiles
* Embed shell scripts in modulefiles
* Querying user's name and groups membership
* Hiding modules
* Forbidding use of modules
* Tracing module execution

Details on these features included in this new release are provided in the
MIGRATING document. The list of all changes made in this new version are
described in the NEWS document.

 http://modules.readthedocs.io/en/stable/MIGRATING.html
 http://modules.readthedocs.io/en/stable/NEWS.html

The tarball of this new version can be downloaded at:

 http://downloads.sourceforge.net/modules/modules-4.6.0.tar.gz

The zipball to install this new version on Windows platform can be
downloaded at:

 http://downloads.sourceforge.net/modules/modules-4.6.0-win.zip

If you encounter any issue, please let us know by creating a ticket on the
project bug tracker at:

 https://github.com/cea-hpc/modules/issues

Many thanks also to all of you who improve Modules by reporting bugs or
sharing new ideas.

Best regards,
Xavie

[Modules] Tracing module execution

[Xavier D. <xav...@gm...>]

Dear All,

The `trace` verbosity is introduced between the `verbose` and `debug`
levels to report details on module searches, resolutions, selections and
evaluations. Trace mode can be enabled by setting the `verbosity` config to
the `trace` value or by using the `-T`/`--trace` command-line switches.

To specifically render trace messages, the `tr` key is added to the color
palette with a default value of `2` (decreased intensity).

    $ ml -T foo
    Evaluate modulerc: '/path/to/modulefiles/.modulerc'
    Get modules: {foo} matching 'foo' in '/path/to/modulefiles'
    Resolve: 'foo' into 'bar'
    Get modules: {bar bar/1.0} matching 'bar' in '/path/to/modulefiles'
    Select module: 'bar/1.0' (/path/to/modulefiles/bar/1.0) matching
'bar/1.0'

    Loading bar/1.0
      Evaluate modulefile: '/path/to/modulefiles/bar/1.0' as 'bar/1.0'

This new feature is available in git repository and will be included in
upcoming v4.6 release.

Regards,
Xavier