lmod-users Mailing List for Lmod (Page 2)
A Lua based environment module system that reads TCL modulefiles.
Brought to you by:
rtmclay
Menu
▾
▴
lmod-users — A list to discuss using/deploying Lmod
You can subscribe to this list here.
| 2012 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(7) |
Nov
(37) |
Dec
(9) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2013 |
Jan
(22) |
Feb
(9) |
Mar
(28) |
Apr
(13) |
May
(30) |
Jun
(49) |
Jul
(24) |
Aug
(20) |
Sep
(21) |
Oct
(71) |
Nov
(18) |
Dec
(26) |
| 2014 |
Jan
(57) |
Feb
(73) |
Mar
(39) |
Apr
(74) |
May
(55) |
Jun
(27) |
Jul
(25) |
Aug
(59) |
Sep
(43) |
Oct
(43) |
Nov
(38) |
Dec
(8) |
| 2015 |
Jan
(32) |
Feb
(38) |
Mar
(23) |
Apr
(15) |
May
(8) |
Jun
(45) |
Jul
(43) |
Aug
(6) |
Sep
(43) |
Oct
(58) |
Nov
(12) |
Dec
(31) |
| 2016 |
Jan
(21) |
Feb
(20) |
Mar
(12) |
Apr
(15) |
May
(18) |
Jun
(28) |
Jul
(3) |
Aug
(30) |
Sep
(31) |
Oct
(23) |
Nov
(49) |
Dec
(49) |
| 2017 |
Jan
(90) |
Feb
(57) |
Mar
(46) |
Apr
(35) |
May
(43) |
Jun
(23) |
Jul
(40) |
Aug
(51) |
Sep
(22) |
Oct
(21) |
Nov
(29) |
Dec
(29) |
| 2018 |
Jan
(7) |
Feb
(22) |
Mar
(16) |
Apr
(17) |
May
(18) |
Jun
(16) |
Jul
(16) |
Aug
(8) |
Sep
(29) |
Oct
(52) |
Nov
(24) |
Dec
(29) |
| 2019 |
Jan
(11) |
Feb
(13) |
Mar
(22) |
Apr
(43) |
May
(23) |
Jun
(7) |
Jul
(14) |
Aug
(27) |
Sep
(9) |
Oct
(8) |
Nov
(36) |
Dec
(58) |
| 2020 |
Jan
(29) |
Feb
(13) |
Mar
(49) |
Apr
(16) |
May
(7) |
Jun
(27) |
Jul
(12) |
Aug
(21) |
Sep
(11) |
Oct
(10) |
Nov
(12) |
Dec
(4) |
| 2021 |
Jan
(23) |
Feb
(10) |
Mar
(8) |
Apr
(16) |
May
(15) |
Jun
(19) |
Jul
(19) |
Aug
(11) |
Sep
(28) |
Oct
(25) |
Nov
(3) |
Dec
(18) |
| 2022 |
Jan
(17) |
Feb
(41) |
Mar
(19) |
Apr
(36) |
May
(40) |
Jun
(6) |
Jul
(17) |
Aug
(16) |
Sep
(12) |
Oct
(8) |
Nov
(12) |
Dec
(4) |
| 2023 |
Jan
(6) |
Feb
(7) |
Mar
(26) |
Apr
(9) |
May
(3) |
Jun
(6) |
Jul
(15) |
Aug
(11) |
Sep
(3) |
Oct
(4) |
Nov
(6) |
Dec
(17) |
| 2024 |
Jan
(13) |
Feb
(9) |
Mar
(5) |
Apr
(6) |
May
(6) |
Jun
(6) |
Jul
(12) |
Aug
(17) |
Sep
(14) |
Oct
(15) |
Nov
(20) |
Dec
(7) |
| 2025 |
Jan
(11) |
Feb
(1) |
Mar
(6) |
Apr
(14) |
May
(17) |
Jun
(4) |
Jul
|
Aug
(4) |
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Paul T. B. <ptb...@gm...> - 2025-04-24 15:49:42
|
Greetings Lmod Users, I'd talked with Robert about something related over a decade ago now (sigh), but wanted to see if things have changed since then. Here is the kind of scenario I'm interested in at an abstract level. Consider modules A1, A2, B1, B2, C, and D. A and B have different versions, but are the same package and do not depend on each other. Module C depends on both A and B. Module D depends on C (and therefore implicitly A and B). A,B --> C --> D I would like to be able to "module swap A1 A2" or "module swap B1 B2" and have C and D be reloaded accordingly. Is this possible? The specific use-case I have in mind is that my MPI stack depends on both the compiler and the GPU compute stack (i.e. different CUDA or ROCm versions). I would like to be able to swap out the compiler version and/or the GPU software stack version and then have dependent modules reloaded accordingly. I would be curious to hear about others' solution to this specific pattern as I'm sure I'm not the first to have thought about this at this point. Thanks for your time. Best, Paul |
|
From: Marcus W. <wa...@it...> - 2025-04-24 05:37:59
|
Hello all, we are using a hierarchical module naming scheme. For us, it looks like the sorting of the groups depends on the order in the modulepath. Is there a possibility, to influence the sorting? how it looks now: global aliases MPI modules Compiler modules Core modules personal Core modules what we would like to achieve: global aliases Core modules personal Core modules Compiler modules MPI modules Does anyone have a hint? Best Marcus -- Dipl.-Inf. Marcus Wagner stellv. Gruppenleitung IT Center Gruppe: Server, Storage, HPC Abteilung: Systeme und Betrieb RWTH Aachen University Seffenter Weg 23 52074 Aachen Tel: +49 241 80 24383 wa...@it... www.itc.rwth-aachen.de Social-Media-Kanäle des IT Centers: https://blog.rwth-aachen.de/itc/ https://www.facebook.com/itcenterrwth https://www.instagram.com/itcenterrwthaachen/ https://www.linkedin.com/company/itcenterrwth https://www.youtube.com/c/ITCenterRWTHAachen |
|
From: Robert M. <mc...@ta...> - 2025-04-07 15:13:11
|
We will hold the Lmod Zoom meeting tomorrow April 8th at 9:30 US Central Time, (14:30 UTC). The zoom link is: https://utexas.zoom.us/j/2714596735 Beginners welcome. You do not need to be an Lmod expert to attend the meeting. New topics welcome. The current agenda is: * Q/A * A discussion about generating spider cache files that contain the contents of each module file * TCL contents issues: Copying file to /dev/shmem, Reporting Errors * Regular Spider cache file vs. Big Spider Cache file * Is this going to improve performance on parallel file systems? Best, Lmod Team |
|
From: Robert M. <mc...@ta...> - 2025-04-03 17:01:58
|
Typically, the less program is installed where LESSOPEN is defined. This starts a new shell. When this shell is run, it sources the files in /etc/profile.d. In your case it sources /etc/profile.d/lmod.sh. And that executes /opt/ohpc/admin/lmod/lmod/libexec/addto. At the top of addto has in your case:
#!/usr/bin/lua5.3
-- -*- lua -*-
The command addto is expecting /usr/bin/lua5.3 to exist and be executable by you the user. For some reason, the lua5.3 executable is not there in /usr/bin.
This is not an Lmod issue. It might be an OHPC issue.
Best,
Robert
________________________________
From: Aziz Öğütlü <azi...@ed...>
Sent: Tuesday, April 1, 2025 10:01 PM
To: Lmod Users <lmo...@li...>
Subject: [Lmod-users] after less command lua permission denied
Hi there all lmod users,
I've installed lmod-ohpc package on SUSE 15.6 and when I run less
command with root user after close the command this error shows:
software:~ # less log
/opt/ohpc/admin/lmod/lmod/init/bash:
/opt/ohpc/admin/lmod/lmod/libexec/addto: /usr/bin/lua5.3: bad
interpreter: Permission denied
What can be the problem?
--
Best regards,
Aziz Öğütlü
Eduline Bilişim Sanayi ve Ticaret Ltd. Şti. https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eduline.com.tr%2F&data=05%7C02%7C%7Cc04678b164274048a08808dd719da4e7%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791644087705775%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=sERk4ILr8d39H%2FBxWUSm1YvR3n0DGfJG%2BGHCilo44v4%3D&reserved=0<http://www.eduline.com.tr/>
Merkez Mah. Ayazma Cad. No:37 Papirus Plaza
Kat:6 Ofis No:118 Kağıthane - İstanbul - Türkiye 34406
Tel : +90 212 324 60 61 Cep: +90 541 350 40 72
_______________________________________________
Lmod-users mailing list
Lmo...@li...
https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Flmod-users&data=05%7C02%7C%7Cc04678b164274048a08808dd719da4e7%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791644087725074%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=WcoRh1luj3GAQcszBkKvOFiI%2FHsMadsxhMoK70y20Ws%3D&reserved=0<https://lists.sourceforge.net/lists/listinfo/lmod-users>
>> This message is from an external sender. Learn more about why this <<
>> matters at https://links.utexas.edu/rtyclf. <<
|
|
From: Robert M. <mc...@ta...> - 2025-04-02 19:58:44
|
I am unable to reproduce this issue. I can do a module avail when there is a module named starccm+. Please create a github issue at github.com/TACC/Lmod. Please run: $ module -D avail 2> avail.log Then use a github gist to attach avail.log Best ________________________________ From: Aziz Öğütlü <azi...@ed...> Sent: Tuesday, April 1, 2025 9:56 PM To: lmo...@li... <lmo...@li...> Subject: [Lmod-users] Some modules not list Hi there all lmod users, I've installed lmod-ohpc package on SUSE 15.6 and some of the modules are not listing on module avail command. For example starcc+ module is not listing but I can load it with module load command. module -D load starccm+ command output log is attached. What can be the problem. -- Best regards, Aziz Öğütlü Eduline Bilişim Sanayi ve Ticaret Ltd. Şti. https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eduline.com.tr%2F&data=05%7C02%7C%7C04834c3484de4abcf6ac08dd719fbce1%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791653086664091%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=AfgIfNUtEcfo0z%2FY107aGMWz1lb5ZBIsCIOz0cdRStM%3D&reserved=0<http://www.eduline.com.tr/> Merkez Mah. Ayazma Cad. No:37 Papirus Plaza Kat:6 Ofis No:118 Kağıthane - İstanbul - Türkiye 34406 Tel : +90 212 324 60 61 Cep: +90 541 350 40 72 |
|
From: Robert M. <mc...@ta...> - 2025-04-02 19:50:51
|
There is a typo in the previous message:
Normally, the root user does NOT get the module command defined. This is clear from the top of the init/profile.in file:
Best,
Robert
________________________________
From: Robert McLay <mc...@ta...>
Sent: Wednesday, April 2, 2025 1:47 PM
To: Lmod Users <lmo...@li...>; azi...@ed... <azi...@ed...>
Subject: Re: [Lmod-users] Suse cannot load lmod.sh on profile.d
Normally, the root user does get the module command defined. This is clear from the top of the init/profile.in file:
#!/bin/sh
########################################################################
# This is the system wide source file for setting up modules
########################################################################
if [ -z "${LMOD_ALLOW_ROOT_USE+x}" ]; then
LMOD_ALLOW_ROOT_USE=@lmod_allow_root_use@
fi
( [ -n "${USER_IS_ROOT:-}" ] || ( [ "${LMOD_ALLOW_ROOT_USE:-}" != yes ] && [ $(id -u) = 0 ] ) ) && return
If you want to have the root user be able to run the module command then you need to
export LMOD_ALLOW_ROOT_USE=1
Before /etc/profile.d/lmod.sh is sourced
Best,
Robert
________________________________
From: Aziz Öğütlü <azi...@ed...>
Sent: Tuesday, April 1, 2025 9:58 PM
To: Lmod Users <lmo...@li...>
Subject: [Lmod-users] Suse cannot load lmod.sh on profile.d
Hi there all lmod users,
I've installed lmod-ohpc on SUSE 15.6 and for root user
/etc/profile.d/lmod.sh file cannot automatically load. Because of that
module command cannot run. What can be the problem?
--
Best regards,
Aziz Öğütlü
Eduline Bilişim Sanayi ve Ticaret Ltd. Şti. https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eduline.com.tr%2F&data=05%7C02%7C%7Cc729a784acc94db3e71808dd719cf571%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791641149831814%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=6ZZG4UlRR6%2F0hWe4oHKcQ9lq0kdv6zHUDOSkQjPOKkI%3D&reserved=0<http://www.eduline.com.tr/>
Merkez Mah. Ayazma Cad. No:37 Papirus Plaza
Kat:6 Ofis No:118 Kağıthane - İstanbul - Türkiye 34406
Tel : +90 212 324 60 61 Cep: +90 541 350 40 72
_______________________________________________
Lmod-users mailing list
Lmo...@li...
https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Flmod-users&data=05%7C02%7C%7Cc729a784acc94db3e71808dd719cf571%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791641149847698%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=7mVcHlYKJZQ%2FEovyYK3awjUhRxefl%2FO7JvV0nPCoGqk%3D&reserved=0<https://lists.sourceforge.net/lists/listinfo/lmod-users>
>> This message is from an external sender. Learn more about why this <<
>> matters at https://links.utexas.edu/rtyclf. <<
|
|
From: Robert M. <mc...@ta...> - 2025-04-02 19:48:33
|
Normally, the root user does get the module command defined. This is clear from the top of the init/profile.in file:
#!/bin/sh
########################################################################
# This is the system wide source file for setting up modules
########################################################################
if [ -z "${LMOD_ALLOW_ROOT_USE+x}" ]; then
LMOD_ALLOW_ROOT_USE=@lmod_allow_root_use@
fi
( [ -n "${USER_IS_ROOT:-}" ] || ( [ "${LMOD_ALLOW_ROOT_USE:-}" != yes ] && [ $(id -u) = 0 ] ) ) && return
If you want to have the root user be able to run the module command then you need to
export LMOD_ALLOW_ROOT_USE=1
Before /etc/profile.d/lmod.sh is sourced
Best,
Robert
________________________________
From: Aziz Öğütlü <azi...@ed...>
Sent: Tuesday, April 1, 2025 9:58 PM
To: Lmod Users <lmo...@li...>
Subject: [Lmod-users] Suse cannot load lmod.sh on profile.d
Hi there all lmod users,
I've installed lmod-ohpc on SUSE 15.6 and for root user
/etc/profile.d/lmod.sh file cannot automatically load. Because of that
module command cannot run. What can be the problem?
--
Best regards,
Aziz Öğütlü
Eduline Bilişim Sanayi ve Ticaret Ltd. Şti. https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eduline.com.tr%2F&data=05%7C02%7C%7Cc729a784acc94db3e71808dd719cf571%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791641149831814%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=6ZZG4UlRR6%2F0hWe4oHKcQ9lq0kdv6zHUDOSkQjPOKkI%3D&reserved=0<http://www.eduline.com.tr/>
Merkez Mah. Ayazma Cad. No:37 Papirus Plaza
Kat:6 Ofis No:118 Kağıthane - İstanbul - Türkiye 34406
Tel : +90 212 324 60 61 Cep: +90 541 350 40 72
_______________________________________________
Lmod-users mailing list
Lmo...@li...
https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Flmod-users&data=05%7C02%7C%7Cc729a784acc94db3e71808dd719cf571%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791641149847698%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=7mVcHlYKJZQ%2FEovyYK3awjUhRxefl%2FO7JvV0nPCoGqk%3D&reserved=0<https://lists.sourceforge.net/lists/listinfo/lmod-users>
>> This message is from an external sender. Learn more about why this <<
>> matters at https://links.utexas.edu/rtyclf. <<
|
|
From: Robert M. <mc...@ta...> - 2025-04-02 19:19:11
|
The variable FPATH is used by Ksh to find shell functions. Lmod sets FPATH to point to the ksh versions of the module and ml commands for ALL shells. This means that any shell user can run a ksh script that has module commands. As for addto, it is a lua script that modifies the path-like variables. It doesn't mean that you have to support users that have ksh shell as their default shell. At TACC, we support bash, tcsh and zsh as user shells only. You can safely remove it if you so desire. It is only there to support running ksh scripts. The question is why? Is there a problem with setting it? Best, Robert Reply Forward WP ________________________________ From: Robert McLay <mc...@ta...> Sent: Wednesday, April 2, 2025 1:17 PM To: Ward Poelmans <wpo...@gm...> Subject: Re: [Lmod-users] FPATH The variable FPATH is used by Ksh to find shell functions. Lmod sets FPATH to point to the ksh versions of the module and ml commands for ALL shells. This means that any shell user can run a ksh script that has module commands. As for addto, it is a lua script that modifies the path-like variables. It doesn't mean that you have to support users that have ksh shell as their default shell. At TACC, we support bash, tcsh and zsh as user shells only. You can safely remove it if you so desire. It is only there to support running ksh scripts. The question is why? Is there a problem with setting it? Best, Robert ________________________________ From: Ward Poelmans <wpo...@gm...> Sent: Tuesday, April 1, 2025 1:16 PM To: lmod-users <lmo...@li...> Subject: Re: [Lmod-users] FPATH Hi Robert, So what does the FPATH variable do? Can we safely disable it? And why is this addto command being run inside a script that doesn't call anything Lmod command? Ward On 1/04/2025 17:31, Robert McLay wrote: Support for ksh is there so that bash/zsh users can run the module command in Ksh scripts. Best, Robert. ________________________________ From: Ward Poelmans <wpo...@gm...><mailto:wpo...@gm...> Sent: Tuesday, April 1, 2025 9:25 AM To: lmod-users <lmo...@li...><mailto:lmo...@li...> Subject: [Lmod-users] FPATH Hi Lmod people, We've noticed that our task prolog in Slurm is executing the following command: /usr/bin/lua /usr/share/lmod/lmod/libexec/addto --append FPATH /usr/share/lmod/lmod/init/ksh_funcs /usr/share/lmod/lmod/init/ksh_funcs Can anyone tell what this is and why it runs? We don't use ksh, only bash. ksh is installed because GPFS needs it. I see an `export FPATH=...` like in the `init/bash` of Lmod but I don't understand why it's there. There is also a LMOD_KSH_SUPPORT variable but that does not seem to be used by anything? Can anyone shed some light on this? Thanks! Ward _______________________________________________ Lmod-users mailing list Lmo...@li...<mailto:Lmo...@li...> https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Flmod-users&data=05%7C02%7C%7Cf5a18c5b4d7f4d5a0e6a08dd7131ce9d%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791180913272947%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=YWhZCMwbBbcnIvBQnuJHxhk%2FfLM1JjcfsXrnHddAoAo%3D&reserved=0<https://lists.sourceforge.net/lists/listinfo/lmod-users> >> This message is from an external sender. Learn more about why this << >> matters at https://links.utexas.edu/rtyclf. << |
|
From: Aziz Ö. <azi...@ed...> - 2025-04-02 04:34:45
|
Hi there all lmod users, I've installed lmod-ohpc package on SUSE 15.6 and some of the modules are not listing on module avail command. For example starcc+ module is not listing but I can load it with module load command. module -D load starccm+ command output log is attached. What can be the problem. -- Best regards, Aziz Öğütlü Eduline Bilişim Sanayi ve Ticaret Ltd. Şti. www.eduline.com.tr Merkez Mah. Ayazma Cad. No:37 Papirus Plaza Kat:6 Ofis No:118 Kağıthane - İstanbul - Türkiye 34406 Tel : +90 212 324 60 61 Cep: +90 541 350 40 72 |
|
From: Aziz Ö. <azi...@ed...> - 2025-04-02 04:19:51
|
Hi there all lmod users, I've installed lmod-ohpc package on SUSE 15.6 and when I run less command with root user after close the command this error shows: software:~ # less log /opt/ohpc/admin/lmod/lmod/init/bash: /opt/ohpc/admin/lmod/lmod/libexec/addto: /usr/bin/lua5.3: bad interpreter: Permission denied What can be the problem? -- Best regards, Aziz Öğütlü Eduline Bilişim Sanayi ve Ticaret Ltd. Şti. www.eduline.com.tr Merkez Mah. Ayazma Cad. No:37 Papirus Plaza Kat:6 Ofis No:118 Kağıthane - İstanbul - Türkiye 34406 Tel : +90 212 324 60 61 Cep: +90 541 350 40 72 |
|
From: Aziz Ö. <azi...@ed...> - 2025-04-02 04:14:51
|
Hi there all lmod users, I've installed lmod-ohpc on SUSE 15.6 and for root user /etc/profile.d/lmod.sh file cannot automatically load. Because of that module command cannot run. What can be the problem? -- Best regards, Aziz Öğütlü Eduline Bilişim Sanayi ve Ticaret Ltd. Şti. www.eduline.com.tr Merkez Mah. Ayazma Cad. No:37 Papirus Plaza Kat:6 Ofis No:118 Kağıthane - İstanbul - Türkiye 34406 Tel : +90 212 324 60 61 Cep: +90 541 350 40 72 |
|
From: Ward P. <wpo...@gm...> - 2025-04-01 19:16:42
|
Hi Robert, So what does the FPATH variable do? Can we safely disable it? And why is this addto command being run inside a script that doesn't call anything Lmod command? Ward On 1/04/2025 17:31, Robert McLay wrote: > Support for ksh is there so that bash/zsh users can run the module command in Ksh scripts. > > Best, > Robert. > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ > *From:* Ward Poelmans <wpo...@gm...> > *Sent:* Tuesday, April 1, 2025 9:25 AM > *To:* lmod-users <lmo...@li...> > *Subject:* [Lmod-users] FPATH > Hi Lmod people, > > We've noticed that our task prolog in Slurm is executing the following command: > /usr/bin/lua /usr/share/lmod/lmod/libexec/addto --append FPATH /usr/share/lmod/lmod/init/ksh_funcs /usr/share/lmod/lmod/init/ksh_funcs > > Can anyone tell what this is and why it runs? We don't use ksh, only bash. ksh is installed because GPFS needs it. > > I see an `export FPATH=...` like in the `init/bash` of Lmod but I don't understand why it's there. There is also a LMOD_KSH_SUPPORT variable but that does not seem to be used by anything? > > Can anyone shed some light on this? Thanks! > > > Ward > > > > _______________________________________________ > Lmod-users mailing list > Lmo...@li... > https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Flmod-users&data=05%7C02%7C%7Cf5a18c5b4d7f4d5a0e6a08dd7131ce9d%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791180913272947%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=YWhZCMwbBbcnIvBQnuJHxhk%2FfLM1JjcfsXrnHddAoAo%3D&reserved=0 <https://lists.sourceforge.net/lists/listinfo/lmod-users> > >> This message is from an external sender. Learn more about why this << > >> matters at https://links.utexas.edu/rtyclf. << > |
|
From: Robert M. <mc...@ta...> - 2025-04-01 15:31:38
|
Support for ksh is there so that bash/zsh users can run the module command in Ksh scripts. Best, Robert. ________________________________ From: Ward Poelmans <wpo...@gm...> Sent: Tuesday, April 1, 2025 9:25 AM To: lmod-users <lmo...@li...> Subject: [Lmod-users] FPATH Hi Lmod people, We've noticed that our task prolog in Slurm is executing the following command: /usr/bin/lua /usr/share/lmod/lmod/libexec/addto --append FPATH /usr/share/lmod/lmod/init/ksh_funcs /usr/share/lmod/lmod/init/ksh_funcs Can anyone tell what this is and why it runs? We don't use ksh, only bash. ksh is installed because GPFS needs it. I see an `export FPATH=...` like in the `init/bash` of Lmod but I don't understand why it's there. There is also a LMOD_KSH_SUPPORT variable but that does not seem to be used by anything? Can anyone shed some light on this? Thanks! Ward _______________________________________________ Lmod-users mailing list Lmo...@li... https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Flmod-users&data=05%7C02%7C%7Cf5a18c5b4d7f4d5a0e6a08dd7131ce9d%7C31d7e2a5bdd8414e9e97bea998ebdfe1%7C0%7C0%7C638791180913272947%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=YWhZCMwbBbcnIvBQnuJHxhk%2FfLM1JjcfsXrnHddAoAo%3D&reserved=0<https://lists.sourceforge.net/lists/listinfo/lmod-users> >> This message is from an external sender. Learn more about why this << >> matters at https://links.utexas.edu/rtyclf. << |
|
From: Ward P. <wpo...@gm...> - 2025-04-01 15:27:33
|
Hi Lmod people, We've noticed that our task prolog in Slurm is executing the following command: /usr/bin/lua /usr/share/lmod/lmod/libexec/addto --append FPATH /usr/share/lmod/lmod/init/ksh_funcs /usr/share/lmod/lmod/init/ksh_funcs Can anyone tell what this is and why it runs? We don't use ksh, only bash. ksh is installed because GPFS needs it. I see an `export FPATH=...` like in the `init/bash` of Lmod but I don't understand why it's there. There is also a LMOD_KSH_SUPPORT variable but that does not seem to be used by anything? Can anyone shed some light on this? Thanks! Ward |
|
From: James KW M. <j.k...@sh...> - 2025-03-31 18:48:30
|
Hi Grigory,
The methods I have seen most often used with module systems to account for
the CPU architecture are typically (intentionally) as simple as possible
and work by having parallel folders for installations/module files by the
architectures with "hot swapping" of some kind.
These parallel modules/builds can be hot swapped on the fly on a given node
via:
- Swapping a fixed mount point's remote target for the architecture by
that given node.
- aka change the module files on the actual module path (not within
Lmod).
- Using shell environment scripts (/etc/profile.d) to determine the
architecture, then set the module path.
- aka change the module path (not within Lmod).
- Using module files with internal logic to determine the architecture,
then set the module path.
- aka change the module path (arguably still not within Lmod per se,
just using a Lua/TCL module file).
For determination of the actual architecture I have seen the usage of
simple bash/lua parsing of lscpu output as well as solutions like this:
https://github.com/archspec/archspec
If you wanted to keep everything in Lmod (really just a Lua module) then I
think you should approach it same way that Laurence did here:
https://blog.entek.org.uk/notes/2021/07/27/platform-detection-with-lmod.html
In any case, for all HPC systems I have used or maintained, the users of
the system didn't have to know or care about how this was implemented nor
did they need to actively do anything in their job scripts to ensure the
architecturally correct module version of a module is loaded.
They would call the *exact* same module load command *on any* node type and
transparently get the architecturally correct version loaded! (This is to
say that by hook or crook, the correct module path was always populated
automatically on all nodes).
-----
In terms of modules being loaded by default - I don't think there is a one
size fits all answer and it will depend on how you have implemented other
things on a given HPC system.
My take would be that given any particular HPC system context, the choice
should be made keeping in mind what your users will understand easily and
feel most familiar / happy with. Essentially, KISS - "keep it simple,
silly!"
The choice will depend on many factors including inertia / decisions on how
certain aspects of the HPC cluster are provided.
e.g. If base packages like nano or vim are provided by the OS packages, or
whether everything besides the most simplified OS base must be provided as
modules.
If everything must be a module, then I expect your users would likely
appreciate having a nano or vim module autoloaded, (so long as it doesn't
get automatically inherited in the shell, loaded and then cause conflicts
within their submitted jobs - tinkering with SBATCH_EXPORT
<https://slurm.schedmd.com/sbatch.html#OPT_export> to avoid such things
required!)
At Sheffield, we use the /etc/profile.d setup to hot swap the module path
based on automatic architecture detection and provide software like nano or
vim via the OS packages. As such we have had no real need for any automatic
module loading.
The hot swapping of modules/differences in architecture is not explicitly
communicated to our users while they are in the terminal, but we document it
<https://docs.hpc.shef.ac.uk/en/latest/> on our modules pages (essential!)
for ourselves and users to refer to should the need arise.
We have also benefited greatly from usage of EasyBuild to easily and
reproducibly deploy software to our clusters across the architectures with
the default hierarchical module naming scheme/structure:
https://klust.github.io/easybuild-tutorial/2021-lust/module_naming_schemes/
-----
Hope this helps!
James.
------------------------------
<https://www.sheffield.ac.uk/it-services/research>
<https://www.sheffield.ac.uk/it-services/research>
Dr James Moore
Senior Research Platforms Engineer
The University of Sheffield
IT-Services | Research and Innovation IT
p: 0114 222 3110 ext: 23110
a: IT Services, 10-12 Brunswick Street,
Sheffield, S10 2FN
w: https://www.sheffield.ac.uk/it-services/research
tw: @RIT_Sheffield <https://twitter.com/rit_sheffield> @DrJKWMoore
<https://twitter.com/DrJKWMoore>
mast: @jkw...@ma...cial <https://mast.hpc.social/@jkwmoore>
e-alt: res...@sh...
e: J.K...@sh...
PGP keys @: https://keyserver.ubuntu.com/
<https://keyserver.ubuntu.com/pks/lookup?search=j.k.moore%40sheffield.ac.uk&fingerprint=on&op=index>
[image: linkedin] <https://www.linkedin.com/in/jkwmoore> [image: github]
<https://github.com/jkwmoore> [image: twitter]
<https://twitter.com/rit_sheffield?lang=en>
------------------------------
Need a meeting with me? <https://calendar.app.google/mHDxS2gdnUHXfau37>
On Mon, 31 Mar 2025 at 17:50, Grigory Shamov <gri...@um...>
wrote:
> Hi,
>
> I'd like to know if it is a good idea, or what are the best practices
> around, autodetecting CPU architecture within Lmod.
>
> And, in general, what are the best practices/considerations for having
> modules loaded by default? I know that some HPC sites avoid any default
> modules, while others (ComputeCanada) load a lot of them by default.
>
> If architecture is a root of a module hierarchy (arch/ then compiler/ then
> mpi/), and there are at least two CPU architectures to make for "Illegal
> instruction" errors. And, if there are default modules always loaded (arch
> + a default toolchain) Would it make sense for Lmod to pick the right arch
> automatically, and how can it be done?
>
> Thanks!
>
> --
> Grigory Shamov
> Site Lead / HPC Specialist
> University of Manitoba and DRI Alliance Canada
>
>
>
>
>
>
>
> _______________________________________________
> Lmod-users mailing list
> Lmo...@li...
> https://lists.sourceforge.net/lists/listinfo/lmod-users
>
|
|
From: Grigory S. <gri...@um...> - 2025-03-31 16:49:19
|
Hi, I'd like to know if it is a good idea, or what are the best practices around, autodetecting CPU architecture within Lmod. And, in general, what are the best practices/considerations for having modules loaded by default? I know that some HPC sites avoid any default modules, while others (ComputeCanada) load a lot of them by default. If architecture is a root of a module hierarchy (arch/ then compiler/ then mpi/), and there are at least two CPU architectures to make for "Illegal instruction" errors. And, if there are default modules always loaded (arch + a default toolchain) Would it make sense for Lmod to pick the right arch automatically, and how can it be done? Thanks! -- Grigory Shamov Site Lead / HPC Specialist University of Manitoba and DRI Alliance Canada |
|
From: Biz A. <bud...@gm...> - 2025-03-15 23:56:48
|
Klapa |
|
From: Robert M. <mc...@ta...> - 2025-03-06 20:01:12
|
There are two places where changes to Lmod are described. The most detailed (besides the git logs), is the README.new file in the top directory of the source. So, all the changes that seem important to mention are there: For example, here are the 8.7.57 and 8.7.58 entries:
(8.7.57) * Issue #750: Adding support for new function export_shell_function()
Modified convertSh2MF.lua support converting export -f func to export_shell_function("func")
Make "export -f funcName" appear last in bash/zsh/sh shell output
* PR #752: Ensure m_Module_Msgs_close has an ending newline
* Issue #743: "module show noSuchModule" return an LmodError instead of
LmodWarning except when $LMOD_QUIET is set
* Issue #749: set display mode when executing "module update"
(8.7.58) * PR #754: move set_display_mode up in cmdfuncs.lua in function UnUse
* Support for Irreversible functions added. Documentation needs to be expanded.
Features/changes are major are reported here: https://lmod.readthedocs.io/en/latest/025_new.html
Best,
Robert
|
|
From: Thompson, M. (GSFC-610.1)[S. S. A. A. INC]
<mat...@na...> - 2025-03-06 18:13:38
|
Lmod List, This is probably the most minor email ever on this list, but I thought I'd ask after my google searches failed me. Namely, does lmod support "command aliases"? That is, my fingers are dumb sometimes and my history is filled with things like: * ml pruge * ml restoer So, I was wondering if there is a user-level ".lmodrc" or ".config/lmod/config.lua" file or the like I could edit to tell ml/module that when when I say "pruge" I mean "purge". If not, no worries, but thought I'd ask. Matt [signature_276612955]<http://www.ssaihq.com/> Matt Thompson Lead Scientific Software Engineer/Supervisor Global Modeling and Assimilation Office Science Systems and Applications, Inc. Code 610.1, 8800 Greenbelt Rd, Greenbelt, MD 20771 o: 301-614-6712 mat...@na...<mailto:mat...@na...> |
|
From: Robert M. <mc...@ta...> - 2025-03-03 19:09:12
|
We usually skip this week for Lmod meeting because of the time zone shift. Europe has switched to daylight saving mode and the North America switches to daylight saving mode next Sunday. We were going to meet on March 11th but I'm on vacation that day. We will have a zoom meeting on April 8th as I will be coming back from Germany on April 1st. Best, Lmod Team |
|
From: Robert M. <mc...@ta...> - 2025-02-03 17:12:04
|
We will hold the Lmod Zoom meeting tomorrow February 4th at 9:30 US Central Time, (15:30 UTC). The zoom link is: https://utexas.zoom.us/j/2714596735 Join our Cloud HD Video Meeting<https://utexas.zoom.us/j/2714596735> Zoom is the leader in modern enterprise video communications, with an easy, reliable cloud platform for video and audio conferencing, chat, and webinars across mobile, desktop, and room systems. Zoom Rooms is the original software-based conference room solution used around the world in board, conference, huddle, and training rooms, as well as executive offices and classrooms. Founded in 2011, Zoom helps businesses and organizations bring their teams together in a frictionless environment to get more done. Zoom is a publicly traded company headquartered in San Jose, CA. utexas.zoom.us Beginners welcome. You do not need to an Lmod expert to attend the meeting. New topics welcome. The current agenda is: - Q/A - Update from last time: Using Env. Vars to control what files are ignored - LMOD_FILE_IGNORE_PATTERNS could be set in SitePackage.lua or /etc/lmod/lmod_config.lua - The default is `{"%.version[-._].*", "%.modulerc[-._].*"}` - The latest version of Lmod allows sites to set it via an env. var. - This is the first time that Lmod takes the value and converts it to lua code - Issue #745: pushenv("VAR", false) failed when starting a new shell (`module refresh`) - now fixed - Issue #740: `module load vasp/module_does_not_exist` failed when using name-version-version layout and defaults - This was a hard error to fix as I wrote this code 7 years ago and name-version-version layouts are not used as much - Found other errors when working on this. - Lmod now makes sure that in N-V-V that the names match - Now Fixed - Work on irreversible continues. When released sites will be able to set variable on unload or load other modules. - `setenv{"A", "B", modeA={"unload"} }` (note the curly braces) - `load{"moduleA","moduleB", modeA={"unload"} }` - `module purge` will ignore the mode line and unset and unload - `module show moduleA` will show the above lines - Issue #746: Stolen from Xavier Delaurelle from his presentation at FOSDEM 25 last Saturday. - Use Shell hook to report commands that are in unloaded modules. ## Next Meeting: March 11, 2025 (Avoid mismatch of Time Zone Foo: Europe/US) |
|
From: Raghu R. - N. A. <rag...@no...> - 2025-01-30 17:55:18
|
jfe01.% echo $LMOD_VERSION
8.7.32
jfe01.%
jfe01.% echo $MODULEPATH
/etc/scl/modulefiles:/apps/lmod/lmod/modulefiles/Core:/apps/modules/modulefiles/Linux:/apps/modules/modulefiles
jfe01.%
jfe01.% module load spack-apps/2024.11
Lmod has detected the following error: A load storm (possibly an infinite
loop) detected for module: "spack-apps/2024.11" file:
"/apps/modules/modulefiles/spack-apps/2024.11.lua". It was loaded more than
500 times.
While processing the following module(s):
Module fullname Module Filename
--------------- ---------------
spack-apps/2024.11 /apps/modules/modulefiles/spack-apps/2024.11.lua
jfe01.%
jfe01.% cat /apps/modules/modulefiles/spack-apps/2024.11.lua
-- -*- lua -*-
-- Testing module
family("stack")
--pushenv("MODULEPATH","/apps/spack/spack-2024-11/modules/linux-rocky8-x86_64/Core")
pushenv("MODULEPATH","/home/Raghu.Reddy/modules")
jfe01.%
On another system that we have access to they are doing something similar
but on an older version of Lmod, I was wondering if the behavior has
changed or if I am doing something wrong:
The other system where it seems to be doing the right thing is using the
following version:
% echo $LMOD_VERSION
8.7.14
%
It is possible I am overlooking something simple.
Thank you for any suggestions!
--
Raghu Reddy, RDHPCS Support Team
GDIT contractor at NOAA/NWS/NCEP/EMC
5830 University Research Court, Suite 2146
College Park, MD 20740
Phone: 301-683-3771 (o), 301-683-3703 (fax), 412-439-8741 (c)
|
|
From: Robert M. <mc...@ta...> - 2025-01-13 17:12:53
|
________________________________
From: Robert McLay <mc...@ta...>
Sent: Monday, January 6, 2025 12:05 PM
To: lmod-users <lmo...@li...>
Subject: [Lmod-users] Lmod Zoom Meeting moved to Jan. 14 at 9:30 US Central (15:30 UTC)
I have to move the Lmod Zoom meeting to next week on the 14th.
Topic include:
*
Q/A:
*
Any new topics
*
A discussion of the new irreversible options: load{"A","B", mode={"unload"}), setenv("A","a", mode={"unload"}}. This will allow a site to load, setenv , etc on unload
*
A discussion about the new way of tracking module usage with a large factor (100x) times smaller db
*
Easy to delete old data.
*
Issue #740
no error message loading non-existent modules (only when multiple levels in the hierarchy have default symlinks?)
*
The Zoom link is:
https://utexas.zoom.us/j/2714596735
Beginners welcome. You do not need to be an Lmod expert to attend
Best,
Lmod Team
|
|
From: Hongyi Z. <hon...@gm...> - 2025-01-07 09:10:53
|
On Sat, Jan 4, 2025 at 2:15 PM Hongyi Zhao <hon...@gm...> wrote: > > Hi there, > > See my following modulefile: > > ```tcl > $ cat /home/werner/Public/repo/github.com/TACC/modulefiles/applications/calypso/7.3.9+glibc2.17-py3 > #%Module > # 配合gpt，使用如下的网站在线debug tcl脚本： > #Online Tcl Compiler > #https://www.tutorialspoint.com/execute_tcl_online.php > set home $env(HOME) > set module_fullname [module-info name] > > set prefix $home/Public/repo/www.calypso.cn/download-calypso/$module_fullname > prepend-path PATH ${prefix}/bin > prepend-path PATH ${prefix}/Tools_py3/CALYPSO_ANALYSIS_KIT > > # 参考Intel oneapi中的相关用法： > #(datasci) werner@x13dai-t:/opt/intel/oneapi$ cd "/opt/intel/oneapi" > && ug module-info > # On load print component name and version being loaded > if { [ module-info mode load] } { > puts stderr "Loading $module_fullname" > puts stdout "eval \"\$(pyenv init -)\";" > puts stdout "pyenv shell datasci;" > } > > # On `module unload` print component module name and version being removed > # Include `module list` message only if this modulefile loads dependent modules > if { [ module-info mode ] == "unload" || [ module-info mode ] == "remove" } { > puts stderr "Removing $module_fullname" > puts stderr "Use `module list` to view any remaining dependent modules." > puts stdout "pyenv shell --unset;" > } > > ``` > > Here I call some system commands using `puts stdout`, but I don't know > if there are more graceful ways to do the trick. BTW, I also tried to use tcl2lua.tcl to convert the above tcl syntax to lua, but there are several ??? in the results: $ tcl2lua.tcl /home/werner/Public/repo/github.com/TACC/modulefiles/applications/calypso/7.3.9+glibc2.17-py3 prepend_path{"PATH","/home/werner/Public/repo/www.calypso.cn/download-calypso/???/bin",delim=":",priority="0"} prepend_path{"PATH","/home/werner/Public/repo/www.calypso.cn/download-calypso/???/Tools_py3/CALYPSO_ANALYSIS_KIT",delim=":",priority="0"} LmodMsgRaw([===[Loading ??? ]===]) execute{cmd=[===[eval "$(pyenv init -)";]===],modeA={"load"}} execute{cmd=[===[pyenv shell datasci;]===],modeA={"load"}} > Regards, > Zhao > -- > Assoc. Prof. Hongsheng Zhao <hon...@gm...> > Theory and Simulation of Materials > Hebei Vocational University of Technology and Engineering > No. 473, Quannan West Street, Xindu District, Xingtai, Hebei province |
|
From: Robert M. <mc...@ta...> - 2025-01-06 19:06:12
|
I have to move the Lmod Zoom meeting to next week on the 14th.
Topic include:
*
Q/A:
*
Any new topics
*
A discussion of the new irreversible options: load{"A","B", mode={"unload"}), setenv("A","a", mode={"unload"}}. This will allow a site to load, setenv , etc on unload
*
A discussion about the new way of tracking module usage with a large factor (100x) times smaller db
*
Easy to delete old data.
*
Issue #740
no error message loading non-existent modules (only when multiple levels in the hierarchy have default symlinks?)
*
The Zoom link is:
https://utexas.zoom.us/j/2714596735
Beginners welcome. You do not need to be an Lmod expert to attend
Best,
Lmod Team
|
20 messages has been excluded from this view by a project administrator.
