Menu
▾
▴
xcat-user
|
From: Markus H. <mar...@me...> - 2024-05-14 11:52:08
|
Hi, this is really strange because the goconserver should be the very same for quite some time. goconserver-0.3.3-snap202011021058.x86_64.rpm With site.consoleondemand set to yes the following happens: goconserver reads /var/lib/goconserver/nodes.json and spawns the following command: /opt/xcat/share/xcat/cons/ipmi <node> This will spawn: /opt/xcat/bin/ipmitool-xcat -I lanplus -U XXXXXX -P XXXXXX -H <node>.ipmi sol activate Can you please try to use the sol activate command manually and compare ipmitool-xcat vs. ipmitool? We might want to use ipmitool directly instead of ipmitool-xcat in /opt/xcat/share/xcat/cons/ipmi. Please also try with explicit cipher settings -C 3 -C 17 etc. Mit freundlichen Grüßen / Kind regards Markus Hilger HPC Engineer MEGWARE Computer Vertrieb und Service GmbH Tel: +49 3722 528-47 Nordstraße 19 mar...@me...<mailto:mar...@me...> 09247 Chemnitz-Röhrsdorf, Germany www.megware.com<http://www.megware.com/> Geschäftsführer: André Singer, Dr. Axel Auweter Amtsgericht: Chemnitz HRB 584 ________________________________ Von: Calvin Sawyer <c.s...@qm...> Gesendet: Montag, 13. Mai 2024 10:01 An: xca...@li... <xca...@li...> Betreff: [xcat-user] 2.16.5 and rcons Hi We've just migrated to a fresh 2.16.5 in a Rocky9.3 VM using imports from the previous 2.16.3, which has been mostly successful. We can rinstall and perform most r-commands Our test cluster which this xcat manages is comprised of older hardware and is meant to serve as a dress rehearsal for upgrading similarly in our production cluster with newer-gen hardware For the most part, 2.16.5 has been working fine with the notable exception of rcons. Both system types in the test cluster work fine with rcons under 2.16.3 user CentOS7, but under 2.16.5: Flex System x240 and NeXtScale nx360 M5 respond on C3 only, C17 is inoperative (and verified using ipmitool) with error: Error: Unable to establish IPMI v2 / RMCP+ session Error in open session response message : no matching cipher suite Testing on other hardware is complicated by many accepting both C3 and C17 (dell iDrac is one). More contemporary IMM2 allows both cipher suites as well This leads me to think that rcons is still somewhere hardwired to C3. We downloaded and patched IPMI.pm with the one from https://github.com/xcat2/xcat-core but the issue persists. However, I also don't understand exactly which system or xcat-specific components are involved in operation of goconserver or establishing an rcons connection to track down where the cipher suite is set Cal Sawyer ITS Research Platforms Manager Queen Mary University of London |
|
From: Ryan N. <nov...@ru...> - 2024-05-14 16:39:04
|
What has changed in later releases for RHEL-based OS is the behavior of ipmitool. I don’t know enough about the origins of the ipmitool that xCAT uses or how much it relies on the OS, but we have many systems that require -C 3 in order to connect on I believe both RHEL8 and RHEL9.
--
#BlackLivesMatter
____
|| \\UTGERS, |---------------------------*O*---------------------------
||_// the State | Ryan Novosielski - nov...@ru...
|| \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus
|| \\ of NJ | Office of Advanced Research Computing - MSB A555B, Newark
`'
On May 14, 2024, at 07:51, Markus Hilger <mar...@me...> wrote:
Hi,
this is really strange because the goconserver should be the very same for quite some time.
goconserver-0.3.3-snap202011021058.x86_64.rpm
With site.consoleondemand set to yes the following happens:
goconserver reads /var/lib/goconserver/nodes.json and spawns the following command:
/opt/xcat/share/xcat/cons/ipmi <node>
This will spawn:
/opt/xcat/bin/ipmitool-xcat -I lanplus -U XXXXXX -P XXXXXX -H <node>.ipmi sol activate
Can you please try to use the sol activate command manually and compare ipmitool-xcat vs. ipmitool?
We might want to use ipmitool directly instead of ipmitool-xcat in /opt/xcat/share/xcat/cons/ipmi.
Please also try with explicit cipher settings -C 3 -C 17 etc.
Mit freundlichen Grüßen / Kind regards
Markus Hilger
HPC Engineer
MEGWARE Computer Vertrieb und Service GmbH
Tel: +49 3722 528-47
Nordstraße 19
mar...@me...<mailto:mar...@me...>
09247 Chemnitz-Röhrsdorf, Germany
www.megware.com<http://www.megware.com/>
Geschäftsführer: André Singer, Dr. Axel Auweter
Amtsgericht: Chemnitz HRB 584
________________________________
Von: Calvin Sawyer <c.s...@qm...<mailto:c.s...@qm...>>
Gesendet: Montag, 13. Mai 2024 10:01
An: xca...@li...<mailto:xca...@li...> <xca...@li...<mailto:xca...@li...>>
Betreff: [xcat-user] 2.16.5 and rcons
Hi
We've just migrated to a fresh 2.16.5 in a Rocky9.3 VM using imports from the previous 2.16.3, which has been mostly successful. We can rinstall and perform most r-commands
Our test cluster which this xcat manages is comprised of older hardware and is meant to serve as a dress rehearsal for upgrading similarly in our production cluster with newer-gen hardware
For the most part, 2.16.5 has been working fine with the notable exception of rcons. Both system types in the test cluster work fine with rcons under 2.16.3 user CentOS7, but under 2.16.5:
Flex System x240 and NeXtScale nx360 M5 respond on C3 only, C17 is inoperative (and verified using ipmitool) with error:
Error: Unable to establish IPMI v2 / RMCP+ session
Error in open session response message : no matching cipher suite
Testing on other hardware is complicated by many accepting both C3 and C17 (dell iDrac is one). More contemporary IMM2 allows both cipher suites as well
This leads me to think that rcons is still somewhere hardwired to C3. We downloaded and patched IPMI.pm with the one from https://github.com/xcat2/xcat-core but the issue persists.
However, I also don't understand exactly which system or xcat-specific components are involved in operation of goconserver or establishing an rcons connection to track down where the cipher suite is set
Cal Sawyer
ITS Research Platforms Manager
Queen Mary University of London
_______________________________________________
xCAT-user mailing list
xCA...@li...<mailto:xCA...@li...>
https://lists.sourceforge.net/lists/listinfo/xcat-user
|
|
From: Markus H. <mar...@me...> - 2024-05-17 16:42:14
|
With the following command you can enable (a) / disable (X) certain ciphers: ipmitool -I lanplus -U XXX -P XXX -H <node> lan set <channel> cipher_privs aaaaaaaaaaaaaaa This might be useful for some of you. Mit freundlichen Grüßen / Kind regards Markus Hilger HPC Engineer MEGWARE Computer Vertrieb und Service GmbH Tel: +49 3722 528-47 Nordstraße 19 mar...@me...<mailto:mar...@me...> 09247 Chemnitz-Röhrsdorf, Germany www.megware.com<http://www.megware.com/> Geschäftsführer: André Singer, Dr. Axel Auweter Amtsgericht: Chemnitz HRB 584 ________________________________ Von: Ryan Novosielski via xCAT-user <xca...@li...> Gesendet: Dienstag, 14. Mai 2024 17:06 An: xCAT Users Mailing list <xca...@li...> Cc: Ryan Novosielski <nov...@ru...> Betreff: Re: [xcat-user] 2.16.5 and rcons What has changed in later releases for RHEL-based OS is the behavior of ipmitool. I don’t know enough about the origins of the ipmitool that xCAT uses or how much it relies on the OS, but we have many systems that require -C 3 in order to connect on I believe both RHEL8 and RHEL9. -- #BlackLivesMatter ____ || \\UTGERS, |---------------------------*O*--------------------------- ||_// the State | Ryan Novosielski - nov...@ru... || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus || \\ of NJ | Office of Advanced Research Computing - MSB A555B, Newark `' On May 14, 2024, at 07:51, Markus Hilger <mar...@me...> wrote: Hi, this is really strange because the goconserver should be the very same for quite some time. goconserver-0.3.3-snap202011021058.x86_64.rpm With site.consoleondemand set to yes the following happens: goconserver reads /var/lib/goconserver/nodes.json and spawns the following command: /opt/xcat/share/xcat/cons/ipmi <node> This will spawn: /opt/xcat/bin/ipmitool-xcat -I lanplus -U XXXXXX -P XXXXXX -H <node>.ipmi sol activate Can you please try to use the sol activate command manually and compare ipmitool-xcat vs. ipmitool? We might want to use ipmitool directly instead of ipmitool-xcat in /opt/xcat/share/xcat/cons/ipmi. Please also try with explicit cipher settings -C 3 -C 17 etc. Mit freundlichen Grüßen / Kind regards Markus Hilger HPC Engineer MEGWARE Computer Vertrieb und Service GmbH Tel: +49 3722 528-47 Nordstraße 19 mar...@me...<mailto:mar...@me...> 09247 Chemnitz-Röhrsdorf, Germany www.megware.com<http://www.megware.com/> Geschäftsführer: André Singer, Dr. Axel Auweter Amtsgericht: Chemnitz HRB 584 ________________________________ Von: Calvin Sawyer <c.s...@qm...<mailto:c.s...@qm...>> Gesendet: Montag, 13. Mai 2024 10:01 An: xca...@li...<mailto:xca...@li...> <xca...@li...<mailto:xca...@li...>> Betreff: [xcat-user] 2.16.5 and rcons Hi We've just migrated to a fresh 2.16.5 in a Rocky9.3 VM using imports from the previous 2.16.3, which has been mostly successful. We can rinstall and perform most r-commands Our test cluster which this xcat manages is comprised of older hardware and is meant to serve as a dress rehearsal for upgrading similarly in our production cluster with newer-gen hardware For the most part, 2.16.5 has been working fine with the notable exception of rcons. Both system types in the test cluster work fine with rcons under 2.16.3 user CentOS7, but under 2.16.5: Flex System x240 and NeXtScale nx360 M5 respond on C3 only, C17 is inoperative (and verified using ipmitool) with error: Error: Unable to establish IPMI v2 / RMCP+ session Error in open session response message : no matching cipher suite Testing on other hardware is complicated by many accepting both C3 and C17 (dell iDrac is one). More contemporary IMM2 allows both cipher suites as well This leads me to think that rcons is still somewhere hardwired to C3. We downloaded and patched IPMI.pm with the one from https://github.com/xcat2/xcat-core but the issue persists. However, I also don't understand exactly which system or xcat-specific components are involved in operation of goconserver or establishing an rcons connection to track down where the cipher suite is set Cal Sawyer ITS Research Platforms Manager Queen Mary University of London _______________________________________________ xCAT-user mailing list xCA...@li...<mailto:xCA...@li...> https://lists.sourceforge.net/lists/listinfo/xcat-user |
|
From: David J. <dav...@br...> - 2024-05-17 19:02:56
|
<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto">Ok, but how can one configure xcat to use some particular set of options for one set of nodes? We can get gocons to work almost everywhere, except one batch of tyan boxes from 2019. <div><div dir="ltr"> -- ddj<div>Dave Johnson</div></div><div dir="ltr"><br><blockquote type="cite">On May 17, 2024, at 12:42 PM, Markus Hilger <mar...@me...> wrote:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> With the following command you can enable (a) / disable (X) certain ciphers:</div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div class="elementToProof" style="font-family: "Aptos Mono", Aptos_EmbeddedFont, Aptos_MSFontService, monospace; font-size: 12pt; color: rgb(0, 0, 0);"> ipmitool -I lanplus -U XXX -P XXX -H <node> lan set <channel> cipher_privs aaaaaaaaaaaaaaa</div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> This might be useful for some of you.</div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div id="Signature" style="color: inherit; background-color: inherit;"> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> Mit freundlichen Grüßen / Kind regards</div> <div><br> </div> <table style="box-sizing: border-box; border-collapse: collapse; border-spacing: 0px; color: inherit; background-color: inherit;"> <tbody> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 75, 149);"><b>Markus Hilger</b></span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"></td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">HPC Engineer</span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">MEGWARE Computer Vertrieb und Service GmbH</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Tel: +49 3722 528-47</span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Nordstraße 19</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"><a href="mailto:mar...@me..." target="_blank" title="mailto:mar...@me..." rel="noopener noreferrer" data-linkindex="0" data-auth="NotApplicable" style="color: rgb(61, 118, 174); margin: 0px;">mar...@me...</a></span></td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">09247 Chemnitz-Röhrsdorf, Germany</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt; height: 8.5pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"><a href="http://www.megware.com/" target="_blank" rel="noopener noreferrer" data-linkindex="1" data-auth="NotApplicable" style="color: rgb(61, 118, 174); margin-top: 0px; margin-bottom: 0px;">www.megware.com</a></span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm; height: 8.5pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt; height: 8.5pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Geschäftsführer: André Singer, Dr. Axel Auweter</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: bottom; width: 140.35pt;"> <p style="margin: 0cm;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm; vertical-align: bottom; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: bottom; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Amtsgericht: Chemnitz HRB 584</span></p> </td> </tr> </tbody> </table> <br> </div> <div id="appendonsend"></div> <hr style="display:inline-block;width:98%" tabindex="-1"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>Von:</b> Ryan Novosielski via xCAT-user <xca...@li...><br> <b>Gesendet:</b> Dienstag, 14. Mai 2024 17:06<br> <b>An:</b> xCAT Users Mailing list <xca...@li...><br> <b>Cc:</b> Ryan Novosielski <nov...@ru...><br> <b>Betreff:</b> Re: [xcat-user] 2.16.5 and rcons</font> <div> </div> </div> <div style="line-break:after-white-space">What has changed in later releases for RHEL-based OS is the behavior of ipmitool. I don’t know enough about the origins of the ipmitool that xCAT uses or how much it relies on the OS, but we have many systems that require -C 3 in order to connect on I believe both RHEL8 and RHEL9. <div><br id="x_lineBreakAtBeginningOfMessage"> <div> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; line-break:after-white-space"> --<br> #BlackLivesMatter</div> <div style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; line-break:after-white-space"> ____<br> || \\UTGERS, |---------------------------*O*---------------------------<br> ||_// the State<span class="x_Apple-tab-span" style="white-space:pre"> </span> | Ryan Novosielski - nov...@ru...<br> || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus<br> || \\ of NJ<span class="x_Apple-tab-span" style="white-space:pre"> </span> | Office of Advanced Research Computing - MSB A555B, Newark<br> `'</div> </div> </div> </div> </div> </div> <div><br> <blockquote type="cite"> <div>On May 14, 2024, at 07:51, Markus Hilger <mar...@me...> wrote:</div> <br class="x_Apple-interchange-newline"> <div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Hi,</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> this is really strange because the goconserver should be the very same for quite some time.</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> goconserver-0.3.3-snap202011021058.x86_64.rpm</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> With site.consoleondemand set to yes the following happens:</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> goconserver reads /var/lib/goconserver/nodes.json and spawns the following command:</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; margin:0px; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; font-size:12pt"> /opt/xcat/share/xcat/cons/ipmi <node></div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> This will spawn:</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; font-size:12pt"> /opt/xcat/bin/ipmitool-xcat -I lanplus -U XXXXXX -P XXXXXX -H <node>.ipmi sol activate</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Can you please try to use the sol activate command manually and compare ipmitool-xcat vs. ipmitool?</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> We might want to use ipmitool directly instead of ipmitool-xcat in /opt/xcat/share/xcat/cons/ipmi.</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Please also try with explicit cipher settings -C 3 -C 17 etc.</div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div id="x_Signature" style="color:inherit; font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px; text-decoration:none; background-color:inherit"> <div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt">Mit freundlichen Grüßen / Kind regards</div> <div><br> </div> <table style="box-sizing:border-box; border-collapse:collapse; border-spacing:0px; color:inherit; background-color:inherit"> <tbody> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,75,149)"><b>Markus Hilger</b></span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <p style="margin:0cm"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"></td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">HPC Engineer</span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">MEGWARE Computer Vertrieb und Service GmbH</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Tel: +49 3722 528-47</span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Nordstraße 19</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"><a href="mailto:mar...@me..." target="_blank" title="mailto:mar...@me..." rel="noopener noreferrer" data-linkindex="0" data-auth="NotApplicable" id="OWA55ccd6c4-d277-7763-b816-d9757ed6afe8" class="x_OWAAutoLink" style="color:rgb(61,118,174); margin:0px">mar...@me...</a></span></td> <td style="padding:0cm; vertical-align:top; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">09247 Chemnitz-Röhrsdorf, Germany</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt; height:8.5pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"><a href="http://www.megware.com/" target="_blank" rel="noopener noreferrer" data-linkindex="1" data-auth="NotApplicable" id="OWAe65ead4c-e488-eb9a-44c6-0c1d762dc38c" class="x_OWAAutoLink" style="color:rgb(61,118,174); margin-top:0px; margin-bottom:0px">www.megware.com</a></span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm; height:8.5pt"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt; height:8.5pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Geschäftsführer: André Singer, Dr. Axel Auweter</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:bottom; width:140.35pt"> <p style="margin:0cm"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm; vertical-align:bottom; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:bottom; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Amtsgericht: Chemnitz HRB 584</span></p> </td> </tr> </tbody> </table> <br> </div> <div id="x_appendonsend" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> </div> <hr tabindex="-1" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px; text-decoration:none; display:inline-block; width:630.125px"> <span style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important"></span> <div id="x_divRplyFwdMsg" dir="ltr" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <font face="Calibri, sans-serif" style="font-size:11pt"><b>Von:</b><span class="x_Apple-converted-space"> </span>Calvin Sawyer <<a href="mailto:c.s...@qm...">c.s...@qm...</a>><br> <b>Gesendet:</b><span class="x_Apple-converted-space"> </span>Montag, 13. Mai 2024 10:01<br> <b>An:</b><span class="x_Apple-converted-space"> </span><a href="mailto:xca...@li...">xca...@li...</a><span class="x_Apple-converted-space"> </span><<a href="mailto:xca...@li...">xca...@li...</a>><br> <b>Betreff:</b><span class="x_Apple-converted-space"> </span>[xcat-user] 2.16.5 and rcons</font> <div> </div> </div> <div dir="ltr" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Hi</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> We've just migrated to a fresh 2.16.5 in a Rocky9.3 VM using imports from the previous 2.16.3, which has been mostly successful. We can rinstall and perform most r-commands</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Our test cluster which this xcat manages is comprised of older hardware and is meant to serve as a dress rehearsal for upgrading similarly in our production cluster with newer-gen hardware</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> For the most part, 2.16.5 has been working fine with the notable exception of rcons. Both system types in the test cluster work fine with rcons under 2.16.3 user CentOS7, but under 2.16.5:</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Flex System x240 and NeXtScale nx360 M5 respond on C3 only, C17 is inoperative (and verified using ipmitool) with error:</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="margin:0px 40px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Error: Unable to establish IPMI v2 / RMCP+ session<br> Error in open session response message : no matching cipher suite</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Testing on other hardware is complicated by many accepting both C3 and C17 (dell iDrac is one). More contemporary IMM2 allows both cipher suites as well</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> This leads me to think that rcons is still somewhere hardwired to C3. We downloaded and patched IPMI.pm with the one from<span class="x_Apple-converted-space"> </span><a href="https://github.com/xcat2/xcat-core" id="LPlnk" class="x_x_OWAAutoLink" data-auth="NotApplicable" data-loopstyle="linkonly">https://github.com/xcat2/xcat-core</a> but the issue persists.</div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> However, I also don't understand exactly which system or xcat-specific components are involved in operation of goconserver or establishing an rcons connection to track down where the cipher suite is set</div> <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div id="x_x_Signature"> <div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt"><span style="background-color:rgb(255,255,255)">Cal Sawyer</span></div> <div style="font-family:Calibri,Helvetica,sans-serif; font-size:11pt; color:rgb(34,34,34)"> <span style="background-color:rgb(255,255,255)">ITS Research Platforms Manager</span></div> <div style="font-family:Calibri,Helvetica,sans-serif; font-size:11pt; color:rgb(34,34,34)"> <span style="background-color:rgb(255,255,255)">Queen Mary University of London</span></div> </div> </div> <span style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important">_______________________________________________</span><br style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <span style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important">xCAT-user mailing list</span><br style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <a href="mailto:xCA...@li..." style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px">xCA...@li...</a><br style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <a href="https://lists.sourceforge.net/lists/listinfo/xcat-user" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px">https://lists.sourceforge.net/lists/listinfo/xcat-user</a></div> </blockquote> </div> <br> </div> </div> <span>_______________________________________________</span><br><span>xCAT-user mailing list</span><br><span>xCA...@li...</span><br><span>https://lists.sourceforge.net/lists/listinfo/xcat-user</span><br></div></blockquote></div></body></html> |
|
From: Markus H. <mar...@me...> - 2024-05-18 11:47:06
|
Hi David, unfortunately, you can't. For rpower/rvitals/rinv/nodeset etc. xCAT uses its own IPMI implementation in Perl. Previously this was using -C 3 ciphers. The current upstream code will try -C 17 ciphers and fallback to -C 3. Check this: https://github.com/xcat2/xcat-core/pull/6391 Mit freundlichen Grüßen / Kind regards Markus Hilger HPC Engineer MEGWARE Computer Vertrieb und Service GmbH Tel: +49 3722 528-47 Nordstraße 19 mar...@me...<mailto:mar...@me...> 09247 Chemnitz-Röhrsdorf, Germany www.megware.com<http://www.megware.com/> Geschäftsführer: André Singer, Dr. Axel Auweter Amtsgericht: Chemnitz HRB 584 ________________________________ Von: David Johnson <dav...@br...> Gesendet: Freitag, 17. Mai 2024 19:31 An: xCAT Users Mailing list <xca...@li...> Betreff: Re: [xcat-user] 2.16.5 and rcons Ok, but how can one configure xcat to use some particular set of options for one set of nodes? We can get gocons to work almost everywhere, except one batch of tyan boxes from 2019. -- ddj Dave Johnson On May 17, 2024, at 12:42 PM, Markus Hilger <mar...@me...> wrote: With the following command you can enable (a) / disable (X) certain ciphers: ipmitool -I lanplus -U XXX -P XXX -H <node> lan set <channel> cipher_privs aaaaaaaaaaaaaaa This might be useful for some of you. Mit freundlichen Grüßen / Kind regards Markus Hilger HPC Engineer MEGWARE Computer Vertrieb und Service GmbH Tel: +49 3722 528-47 Nordstraße 19 mar...@me...<mailto:mar...@me...> 09247 Chemnitz-Röhrsdorf, Germany www.megware.com<http://www.megware.com/> Geschäftsführer: André Singer, Dr. Axel Auweter Amtsgericht: Chemnitz HRB 584 ________________________________ Von: Ryan Novosielski via xCAT-user <xca...@li...> Gesendet: Dienstag, 14. Mai 2024 17:06 An: xCAT Users Mailing list <xca...@li...> Cc: Ryan Novosielski <nov...@ru...> Betreff: Re: [xcat-user] 2.16.5 and rcons What has changed in later releases for RHEL-based OS is the behavior of ipmitool. I don’t know enough about the origins of the ipmitool that xCAT uses or how much it relies on the OS, but we have many systems that require -C 3 in order to connect on I believe both RHEL8 and RHEL9. -- #BlackLivesMatter ____ || \\UTGERS, |---------------------------*O*--------------------------- ||_// the State | Ryan Novosielski - nov...@ru... || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus || \\ of NJ | Office of Advanced Research Computing - MSB A555B, Newark `' On May 14, 2024, at 07:51, Markus Hilger <mar...@me...> wrote: Hi, this is really strange because the goconserver should be the very same for quite some time. goconserver-0.3.3-snap202011021058.x86_64.rpm With site.consoleondemand set to yes the following happens: goconserver reads /var/lib/goconserver/nodes.json and spawns the following command: /opt/xcat/share/xcat/cons/ipmi <node> This will spawn: /opt/xcat/bin/ipmitool-xcat -I lanplus -U XXXXXX -P XXXXXX -H <node>.ipmi sol activate Can you please try to use the sol activate command manually and compare ipmitool-xcat vs. ipmitool? We might want to use ipmitool directly instead of ipmitool-xcat in /opt/xcat/share/xcat/cons/ipmi. Please also try with explicit cipher settings -C 3 -C 17 etc. Mit freundlichen Grüßen / Kind regards Markus Hilger HPC Engineer MEGWARE Computer Vertrieb und Service GmbH Tel: +49 3722 528-47 Nordstraße 19 mar...@me...<mailto:mar...@me...> 09247 Chemnitz-Röhrsdorf, Germany www.megware.com<http://www.megware.com/> Geschäftsführer: André Singer, Dr. Axel Auweter Amtsgericht: Chemnitz HRB 584 ________________________________ Von: Calvin Sawyer <c.s...@qm...<mailto:c.s...@qm...>> Gesendet: Montag, 13. Mai 2024 10:01 An: xca...@li...<mailto:xca...@li...> <xca...@li...<mailto:xca...@li...>> Betreff: [xcat-user] 2.16.5 and rcons Hi We've just migrated to a fresh 2.16.5 in a Rocky9.3 VM using imports from the previous 2.16.3, which has been mostly successful. We can rinstall and perform most r-commands Our test cluster which this xcat manages is comprised of older hardware and is meant to serve as a dress rehearsal for upgrading similarly in our production cluster with newer-gen hardware For the most part, 2.16.5 has been working fine with the notable exception of rcons. Both system types in the test cluster work fine with rcons under 2.16.3 user CentOS7, but under 2.16.5: Flex System x240 and NeXtScale nx360 M5 respond on C3 only, C17 is inoperative (and verified using ipmitool) with error: Error: Unable to establish IPMI v2 / RMCP+ session Error in open session response message : no matching cipher suite Testing on other hardware is complicated by many accepting both C3 and C17 (dell iDrac is one). More contemporary IMM2 allows both cipher suites as well This leads me to think that rcons is still somewhere hardwired to C3. We downloaded and patched IPMI.pm with the one from https://github.com/xcat2/xcat-core but the issue persists. However, I also don't understand exactly which system or xcat-specific components are involved in operation of goconserver or establishing an rcons connection to track down where the cipher suite is set Cal Sawyer ITS Research Platforms Manager Queen Mary University of London _______________________________________________ xCAT-user mailing list xCA...@li...<mailto:xCA...@li...> https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list xCA...@li... https://lists.sourceforge.net/lists/listinfo/xcat-user |
|
From: David J. <dav...@br...> - 2024-05-18 11:57:27
|
<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto">I think I heard that the problem BMCs claim to support cipher suite 17 but actually don’t. <br id="lineBreakAtBeginningOfSignature"><div dir="ltr"> -- ddj<div>Dave Johnson</div></div><div dir="ltr"><br><blockquote type="cite">On May 18, 2024, at 7:47 AM, Markus Hilger <mar...@me...> wrote:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> Hi David,</div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> unfortunately, you can't.</div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> For rpower/rvitals/rinv/nodeset etc. xCAT uses its own IPMI implementation in Perl. Previously this was using -C 3 ciphers. The current upstream code will try -C 17 ciphers and fallback to -C 3. Check this: <a href="https://github.com/xcat2/xcat-core/pull/6391" id="LPlnk">https://github.com/xcat2/xcat-core/pull/6391</a></div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div id="Signature" style="color: inherit; background-color: inherit;"> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> Mit freundlichen Grüßen / Kind regards</div> <div><br> </div> <table style="box-sizing: border-box; border-collapse: collapse; border-spacing: 0px; color: inherit; background-color: inherit;"> <tbody> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 75, 149);"><b>Markus Hilger</b></span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"></td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">HPC Engineer</span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">MEGWARE Computer Vertrieb und Service GmbH</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Tel: +49 3722 528-47</span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Nordstraße 19</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt;"> <span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"><a href="mailto:mar...@me..." target="_blank" title="mailto:mar...@me..." rel="noopener noreferrer" data-linkindex="0" data-auth="NotApplicable" style="color: rgb(61, 118, 174); margin: 0px;">mar...@me...</a></span></td> <td style="padding: 0cm; vertical-align: top; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">09247 Chemnitz-Röhrsdorf, Germany</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: top; width: 140.35pt; height: 8.5pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"><a href="http://www.megware.com/" target="_blank" rel="noopener noreferrer" data-linkindex="1" data-auth="NotApplicable" style="color: rgb(61, 118, 174); margin-top: 0px; margin-bottom: 0px;">www.megware.com</a></span></p> </td> <td style="padding: 0cm; vertical-align: top; width: 1cm; height: 8.5pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: top; width: 636.45pt; height: 8.5pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Geschäftsführer: André Singer, Dr. Axel Auweter</span></p> </td> </tr> <tr> <td style="border-right: 1pt solid rgb(0, 75, 149); padding: 0cm 5.4pt; vertical-align: bottom; width: 140.35pt;"> <p style="margin: 0cm;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm; vertical-align: bottom; width: 1cm;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);"> </span></p> </td> <td style="padding: 0cm 5.4pt; vertical-align: bottom; width: 636.45pt;"> <p style="margin: 0cm 0cm 3pt;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(61, 118, 174);">Amtsgericht: Chemnitz HRB 584</span></p> </td> </tr> </tbody> </table> <br> </div> <div id="appendonsend"></div> <hr style="display:inline-block;width:98%" tabindex="-1"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>Von:</b> David Johnson <dav...@br...><br> <b>Gesendet:</b> Freitag, 17. Mai 2024 19:31<br> <b>An:</b> xCAT Users Mailing list <xca...@li...><br> <b>Betreff:</b> Re: [xcat-user] 2.16.5 and rcons</font> <div> </div> </div> <div dir="auto">Ok, but how can one configure xcat to use some particular set of options for one set of nodes? We can get gocons to work almost everywhere, except one batch of tyan boxes from 2019. <div> <div dir="ltr"> -- ddj <div>Dave Johnson</div> </div> <div dir="ltr"><br> <blockquote type="cite">On May 17, 2024, at 12:42 PM, Markus Hilger <mar...@me...> wrote:<br> <br> </blockquote> </div> <blockquote type="cite"> <div dir="ltr"> <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> With the following command you can enable (a) / disable (X) certain ciphers:</div> <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> <br> </div> <div class="x_elementToProof" style="font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; font-size:12pt; color:rgb(0,0,0)"> ipmitool -I lanplus -U XXX -P XXX -H <node> lan set <channel> cipher_privs aaaaaaaaaaaaaaa</div> <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> <br> </div> <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> This might be useful for some of you.</div> <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> <br> </div> <div id="x_Signature" style="color:inherit; background-color:inherit"> <div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> Mit freundlichen Grüßen / Kind regards</div> <div><br> </div> <table style="box-sizing:border-box; border-collapse:collapse; border-spacing:0px; color:inherit; background-color:inherit"> <tbody> <tr> <td style="border-right:1pt solid rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,75,149)"><b>Markus Hilger</b></span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <p style="margin:0cm"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"></td> </tr> <tr> <td style="border-right:1pt solid rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">HPC Engineer</span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">MEGWARE Computer Vertrieb und Service GmbH</span></p> </td> </tr> <tr> <td style="border-right:1pt solid rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Tel: +49 3722 528-47</span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Nordstraße 19</span></p> </td> </tr> <tr> <td style="border-right:1pt solid rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"><a href="mailto:mar...@me..." target="_blank" title="mailto:mar...@me..." rel="noopener noreferrer" data-linkindex="0" data-auth="NotApplicable" style="color:rgb(61,118,174); margin:0px">mar...@me...</a></span></td> <td style="padding:0cm; vertical-align:top; width:1cm"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">09247 Chemnitz-Röhrsdorf, Germany</span></p> </td> </tr> <tr> <td style="border-right:1pt solid rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt; height:8.5pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"><a href="http://www.megware.com/" target="_blank" rel="noopener noreferrer" data-linkindex="1" data-auth="NotApplicable" style="color:rgb(61,118,174); margin-top:0px; margin-bottom:0px">www.megware.com</a></span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm; height:8.5pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt; height:8.5pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Geschäftsführer: André Singer, Dr. Axel Auweter</span></p> </td> </tr> <tr> <td style="border-right:1pt solid rgb(0,75,149); padding:0cm 5.4pt; vertical-align:bottom; width:140.35pt"> <p style="margin:0cm"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm; vertical-align:bottom; width:1cm"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:bottom; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Amtsgericht: Chemnitz HRB 584</span></p> </td> </tr> </tbody> </table> <br> </div> <div id="x_appendonsend"></div> <hr tabindex="-1" style="display:inline-block; width:98%"> <div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>Von:</b> Ryan Novosielski via xCAT-user <xca...@li...><br> <b>Gesendet:</b> Dienstag, 14. Mai 2024 17:06<br> <b>An:</b> xCAT Users Mailing list <xca...@li...><br> <b>Cc:</b> Ryan Novosielski <nov...@ru...><br> <b>Betreff:</b> Re: [xcat-user] 2.16.5 and rcons</font> <div> </div> </div> <div style="line-break:after-white-space">What has changed in later releases for RHEL-based OS is the behavior of ipmitool. I don’t know enough about the origins of the ipmitool that xCAT uses or how much it relies on the OS, but we have many systems that require -C 3 in order to connect on I believe both RHEL8 and RHEL9. <div><br id="x_x_lineBreakAtBeginningOfMessage"> <div> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div dir="auto" style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; line-break:after-white-space"> <div style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; line-break:after-white-space"> --<br> #BlackLivesMatter</div> <div style="color:rgb(0,0,0); letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; line-break:after-white-space"> ____<br> || \\UTGERS, |---------------------------*O*---------------------------<br> ||_// the State<span class="x_x_Apple-tab-span" style="white-space:pre"> </span> | Ryan Novosielski - nov...@ru...<br> || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus<br> || \\ of NJ<span class="x_x_Apple-tab-span" style="white-space:pre"> </span> | Office of Advanced Research Computing - MSB A555B, Newark<br> `'</div> </div> </div> </div> </div> </div> <div><br> <blockquote type="cite"> <div>On May 14, 2024, at 07:51, Markus Hilger <mar...@me...> wrote:</div> <br class="x_x_Apple-interchange-newline"> <div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Hi,</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> this is really strange because the goconserver should be the very same for quite some time.</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> goconserver-0.3.3-snap202011021058.x86_64.rpm</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> With site.consoleondemand set to yes the following happens:</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> goconserver reads /var/lib/goconserver/nodes.json and spawns the following command:</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; margin:0px; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; font-size:12pt"> /opt/xcat/share/xcat/cons/ipmi <node></div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> This will spawn:</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; font-size:12pt"> /opt/xcat/bin/ipmitool-xcat -I lanplus -U XXXXXX -P XXXXXX -H <node>.ipmi sol activate</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Can you please try to use the sol activate command manually and compare ipmitool-xcat vs. ipmitool?</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> We might want to use ipmitool directly instead of ipmitool-xcat in /opt/xcat/share/xcat/cons/ipmi.</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Please also try with explicit cipher settings -C 3 -C 17 etc.</div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div id="x_x_Signature" style="color:inherit; font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px; text-decoration:none; background-color:inherit"> <div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt">Mit freundlichen Grüßen / Kind regards</div> <div><br> </div> <table style="box-sizing:border-box; border-collapse:collapse; border-spacing:0px; color:inherit; background-color:inherit"> <tbody> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,75,149)"><b>Markus Hilger</b></span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <p style="margin:0cm"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt"> </span></p> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"></td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">HPC Engineer</span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">MEGWARE Computer Vertrieb und Service GmbH</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Tel: +49 3722 528-47</span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Nordstraße 19</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt"> <span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"><a href="mailto:mar...@me..." target="_blank" title="mailto:mar...@me..." rel="noopener noreferrer" data-linkindex="0" data-auth="NotApplicable" id="OWA55ccd6c4-d277-7763-b816-d9757ed6afe8" class="x_x_OWAAutoLink" style="color:rgb(61,118,174); margin:0px">mar...@me...</a></span></td> <td style="padding:0cm; vertical-align:top; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">09247 Chemnitz-Röhrsdorf, Germany</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:top; width:140.35pt; height:8.5pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"><a href="http://www.megware.com/" target="_blank" rel="noopener noreferrer" data-linkindex="1" data-auth="NotApplicable" id="OWAe65ead4c-e488-eb9a-44c6-0c1d762dc38c" class="x_x_OWAAutoLink" style="color:rgb(61,118,174); margin-top:0px; margin-bottom:0px">www.megware.com</a></span></p> </td> <td style="padding:0cm; vertical-align:top; width:1cm; height:8.5pt"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:top; width:636.45pt; height:8.5pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Geschäftsführer: André Singer, Dr. Axel Auweter</span></p> </td> </tr> <tr> <td style="border-right-width:1pt; border-right-style:solid; border-right-color:rgb(0,75,149); padding:0cm 5.4pt; vertical-align:bottom; width:140.35pt"> <p style="margin:0cm"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span></p> </td> <td style="padding:0cm; vertical-align:bottom; width:1cm"> <div style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)"> </span><br class="x_x_webkit-block-placeholder"> </div> </td> <td style="padding:0cm 5.4pt; vertical-align:bottom; width:636.45pt"> <p style="margin:0cm 0cm 3pt"><span style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:10pt; color:rgb(61,118,174)">Amtsgericht: Chemnitz HRB 584</span></p> </td> </tr> </tbody> </table> <br> </div> <div id="x_x_appendonsend" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> </div> <hr tabindex="-1" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px; text-decoration:none; display:inline-block; width:630.125px"> <span style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important"></span> <div id="x_x_divRplyFwdMsg" dir="ltr" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <font face="Calibri, sans-serif" style="font-size:11pt"><b>Von:</b><span class="x_x_Apple-converted-space"> </span>Calvin Sawyer <<a href="mailto:c.s...@qm...">c.s...@qm...</a>><br> <b>Gesendet:</b><span class="x_x_Apple-converted-space"> </span>Montag, 13. Mai 2024 10:01<br> <b>An:</b><span class="x_x_Apple-converted-space"> </span><a href="mailto:xca...@li...">xca...@li...</a><span class="x_x_Apple-converted-space"> </span><<a href="mailto:xca...@li...">xca...@li...</a>><br> <b>Betreff:</b><span class="x_x_Apple-converted-space"> </span>[xcat-user] 2.16.5 and rcons</font> <div> </div> </div> <div dir="ltr" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Hi</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> We've just migrated to a fresh 2.16.5 in a Rocky9.3 VM using imports from the previous 2.16.3, which has been mostly successful. We can rinstall and perform most r-commands</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Our test cluster which this xcat manages is comprised of older hardware and is meant to serve as a dress rehearsal for upgrading similarly in our production cluster with newer-gen hardware</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> For the most part, 2.16.5 has been working fine with the notable exception of rcons. Both system types in the test cluster work fine with rcons under 2.16.3 user CentOS7, but under 2.16.5:</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Flex System x240 and NeXtScale nx360 M5 respond on C3 only, C17 is inoperative (and verified using ipmitool) with error:</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="margin:0px 40px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Error: Unable to establish IPMI v2 / RMCP+ session<br> Error in open session response message : no matching cipher suite</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> Testing on other hardware is complicated by many accepting both C3 and C17 (dell iDrac is one). More contemporary IMM2 allows both cipher suites as well</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> This leads me to think that rcons is still somewhere hardwired to C3. We downloaded and patched IPMI.pm with the one from<span class="x_x_Apple-converted-space"> </span><a href="https://github.com/xcat2/xcat-core" id="LPlnk" class="x_x_x_OWAAutoLink" data-auth="NotApplicable" data-loopstyle="linkonly">https://github.com/xcat2/xcat-core</a> but the issue persists.</div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> However, I also don't understand exactly which system or xcat-specific components are involved in operation of goconserver or establishing an rcons connection to track down where the cipher suite is set</div> <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt"> <br> </div> <div id="x_x_x_Signature"> <div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt"><span style="background-color:rgb(255,255,255)">Cal Sawyer</span></div> <div style="font-family:Calibri,Helvetica,sans-serif; font-size:11pt; color:rgb(34,34,34)"> <span style="background-color:rgb(255,255,255)">ITS Research Platforms Manager</span></div> <div style="font-family:Calibri,Helvetica,sans-serif; font-size:11pt; color:rgb(34,34,34)"> <span style="background-color:rgb(255,255,255)">Queen Mary University of London</span></div> </div> </div> <span style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important">_______________________________________________</span><br style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <span style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important">xCAT-user mailing list</span><br style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <a href="mailto:xCA...@li..." style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px">xCA...@li...</a><br style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none"> <a href="https://lists.sourceforge.net/lists/listinfo/xcat-user" style="font-family:Menlo-Regular; font-size:11px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; orphans:auto; text-align:start; text-indent:0px; text-transform:none; white-space:normal; widows:auto; word-spacing:0px">https://lists.sourceforge.net/lists/listinfo/xcat-user</a></div> </blockquote> </div> <br> </div> </div> <span>_______________________________________________</span><br> <span>xCAT-user mailing list</span><br> <span>xCA...@li...</span><br> <span>https://lists.sourceforge.net/lists/listinfo/xcat-user</span><br> </div> </blockquote> </div> </div> <span>_______________________________________________</span><br><span>xCAT-user mailing list</span><br><span>xCA...@li...</span><br><span>https://lists.sourceforge.net/lists/listinfo/xcat-user</span><br></div></blockquote></body></html> |
Thanks for helping keep SourceForge clean.
X