From: Jarrod J. <jjo...@le...> - 2015-05-19 18:20:30
|
Interesting, what is the output of lspci and lspci -n? For what it is worth, /opt/xcat/share/xcat/netboot/genesis/x86_64/fs/etc/udev/rules.d/98-mlx.rules is the mechanism that is supposed to load the mellanox Ethernet driver since mlx4_core instead of mlx4_en hooks the device. Jarrod Johnson HPC Systems Management Architect Lenovo -----Original Message----- From: Christopher J. Walker [mailto:C.J...@qm...] Sent: Tuesday, May 19, 2015 1:50 PM To: xca...@li... Subject: [xcat-user] xcat genesis kernel and mellanox ethernet cards I seem to have run into: http://sourceforge.net/p/xcat/bugs/4578/ but for x86_64 - which I don't quite understand as that implies it has been fixed. If I plug the mellanox ConnectX-3 card in and try to do node discovery, the node hangs with the following prompt on the screen: Waiting for device with address f4:52:14:0b:15:e1 to appear If I unplug the network cable (and 40->10 adapter) from the card, then the genesis kernel boots. If I then plug the network in and do: [root@frontend5 ~]# lsmod | grep mlx mlx4_core 225805 0 [root@frontend5 ~]# ip link show Doesn't show the network card, however: however: [root@frontend5 ~]# modprobe mlx4_en 11: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000 link/ether f4:52:14:8a:ef:11 brd ff:ff:ff:ff:ff:ff Does. I think what's happening is that although the mlx4_core driver is being loaded, the mlx4_en isn't - and having pxe/uefi network booted from the card, it can't see it - hence the node discovery process hanging. Any thoughts about how I'd fix this? Chris ------------------------------------------------------------------------------ One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y _______________________________________________ xCAT-user mailing list xCA...@li... https://lists.sourceforge.net/lists/listinfo/xcat-user |