From: <dav...@cn...> - 2013-04-17 21:31:42
|
Olivier, Finally had a chance to test from a client running beta8 to a server running beta8. Both client and server are running rhel 6.4 x86_64. - I prepared the images as both uyok and without and both worked. No problem with the getimage from the server. - I then attempted to load the client with the image I had created. I attempted this with both the standard kernel and the uyok. Both worked up to the point in the script when lvcreate was executed. At this point the load/system would hang(reset required). See the log below. To restore I loaded from a server running a slightly older version( systemimager-server-4.3.0-0.2.el6.noarch) which did not have this problem. Also note for reasons I have stated in the past I also modified UseYourOwnKernel.pm as follows : [root@wild1 130408]# diff /usr/lib/systemimager/perl/SystemImager/UseYourOwnKernel.pm UseYourOwnKernel.pm 152c152 < $cmd = qq(rsync -a --exclude=build --exclude=source ) . --- > $cmd = qq(rsync -aL --exclude=build --exclude=source ) . 159c159 < $cmd = qq(rsync -aR $module $staging_dir); --- > $cmd = qq(rsync -aLR $module $staging_dir); 222a223,233 > # > # Copy /lib/firmware file to initrd > # > # > if (-d "/lib/firmware") { > # copy firmware tree to new initrd. > $cmd = qq(rsync -aLR /lib/firmware $staging_dir); > !system( $cmd ) or die( "Couldn't $cmd." ); > > } > Log of failed boot : parted -s -- /dev/sda set 2 lvm on logger: logger: parted /dev/sda set 2 lvm on New partition table for /dev/sda: parted -s -- /dev/sda print Model: HP LOGICAL VOLUME (scsi) Disk /dev/sda: 300GB Sector size (logical/physical): 512B/512B Partition Table: msdos Disk Flags: Number Start End Size Type File system Flags 1 512B 1000MB 1000MB primary boot 2 1000MB 300GB 299GB primary lvm Load software RAID modules. Load device mapper driver (for LVM). Initializing partition /dev/sda2 for use by LVM. pvcreate -M2 -ff -y /dev/sda2 || shellout WARNING: Forcing physical volume creation on /dev/sda2 of volume group "rootvg" Physical volume "/dev/sda2" successfully created lvremove -f /dev/rootvg >/dev/null 2>&1 && vgremove rootvg >/dev/null 2>&1 vgcreate -M2 -l 0 -p 0 -s 32768K rootvg /dev/sda2 || shellout Volume group "rootvg" successfully created lvcreate -L16777216K -n LogVol01 rootvg || shellout David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 Email: Dav...@cn... ----- Forwarded by David Livingstone/LIVING03/CNR/CA on 2013/04/17 15:14 ----- From: dav...@cn... To: sis...@li... Date: 2013/04/10 15:56 Subject: Re: [sisuite-users] beta7 bug fixed => beta8 WAS: systemimager 4.3.0-0.7 available for testing Olivier, Thanks. That does it. I still need to test loading the image. I will let you know. David David K Livingstone CN Signals and Communications From: LAHAYE Olivier <oli...@ce...> To: "sis...@li..." <sis...@li...> Date: 2013/04/08 06:37 Subject: [sisuite-users] beta7 bug fixed => beta8 WAS: systemimager 4.3.0-0.7 available for testing Hi, The issue has been fixed. I wonder how it could work on V0.2. There were 2 bugs: One that I introduced when I wanted to match kernel 3.x kernels with x >2 But there was also a bug in initrd detection. the routine was unable to check for initramfs files. If no initrd file was available, the error should have triggered as well.... Anyway, It's hopefully fixed and should be available shortly for fedora, rhel-6 and debian-7-x86_64 soon here: http://svn.oscar.openclustergroup.org/repos/unstable/ The source rpm (and tarball) will be available here soon as well: http://svn.oscar.openclustergroup.org/pkgs/downloads/ -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR De : LAHAYE Olivier Date d'envoi : lundi 8 avril 2013 09:24 À : sis...@li... Objet : RE : [sisuite-users] systemimager 4.3.0-0.7 available for testing Hi, Thanks a lot for this report, I'll try to understand the issue ASAP. 0.2 has the same code as 0.7 (differences are on the initrd and boot packages which are very different). Regards, Olivier. -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR De : dav...@cn... [dav...@cn...] Date d'envoi : samedi 6 avril 2013 00:44 À : sis...@li... Objet : Re: [sisuite-users] systemimager 4.3.0-0.7 available for testing Olivier, I installed on a rhel 6.4 client and get the below error message when attempting to prepare the client. If I install 4.3.0-0.2 this does not happen. systemimager-common-4.3.0-0.7.el6.noarch systemimager-x86_64initrd_template-4.3.0-0.7.el6.noarch systemimager-client-4.3.0-0.7.el6.noarch - same error on vccs3 using --no-uyok and without - We get : - [root@mtl-vccs03d ~]# si_prepareclient --no-uyok --server 165.115.83.125 ... This client is ready to have its image retrieved. You must now run the "si_getimage" command on your imageserver. Automatically create configuration file for systemconfigurator: >> /etc/systemconfig/systemconfig.conf WARNING: unable to auto-detect kernel file! WARNING: coulnd't create file /etc/systemconfig/systemconfig.conf (needed by systemconfigurator) [root@mtl-vccs03d ~]# David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 Email: Dav...@cn... ----- Forwarded by David Livingstone/LIVING03/CNR/CA on 2013/04/05 16:40 ----- From: David Livingstone/LIVING03/CNR/CA To: sis...@li... Date: 2013/03/21 11:40 Subject: Re: [sisuite-users] systemimager 4.3.0-0.7 available for testing Olivier, Thanks ! I will download and test on rhel 6.x). BTW I am currently using your previous build(4.3.0-0.2 std kernel only) on rhel 6.x with the restrictions we have corresponded about. David David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 Email: Dav...@cn... From: LAHAYE Olivier <oli...@ce...> To: "sis...@li..." <sis...@li...> Date: 2013/03/20 10:17 Subject: [sisuite-users] systemimager 4.3.0-0.7 available for testing Hi, I've uploaded the rpms for systemimager beta version V4.3.0 (beta7) I've built it for fedora-17 and centos-6.3 They are available here: http://olivier.lahaye1.free.fr/OSCAR/repos/unstable/ Note that you can install the oscar-release rpm which will setup the yum.repo.d/oscar.repo. Usage notes: - The pre install script required to modprobe disk controlers is not required anymore. (leave comments in it) - the post install scripts (si_scripts.tar.bz2) are usefull for grub setup (systemconfigurator not yet ported for new grub, grub2 and other bootloaders and Network manager) Just comment everything in the pre_install script. Firmwares available in the image are those that can be built from the kernel source tree. No external firmware is provided yet (need to check EULA). Please keep in mind that this is a testing release. If you have a systemimager that is in production, don't upgrade). Happy testing. -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar _______________________________________________ sisuite-users mailing list sis...@li... https://lists.sourceforge.net/lists/listinfo/sisuite-users ------------------------------------------------------------------------------ Minimize network downtime and maximize team effectiveness. Reduce network management and security costs.Learn how to hire the most talented Cisco Certified professionals. Visit the Employer Resources Portal http://www.cisco.com/web/learning/employer_resources/index.html _______________________________________________ sisuite-users mailing list sis...@li... https://lists.sourceforge.net/lists/listinfo/sisuite-users ------------------------------------------------------------------------------ Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter _______________________________________________ sisuite-users mailing list sis...@li... https://lists.sourceforge.net/lists/listinfo/sisuite-users |
From: LAHAYE O. <oli...@ce...> - 2013-04-19 14:55:02
|
hi David, Thanks a lot for your report. Thanks also for the patch. It is not yet integrated because I want to have a deterministic way of managing firmwares. I don't want to end in a situation when errors occure because guy A had installed a package and guy B didn't. I think that the best way for the moment is to add command line switch to include system installed firmwares . By this way, the user will known that the problem can come from a missing firmware. For the L switch, I understand that it is needed for the firmware sync, but this triggers some problems elsewhere were files a copied twice instead of having a link and a file. using L switch is a quick hack but the image gets even bigger (already very big). I'm aware of both issues, and I'll find a solution. The freeze problem is more problematic. Did you try without using LVM? If it works, then it may be a bad lvm tools build (using system libs instead of initrd built libs..... I tryed to fix most of them, but lvm may be one of them. Best regards, PS: Right now, I'm working on debian systemimager oscar-packager. I'll be back soon. Olivier. -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR ________________________________ De : dav...@cn... [dav...@cn...] Date d'envoi : mercredi 17 avril 2013 23:31 À : sis...@li... Objet : Re: [sisuite-users] beta7 bug fixed => beta8 WAS: systemimager 4.3.0-0.7 available for testing Olivier, Finally had a chance to test from a client running beta8 to a server running beta8. Both client and server are running rhel 6.4 x86_64. - I prepared the images as both uyok and without and both worked. No problem with the getimage from the server. - I then attempted to load the client with the image I had created. I attempted this with both the standard kernel and the uyok. Both worked up to the point in the script when lvcreate was executed. At this point the load/system would hang(reset required). See the log below. To restore I loaded from a server running a slightly older version( systemimager-server-4.3.0-0.2.el6.noarch) which did not have this problem. Also note for reasons I have stated in the past I also modified UseYourOwnKernel.pm as follows : [root@wild1 130408]# diff /usr/lib/systemimager/perl/SystemImager/UseYourOwnKernel.pm UseYourOwnKernel.pm 152c152 < $cmd = qq(rsync -a --exclude=build --exclude=source ) . --- > $cmd = qq(rsync -aL --exclude=build --exclude=source ) . 159c159 < $cmd = qq(rsync -aR $module $staging_dir); --- > $cmd = qq(rsync -aLR $module $staging_dir); 222a223,233 > # > # Copy /lib/firmware file to initrd > # > # > if (-d "/lib/firmware") { > # copy firmware tree to new initrd. > $cmd = qq(rsync -aLR /lib/firmware $staging_dir); > !system( $cmd ) or die( "Couldn't $cmd." ); > > } > Log of failed boot : parted -s -- /dev/sda set 2 lvm on logger: logger: parted /dev/sda set 2 lvm on New partition table for /dev/sda: parted -s -- /dev/sda print Model: HP LOGICAL VOLUME (scsi) Disk /dev/sda: 300GB Sector size (logical/physical): 512B/512B Partition Table: msdos Disk Flags: Number Start End Size Type File system Flags 1 512B 1000MB 1000MB primary boot 2 1000MB 300GB 299GB primary lvm Load software RAID modules. Load device mapper driver (for LVM). Initializing partition /dev/sda2 for use by LVM. pvcreate -M2 -ff -y /dev/sda2 || shellout WARNING: Forcing physical volume creation on /dev/sda2 of volume group "rootvg" Physical volume "/dev/sda2" successfully created lvremove -f /dev/rootvg >/dev/null 2>&1 && vgremove rootvg >/dev/null 2>&1 vgcreate -M2 -l 0 -p 0 -s 32768K rootvg /dev/sda2 || shellout Volume group "rootvg" successfully created lvcreate -L16777216K -n LogVol01 rootvg || shellout David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 Email: Dav...@cn... ----- Forwarded by David Livingstone/LIVING03/CNR/CA on 2013/04/17 15:14 ----- From: dav...@cn... To: sis...@li... Date: 2013/04/10 15:56 Subject: Re: [sisuite-users] beta7 bug fixed => beta8 WAS: systemimager 4.3.0-0.7 available for testing ________________________________ Olivier, Thanks. That does it. I still need to test loading the image. I will let you know. David David K Livingstone CN Signals and Communications From: LAHAYE Olivier <oli...@ce...> To: "sis...@li..." <sis...@li...> Date: 2013/04/08 06:37 Subject: [sisuite-users] beta7 bug fixed => beta8 WAS: systemimager 4.3.0-0.7 available for testing ________________________________ Hi, The issue has been fixed. I wonder how it could work on V0.2. There were 2 bugs: One that I introduced when I wanted to match kernel 3.x kernels with x >2 But there was also a bug in initrd detection. the routine was unable to check for initramfs files. If no initrd file was available, the error should have triggered as well.... Anyway, It's hopefully fixed and should be available shortly for fedora, rhel-6 and debian-7-x86_64 soon here: http://svn.oscar.openclustergroup.org/repos/unstable/ The source rpm (and tarball) will be available here soon as well: http://svn.oscar.openclustergroup.org/pkgs/downloads/ -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR ________________________________ De : LAHAYE Olivier Date d'envoi : lundi 8 avril 2013 09:24 À : sis...@li... Objet : RE : [sisuite-users] systemimager 4.3.0-0.7 available for testing Hi, Thanks a lot for this report, I'll try to understand the issue ASAP. 0.2 has the same code as 0.7 (differences are on the initrd and boot packages which are very different). Regards, Olivier. -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR ________________________________ De : dav...@cn... [dav...@cn...] Date d'envoi : samedi 6 avril 2013 00:44 À : sis...@li... Objet : Re: [sisuite-users] systemimager 4.3.0-0.7 available for testing Olivier, I installed on a rhel 6.4 client and get the below error message when attempting to prepare the client. If I install 4.3.0-0.2 this does not happen. systemimager-common-4.3.0-0.7.el6.noarch systemimager-x86_64initrd_template-4.3.0-0.7.el6.noarch systemimager-client-4.3.0-0.7.el6.noarch - same error on vccs3 using --no-uyok and without - We get : - [root@mtl-vccs03d ~]# si_prepareclient --no-uyok --server 165.115.83.125 ... This client is ready to have its image retrieved. You must now run the "si_getimage" command on your imageserver. Automatically create configuration file for systemconfigurator: >> /etc/systemconfig/systemconfig.conf WARNING: unable to auto-detect kernel file! WARNING: coulnd't create file /etc/systemconfig/systemconfig.conf (needed by systemconfigurator) [root@mtl-vccs03d ~]# David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 Email: Dav...@cn... ----- Forwarded by David Livingstone/LIVING03/CNR/CA on 2013/04/05 16:40 ----- From: David Livingstone/LIVING03/CNR/CA To: sis...@li... Date: 2013/03/21 11:40 Subject: Re: [sisuite-users] systemimager 4.3.0-0.7 available for testing ________________________________ Olivier, Thanks ! I will download and test on rhel 6.x). BTW I am currently using your previous build(4.3.0-0.2 std kernel only) on rhel 6.x with the restrictions we have corresponded about. David David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 Email: Dav...@cn... From: LAHAYE Olivier <oli...@ce...> To: "sis...@li..." <sis...@li...> Date: 2013/03/20 10:17 Subject: [sisuite-users] systemimager 4.3.0-0.7 available for testing ________________________________ Hi, I've uploaded the rpms for systemimager beta version V4.3.0 (beta7) I've built it for fedora-17 and centos-6.3 They are available here: http://olivier.lahaye1.free.fr/OSCAR/repos/unstable/<http://olivier.lahaye1.free.fr/OSCAR/repos/unstable/> Note that you can install the oscar-release rpm which will setup the yum.repo.d/oscar.repo. Usage notes: - The pre install script required to modprobe disk controlers is not required anymore. (leave comments in it) - the post install scripts (si_scripts.tar.bz2<http://olivier.lahaye1.free.fr/RPMS/extra/si_scripts.tar.bz2>) are usefull for grub setup (systemconfigurator not yet ported for new grub, grub2 and other bootloaders and Network manager) Just comment everything in the pre_install script. Firmwares available in the image are those that can be built from the kernel source tree. No external firmware is provided yet (need to check EULA). Please keep in mind that this is a testing release. If you have a systemimager that is in production, don't upgrade). Happy testing. -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar _______________________________________________ sisuite-users mailing list sis...@li... https://lists.sourceforge.net/lists/listinfo/sisuite-users ------------------------------------------------------------------------------ Minimize network downtime and maximize team effectiveness. Reduce network management and security costs.Learn how to hire the most talented Cisco Certified professionals. Visit the Employer Resources Portal http://www.cisco.com/web/learning/employer_resources/index.html _______________________________________________ sisuite-users mailing list sis...@li... https://lists.sourceforge.net/lists/listinfo/sisuite-users ------------------------------------------------------------------------------ Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter _______________________________________________ sisuite-users mailing list sis...@li... https://lists.sourceforge.net/lists/listinfo/sisuite-users |
From: <dav...@cn...> - 2013-04-19 15:45:41
|
Olivier, Thanks for the reply. This is a truncated resend as the original was over the 40KB limit and is awaiting moderator approval ... So are you looking at two switches(one for firmware inclusion and one for link ?) The link is needed to handle situations like below - rhel6.4 with three kernels installed( 2.6.32-358.2.1.el6.x86_64 current one). As you can see below the drbd module is actually a link to the module directory when it was initially installed. Subsequent kernel updates just link back. Obvioulsy RH does this - not sure about Centos or others. [root@vccstest1 modules]# find /lib/modules -type l -exec ls -al {} \; lrwxrwxrwx 1 root root 5 Oct 7 2012 /lib/modules/2.6.32-279.el6.x86_64/source -> build lrwxrwxrwx 1 root root 58 Feb 14 11:39 /lib/modules/2.6.32-279.el6.x86_64/weak-updates/drbd/drbd.ko -> /lib/modules/2.6.32-279.14.1.el6.x86_64/extra/drbd/drbd.ko lrwxrwxrwx 1 root root 46 Oct 7 2012 /lib/modules/2.6.32-279.el6.x86_64/build -> ../../../usr/src/kernels/2.6.32-279.el6.x86_64 lrwxrwxrwx 1 root root 5 Dec 17 12:48 /lib/modules/2.6.32-279.14.1.el6.x86_64/source -> build lrwxrwxrwx 1 root root 51 Dec 17 12:48 /lib/modules/2.6.32-279.14.1.el6.x86_64/build -> ../../../usr/src/kernels/2.6.32-279.14.1.el6.x86_64 lrwxrwxrwx 1 root root 5 Mar 14 13:25 /lib/modules/2.6.32-358.2.1.el6.x86_64/source -> build lrwxrwxrwx 1 root root 58 Mar 14 13:25 /lib/modules/2.6.32-358.2.1.el6.x86_64/weak-updates/drbd/drbd.ko -> /lib/modules/2.6.32-279.14.1.el6.x86_64/extra/drbd/drbd.ko lrwxrwxrwx 1 root root 50 Mar 14 13:25 /lib/modules/2.6.32-358.2.1.el6.x86_64/build -> ../../../usr/src/kernels/2.6.32-358.2.1.el6.x86_64 [root@vccstest1 modules]# I agree a more deterministic way for firmware is needed - my hack was to copy ALL of /lib/firmware. At the time of uyok generation we should be able to be more selective. As per the lvcreate hang it definitely looks like a lvm tools issue(it did work successfully with a previous pkg). No I didn't try without lvm as the host I was testing with was lvm - have you or anyone else tested without lvm - it should be the same. Thanks again Ugly weather here with snow on the car this morning ... maybe I should give up on the bike and go back to the skis ! David David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 hi David, Thanks a lot for your report. Thanks also for the patch. It is not yet integrated because I want to have a deterministic way of managing firmwares. I don't want to end in a situation when errors occure because guy A had installed a package and guy B didn't. I think that the best way for the moment is to add command line switch to include system installed firmwares . By this way, the user will known that the problem can come from a missing firmware. For the L switch, I understand that it is needed for the firmware sync, but this triggers some problems elsewhere were files a copied twice instead of having a link and a file. using L switch is a quick hack but the image gets even bigger (already very big). I'm aware of both issues, and I'll find a solution. The freeze problem is more problematic. Did you try without using LVM? If it works, then it may be a bad lvm tools build (using system libs instead of initrd built libs..... I tryed to fix most of them, but lvm may be one of them. Best regards, PS: Right now, I'm working on debian systemimager oscar-packager. I'll be back soon. Olivier. -- Olivier LAHAYE CEA DRT/LIST/DCSI/DIR David K Livingstone CN Signals and Communications 10229 127 Avenue floor 2 Walker Operations East Building Edmonton, AB, T5E 0B9 Ph : 780 472-3959 Fax : 780 472-3046 Email: Dav...@cn... |