Menu
▾
▴
Re: [OSR-devel] Bug reports / fixes and iSCSI
|
From: Marc G. <gr...@at...> - 2007-10-10 13:30:19
|
On Wednesday 10 October 2007 14:59:25 Gordan Bobic wrote: > On Wed, 10 Oct 2007, Marc Grimme wrote: > >> 1) Python libraries assume python 2.3. RHEL5 (CentOS5 in my case) uses > >> python 2.4. That means that if this is intended for RHEL5, the libraries > >> should end up in /usr/lib/python2.4/site-packages/comoonics > >> At the moment, they end up in > >> /usr/lib/python2.3/site-packages/comoonics, which means they don't work. > > > > There should be a rhel5 channel available. It's not yet official but it > > proves to be quite stable. We are right now in the last steps before > > qa-ing. Use the following yum.repositories. > > > > [comoonics-preview] > > name=Packages for the comoonics shared root cluster > > baseurl=http://download.atix.de/yum/comoonics/redhat-el5/preview/noarch/ > > enabled=1 > > gpgcheck=1 > > gpgkey=http://download.atix.de/yum/comoonics/comoonics-RPM-GPG.key > > > > [comoonics-preview-i386] > > name=Packages for the comoonics shared root cluster > > baseurl=http://download.atix.de/yum/comoonics/redhat-el5/preview/$arch > > enabled=1 > > gpgcheck=1 > > gpgkey=http://download.atix.de/yum/comoonics/comoonics-RPM-GPG.key > > > > [comoonics-addons] > > name=Addon Packages for utilities > > baseurl=http://download.atix.de/yum/comoonics/redhat-el5/addons/noarch/ > > enabled=1 > > gpgcheck=1 > > gpgkey=http://download.atix.de/yum/comoonics/comoonics-RPM-GPG.key > > > > That will be anounced recently on www.opensharedroot.org. > > OK, that seems to solve the problem of el4 packages creeping in and > breaking things. :-) > > >> 2) When making the initrd: > >> > >> 2.1) Extracting rpms...Cannot find rpm "comoonics-cs". Skipping. > >> Cannot find rpm "GFS". Skipping. > >> Cannot find rpm "ccs". Skipping. > >> Cannot find rpm "dlm". Skipping. > >> Cannot find rpm "fence". Skipping. > >> Cannot find rpm "magma". Skipping. > >> Cannot find rpm "magma-plugins". Skipping. > >> Cannot find rpm "OpenIPMI-tools". Skipping. > >> > >> Where can these be found, and where should they be put for this step to > >> find them? > > > > Follow the instructions on > > http://www.opensharedroot.org/documentation/rhel5-gfs-shared-root-mini-ho > >wto > > I did. Nowhere does it manage yum installing packages GFS, ccs, dlm, > fence, magma, magma-plugins or OpenIPMI-tools. Hm. you still seem to have old depfiles. Remove the comoonics-bootimage rpms and delete /etc/comoonics/bootimage and reinstall. This should go away then: [root@axqa03_1 ~]# mkinitrd /boot/initrd_sr-2.6.18-52.el5xen.img 2.6.18-52.el5xen Extracting rpms...Cannot find rpm "comoonics-cs". Skipping. Cannot find rpm "OpenIPMI-tools". Skipping. [ OK ] Retrieving dependent files.../opt/atix/comoonics-bootimage/boot-scripts/etc/chroot-lib.sh: line 333: [: !=: unary operator expected found 4306 [ OK ] Copying files...cp: cannot stat `/etc/profile.d/krb5.csh': No such file or directory cp: cannot stat `/etc/profile.d/krb5.sh': No such file or directory cp: cannot stat `/etc/sysconfig/comoonics-chroot': No such file or directory [ OK ] Copying kernelmodules (2.6.18-52.el5xen)... [ OK ] builddate_file [ OK ] [ OK ] Post settings .. [ OK ] Cpio and compress.. [ OK ] Cleaning up (/tmp/initrd.mnt.G24645, )... [ OK ] -rw-r--r-- 1 root root 42731 Oct 10 14:42 /boot/initrd_sr-2.6.18-52.el5xen.img > > >> 2.2) Retrieving dependent > >> files.../opt/atix/comoonics-bootimage/boot-scripts/etc/chroot-lib.sh: > >> line 333: [: !=: unary operator expected > > > > you can ignore that. > > > >> found 3545 > >> > >> What is actually causing this? I looked at the script, and I have a > >> feeling it's caused by the '#' comparison, but I'm not sure. > > > > We are aware of that *warning* but you can savely ignore it. > > OK. Is it the '#' that kills it? What about "\#"? Mark? What do you think? > > >> 3) iSCSI - this doesn't appear to get included on the initrd. This is > >> kind of important. How do I add it, so that I can mount the SAN being > >> used for the shared GFS root? > > > > We did not implement it yet. Feel free to do it. Use the latest rpms and > > adapt the code. Latest HEAD rpms are attached. > > Please edit against them. And send either patches or the changed files > > directly to me. > > OK. Presumably, this would mean: > > 1) Install standard iscsi-initiator-utils rpm into the OSR initrd. yes. > 2) Copy the /etc/iscsi/iscsid.conf /var/lib/iscsi/* into the OSR initrd no the iscsid.conf should be created from cluster.conf. Because of the ip of the iscsi-source. It might be one server gets it root from on iscsi-device and another from another iscsi-device. Some customers have clusters with different roots for different nodes. > 3) Add iscsi and iscsid init scripts to the relevant run-level on OSR > initrd. there are no run-levels inside the initrd ;-( . So the starting has to be done manually within iscsi-lib and the iscsiLoad Function. > > On a separate note - the instructions say that /etc/sysconfig/network is > to be unshared. Yes. Because of the hostsname. > I think /etc/sysconfig/network-scripts should be unshared, > too, unless all IPs are assigned via DHCP - which may or may not be the > case. Although if they were assigned by DHCP, that would be kind of neat Yes, every ifcfg-eth? has to be hostdependent. Unless using dhcp. > because it would mean you can purely network boot them via PXE (even if > the initrd is 50MB+!). It once worked that customers had the ip=dhcp in the cluster.conf and it got its clusterip from a dhcp server. If you like give it a try. > > > Find more information here: > > http://www.opensharedroot.org/Members/marc/blog/comoonics-bootimage/conce > >pt-of-integrating-iscsi-support-to-latest-bootimage You should be able to > > add comments or just send me an email on what you think. > > Hmm. Do we need this specified in cluster.conf? > Are the rootsource, rootvolume and chrootenv tags the standard way to > achieve this? rootvolume has to be given always. It tells where to mount the rootfs from. rootsource is optional: I would use it for telling the cluster that the rootdevice itself is an iscsione and the ipadress is x.y.z. > > > If you need more bins or rpms included in the initrd (which I expect to > > be) have a look at /etc/comoonics/bootimage/files.initrd.d > > and /etc/comoonics/bootimage/rpms.initrd.d. > > Thanks for that. Do you envisage anything over and above what I listed > above to be required? I'm not quite up to speed on the cluster.conf stuff, > but would the 3 steps to get iSCSI going be sufficient to get the initrd > connectable to the SAN at least? Once it gets that far, even mounting the > root manually wouldn't be too bad. To do anything manually you can always use two or better three nice options at bootcmdline: com-debug: switches on debugging. com-step: adds steps to the bootprocess where you can jump into a shell with break and leave and continue the bootprocess with exit. com-expert: imediately starts a shell after initrd is loaded. > > Incidentally, how is the fencing/cluster stuff handled in the initrd? I > didn't notice cman being included. It is but RHEL5 has slightly different packages. > > > Have fun and thanks (hope you'll enjoy the open-sharedroot concept as > > much as we do) > > Thank you for responding, I appreciate it. > > Gordan Regards Marc. > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a browser. > Download your FREE copy of Splunk now >> http://get.splunk.com/ > _______________________________________________ > Open-sharedroot-devel mailing list > Ope...@li... > https://lists.sourceforge.net/lists/listinfo/open-sharedroot-devel -- Gruss / Regards, Marc Grimme Phone: +49-89 452 3538-14 http://www.atix.de/ http://www.open-sharedroot.org/ ** Visit us at LinuxWorld Conference & Expo 31.10. - 01.11.2007 in Jaarbeurs Utrecht - The Netherlands ATIX stand: Hall 9 / B 005 ** ATIX Informationstechnologie und Consulting AG Einsteinstr. 10 85716 Unterschleissheim Deutschland/Germany Phone: +49-89 452 3538-0 Fax: +49-89 990 1766-0 Registergericht: Amtsgericht Muenchen Registernummer: HRB 168930 USt.-Id.: DE209485962 Vorstand: Marc Grimme, Mark Hlawatschek, Thomas Merz (Vors.) Vorsitzender des Aufsichtsrats: Dr. Martin Buss |
