Menu
▾
▴
Re: [xcat-user] [-user] contribution : cfm like
|
From: Antoine M. <ant...@u-...> - 2010-03-31 15:14:42
|
Hello, yes I get the script from redbooks the last week, this script have more feature than xdcp. But my observations are : - no support for query - nodes are not synchronized concurrently - it take 350 seconds real for update 150 files and make 75 directories in 1 node (60 seconds with my script) - bug during my test : it run a xdcp to a node name "groupXY" for a file name myfile._groupXY (the test node is not a member of groupXY) - directory owners and permissions are not preserved Yes I will send you my script Antoine Migeon Université de Bourgogne Centre de Ressources Informatiques - Centre de Calcul tel : 03 80 39 52 70 Site du CCUB : http://www.u-bourgogne.fr/cri-ccub Le 03/31/10 16:10, Patrick Jaeger a écrit : > > Hi Guys > > on the Redbook Site there is a script with the similar fonctionnalities . > > you can look at : ftp://www.redbooks.ibm.com/redbooks/SG247766/ > > Antoine , if you can send your script to me , i forward this script to > another french xcat community at CRIHAN > > > _f_ <ftp://www.redbooks.ibm.com/redbooks/SG247766/> > > > > > > > Cordialement / Best Regards > ------------------------------------------------------------------------ > > *Patrick Jaëger* 17 Avenue De L'europe > HPC I/T Specialist SSIS Bois Colombes Cedex, 92275 > 0233AA France > Global Technology Services > Phone: +33-1-5875-2455 > Mobile: +33-6.7192.2077 > e-mail: pat...@fr... > > > > > > From: Antoine Migeon <ant...@u-...> > To: xca...@li... > Date: 31/03/2010 15:40 > Subject: Re: [xcat-user] [-user] contribution : cfm like > > > ------------------------------------------------------------------------ > > > > Thank you for your reply. > > Yes, I read the SyncList HowTo, but : > - I don't see .pre and .post feature > - synclist are too hard to maintain for many nodes, servers, groups, .... > - directory owners and permissions are not preserved > - xdcp can't query which nodes needs update > > Maybe I did not understand how xdcp work... > > > I tried cfm2xcat script (xcat 2.3.3), but I did not find or don't > understand how to use .pre and .post scripts. This script generate a > big synclist file, but it failed when I try the file with 'xdcp -F' : > if I remember correctly the script does not understand "( nodename )" . > > > To compare files between server and node, and to determine which files > must be updated, for each nodes my script write a second Perl script > which contain lines like : > --------------------------------------- > print "/cfmroot/etc/.\n" if(!-d '/etc' || (stat('/etc'))[2] != 16877 > || (stat('/etc'))[4] != 0 || (stat('/etc'))[5] != 0); > print "/cfmroot/etc/profile\n" if(!-f '/etc/profile' || > (stat('/etc/profile'))[2] != 33261 || (stat('/etc/profile'))[4] != 0 > || (stat('/etc/profile'))[5] != 0 || (stat('/etc/profile'))[7] != 1278 > || (stat('/etc/profile'))[9] != 1142243464); > --------------------------------------- > This second script is transferred to the node, then executed over ssh, > the main script read the output and record which files are out of date. > > This solution is not beautiful but it is simple and relatively > efficient (5 seconds real, for check 150 files and 75 directory in 1 > node). > > > Antoine > Antoine Migeon > Université de Bourgogne > Centre de Ressources Informatiques - Centre de Calcul > > tel : 03 80 39 52 70 > Site du CCUB : _http://www.u-bourgogne.fr/cri-ccub_ > > > Le 03/31/10 13:16, Lissa Valletta a écrit : > > We have provide a cfm2xcat migration script that will convert you > entire CFM setup on CSM, to files that are usable by the xdcp -F > <sysclist> feature. Did you see all the options available for > syncing files in the SyncList HowTo > :_http://xcat.svn.sourceforge.net/viewvc/xcat/xcat-core/trunk/xCAT-client/share/doc/xCAT2SyncFilesHowTo.pdf_ > > > I would like to understand the features that are missing in xdcp that > you need? See what the cfm2xcat script does, it does handle > somethings like .group extentions and it will copy the .pre and .post > scripts to the nodes, although it does not do all the extra work that > cfmupdate did to automatically run them. I would be interested in > your design there, because we required a CFM client on the nodes to > handle this function in CSM, and we cannot put xCAT code on the nodes. > > I think the experience you have doing this and analyzing our current > file sync support is invaluable to us, but we really need to build > on our current design so if you would like to open a Feature to tell > us what we are missing, it would really help. > > Using the /cfmroot directory for syncfiles as in CSM, does not fit > into the current design for syncing files to the node during install > or running updatenode. We had hoped the migration script would help > to ease the move of the CSM CFM users data to the equivalent xCAT > data paths. > > As far as integrating it with xCAT, it could be put with our other > shared tools in /opt/xcat/share/xcat/tools. > > Lissa K. Valletta > 414/3-8 > Poughkeepsie, NY 12601 > (tie 293) 433-3102 > > > > From: Antoine Migeon _<ant...@u-...>_ > <mailto:ant...@u-...> > To: _xc...@li..._ > <mailto:xca...@li...> > Date: 03/31/2010 06:45 AM > Subject: [xcat-user] contribution : cfm like > > > > ------------------------------------------------------------------------ > > > > Hello, > > Because I need to migrate from CSM to xCat, and because xdcp do not > have enough features, I wrote a Perl script that has the same > functionality as "cfmupdatenode" (IBM CSM). > Here are the features : > > Synchronise and copy files from /xcfmroot to nodes. > Preserve permissions, owners and mtime for files and directories. > Symbolic links are not transferred, the target link will be transferred. > Support pre and post execution scripts (suffixed .pre et .post). > Support for nodes suffixes, like ._node or ._group for files and > directories. > By default, compares files and synchronize only what is necessary. > Work in parallel. > > -a --all > For all nodes > -b --backup > Preserve existing configuration file (on nodes) as > filename.OLD > -d --dummy > Create scripts but do nothing in nodes > -f --filename <file> > Only update the given filename(s), separated by comma > -F --force > Force synchronization without verification > -M --max-child-process <integer> > Set the number of nodes to update concurrently, default=32 > -n --node_list <node> > For specified nodes (format : see noderange(3)) > -q --query > Only check if files need to be synchronized > -v --verbose > > > Like xdcp, it use rsync for final transfer. > At this time, it does not support diskless or rootimg path, and not > support SN. > My script work with xCat, use several modules (noderange), but it is > not really integrated and does not respect the xCat Developer Guide > (no client/server model for example). > > Are you interested in this script ? > Is there a chance that my script will be integrated in xCat project ? > If yes, I can work and adapt my script to xCat Developper Guide. > > > Antoine > > -- > Antoine Migeon > Université de Bourgogne > Centre de Ressources Informatiques - Centre de Calcul > > tel : 03 80 39 52 70 > Site du CCUB : _http://www.u-bourgogne.fr/cri-ccub_ > <http://u-bourgogne.fr/cri-ccub> > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta._ > __http://p.sf.net/sfu/intel-sw-dev________________________________________________ > xCAT-user mailing list_ > __x...@li..._ > <mailto:xCA...@li...>_ > __https://lists.sourceforge.net/lists/listinfo/xcat-user_ > > > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > _http://p.sf.net/sfu/intel-sw-dev_ > > > _______________________________________________ > xCAT-user mailing list > _xC...@li..._ <mailto:xCA...@li...> > _https://lists.sourceforge.net/lists/listinfo/xcat-user_ > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev_______________________________________________ > xCAT-user mailing list > xCA...@li... > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > > > Sauf indication contraire ci-dessus:/ Unless stated otherwise above: > Compagnie IBM France > Siege Social : 17 avenue de l'Europe, 92275 Bois-Colombes Cedex > RCS Nanterre 552 118 465 > Forme Sociale : S.A.S. > Capital Social : 611.451.766,20 EUR > SIREN/SIRET : 552 118 465 03644 > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > > > _______________________________________________ > xCAT-user mailing list > xCA...@li... > https://lists.sourceforge.net/lists/listinfo/xcat-user > |