Thread: [SSI-devel] About Lustre 1.2.x for OpenSSI
Brought to you by:
brucewalker,
rogertsang
From: <wor...@on...> - 2005-03-14 15:46:29
|
Clusterfs Inc. had open their lustre 1.2.4 for public. It had a lot of feature enhancement. When will release Lustre 1.2.x for OpenSSI? sincerely |
From: Jaideep D. <Jai...@hp...> - 2005-03-14 22:58:08
|
Thanks for letting us know that 1.2.4 version for lustre has been made public. I am not sure how much of a demand there is for lustre currently. As a result, unfortunately it might be some time before I get to working on a release for lustre 1.2.4 on OpenSSI. You are welcome to try and adapt it. The current version of lustre on OpenSSI is 1.0.4 and we had to make a few changes to adapt it to OpenSSI. You should be able to figure those by doing a diff on the original lustre 1.0.4 package and the changed lustre package that we ship with OpenSSI. Let me know if you do intend to work on it and maybe I can help you. Jai. wor...@on... wrote: > Clusterfs Inc. had open their lustre 1.2.4 for public. > It had a lot of feature enhancement. > When will release Lustre 1.2.x for OpenSSI? > > sincerely > |
From: Roger T. <rog...@gm...> - 2005-03-15 04:15:17
|
> I am not sure how much of a demand there is for lustre currently. As a > result, > unfortunately it might be some time before I get to working on a release > for > lustre 1.2.4 on OpenSSI. > Well you've got me too. There will be more demand in some form if someone makes more "noise". I'm willing to help out with making Lustre 1.2.4 work on SSI as this version adds zero-config, liblustre, and HA MDS/OSS which is somewhat more attractive than 1.0.4 and in my opinion further compliments the goals of SSI. I'm sure others like me have been waiting for 1.2.x to come out before giving it more thought. As we know Lustre guarantees IO and metadata atomicity just like GFS (see below). So it seems possible to consider mounting Lustre CFS parallel as we already do GFS which hopefully will boost CFS chard performance - John? Come to thought if we can't CFS mount Lustre parallel there's no point pursuing this further in SSI. I'll do a zero-config SSI cluster using HA Lustre on channel bonded DRBD clusters with the same auto-recovery manager that Lustre 1.4.x is coming out with. This doesn't seem hard to setup as long as the software works as advertised :p "Lustre's network protocols were designed from the beginning to be completely recoverable. All transaction state is retained until the data is safely on disk, which allows Lustre to replay any lost operations if a server is rebooted or loses power. Even if a server fails while applications are using the file system, Lustre guarantees coherent data and metadata, and applications continue uninterrupted." http://www.clusterfs.com/compare.html#recovery -Roger |
From: Roger T. <rog...@gm...> - 2005-03-15 04:21:19
|
> parallel as we already do GFS which hopefully will boost CFS chard > performance - John? Come to thought if we can't CFS mount Lustre > parallel there's no point pursuing this further in SSI. > uh.. think again maybe we don't need CFS for Lustre so nevermind that comment. -Roger |
From: Jaideep D. <Jai...@hp...> - 2005-03-17 05:40:56
|
Ok. So I decided to give it a quick shot and see how painful it was going to support 1.2.4. I was expecting that there would be a lot of patch conflicts. But I have been able to compile the kernel (with all the lustre 1.2.4 patches) successfully. The lustre packages have been compiled as well. I will do some rudimentary testing on Monday when I am back at work. We should be able to have lustre 1.2.4 package for OpenSSI next week. Jai. Roger Tsang wrote: >>I am not sure how much of a demand there is for lustre currently. As a >>result, >>unfortunately it might be some time before I get to working on a release >>for >>lustre 1.2.4 on OpenSSI. >> >> >> > >Well you've got me too. There will be more demand in some form if >someone makes more "noise". > >I'm willing to help out with making Lustre 1.2.4 work on SSI as this >version adds zero-config, liblustre, and HA MDS/OSS which is somewhat >more attractive than 1.0.4 and in my opinion further compliments the >goals of SSI. I'm sure others like me have been waiting for 1.2.x to >come out before giving it more thought. > >As we know Lustre guarantees IO and metadata atomicity just like GFS >(see below). So it seems possible to consider mounting Lustre CFS >parallel as we already do GFS which hopefully will boost CFS chard >performance - John? Come to thought if we can't CFS mount Lustre >parallel there's no point pursuing this further in SSI. > >I'll do a zero-config SSI cluster using HA Lustre on channel bonded >DRBD clusters with the same auto-recovery manager that Lustre 1.4.x is >coming out with. This doesn't seem hard to setup as long as the >software works as advertised :p > >"Lustre's network protocols were designed from the beginning to be >completely recoverable. All transaction state is retained until the >data is safely on disk, which allows Lustre to replay any lost >operations if a server is rebooted or loses power. > >Even if a server fails while applications are using the file system, >Lustre guarantees coherent data and metadata, and applications >continue uninterrupted." >http://www.clusterfs.com/compare.html#recovery > > >-Roger > > > |
From: Jaideep D. <Jai...@hp...> - 2005-03-23 16:29:35
|
I am currently trying to pin down a memory leak which is eating up a lot of memory. Will have a patch by later today hopefully. Jai. Jaideep Dharap wrote: > Ok. So I decided to give it a quick shot and see how painful it was > going to support 1.2.4. > I was expecting that there would be a lot of patch conflicts. > > But I have been able to compile the kernel (with all the lustre 1.2.4 > patches) > successfully. The lustre packages have been compiled as well. I will > do some rudimentary > testing on Monday when I am back at work. > We should be able to have lustre 1.2.4 package for OpenSSI next week. > Jai. > > Roger Tsang wrote: > >>> I am not sure how much of a demand there is for lustre currently. As a >>> result, >>> unfortunately it might be some time before I get to working on a >>> release >>> for >>> lustre 1.2.4 on OpenSSI. >>> >>> >> >> >> Well you've got me too. There will be more demand in some form if >> someone makes more "noise". >> >> I'm willing to help out with making Lustre 1.2.4 work on SSI as this >> version adds zero-config, liblustre, and HA MDS/OSS which is somewhat >> more attractive than 1.0.4 and in my opinion further compliments the >> goals of SSI. I'm sure others like me have been waiting for 1.2.x to >> come out before giving it more thought. >> >> As we know Lustre guarantees IO and metadata atomicity just like GFS >> (see below). So it seems possible to consider mounting Lustre CFS >> parallel as we already do GFS which hopefully will boost CFS chard >> performance - John? Come to thought if we can't CFS mount Lustre >> parallel there's no point pursuing this further in SSI. >> >> I'll do a zero-config SSI cluster using HA Lustre on channel bonded >> DRBD clusters with the same auto-recovery manager that Lustre 1.4.x is >> coming out with. This doesn't seem hard to setup as long as the >> software works as advertised :p >> >> "Lustre's network protocols were designed from the beginning to be >> completely recoverable. All transaction state is retained until the >> data is safely on disk, which allows Lustre to replay any lost >> operations if a server is rebooted or loses power. >> >> Even if a server fails while applications are using the file system, >> Lustre guarantees coherent data and metadata, and applications >> continue uninterrupted." >> http://www.clusterfs.com/compare.html#recovery >> >> >> -Roger >> >> >> > > > > > > ------------------------------------------------------- > SF email is sponsored by - The IT Product Guide > Read honest & candid reviews on hundreds of IT Products from real users. > Discover which products truly live up to the hype. Start reading now. > http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click > _______________________________________________ > ssic-linux-devel mailing list > ssi...@li... > https://lists.sourceforge.net/lists/listinfo/ssic-linux-devel > |
From: Jaideep D. <Jai...@hp...> - 2005-03-24 03:13:53
|
Unfortunately, I havent had any success on pinning down it yet. Will let you guys know as soon as I have something. Jaideep Dharap wrote: > I am currently trying to pin down a memory leak which is eating up a > lot of memory. Will have > a patch by later today hopefully. > Jai. > > Jaideep Dharap wrote: > >> Ok. So I decided to give it a quick shot and see how painful it was >> going to support 1.2.4. >> I was expecting that there would be a lot of patch conflicts. >> >> But I have been able to compile the kernel (with all the lustre 1.2.4 >> patches) >> successfully. The lustre packages have been compiled as well. I will >> do some rudimentary >> testing on Monday when I am back at work. >> We should be able to have lustre 1.2.4 package for OpenSSI next week. >> Jai. >> >> Roger Tsang wrote: >> >>>> I am not sure how much of a demand there is for lustre currently. As a >>>> result, >>>> unfortunately it might be some time before I get to working on a >>>> release >>>> for >>>> lustre 1.2.4 on OpenSSI. >>>> >>>> >>> >>> >>> >>> Well you've got me too. There will be more demand in some form if >>> someone makes more "noise". >>> >>> I'm willing to help out with making Lustre 1.2.4 work on SSI as this >>> version adds zero-config, liblustre, and HA MDS/OSS which is somewhat >>> more attractive than 1.0.4 and in my opinion further compliments the >>> goals of SSI. I'm sure others like me have been waiting for 1.2.x to >>> come out before giving it more thought. >>> >>> As we know Lustre guarantees IO and metadata atomicity just like GFS >>> (see below). So it seems possible to consider mounting Lustre CFS >>> parallel as we already do GFS which hopefully will boost CFS chard >>> performance - John? Come to thought if we can't CFS mount Lustre >>> parallel there's no point pursuing this further in SSI. >>> >>> I'll do a zero-config SSI cluster using HA Lustre on channel bonded >>> DRBD clusters with the same auto-recovery manager that Lustre 1.4.x is >>> coming out with. This doesn't seem hard to setup as long as the >>> software works as advertised :p >>> >>> "Lustre's network protocols were designed from the beginning to be >>> completely recoverable. All transaction state is retained until the >>> data is safely on disk, which allows Lustre to replay any lost >>> operations if a server is rebooted or loses power. >>> >>> Even if a server fails while applications are using the file system, >>> Lustre guarantees coherent data and metadata, and applications >>> continue uninterrupted." >>> http://www.clusterfs.com/compare.html#recovery >>> >>> >>> -Roger >>> >>> >>> >> >> >> >> >> >> ------------------------------------------------------- >> SF email is sponsored by - The IT Product Guide >> Read honest & candid reviews on hundreds of IT Products from real users. >> Discover which products truly live up to the hype. Start reading now. >> http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click >> _______________________________________________ >> ssic-linux-devel mailing list >> ssi...@li... >> https://lists.sourceforge.net/lists/listinfo/ssic-linux-devel >> > > > > |
From: Jaideep D. <Jai...@hp...> - 2005-03-30 03:38:04
|
The Lustre version 1.2.4 is available for OpenSSI for Fedora Core. Te kernel and the lustre package has to be built from source currently. The next release for Fedora Core should have the rpms (not sure when the next release will be though) Instructions are available at: http://www.openssi.org/contrib/lustre/lustre-1.2.4-Howto Let me know if you seen any problems. Jai. Jaideep Dharap wrote: > Unfortunately, I havent had any success on pinning down it yet. Will > let you guys know as soon > as I have something. > > Jaideep Dharap wrote: > >> I am currently trying to pin down a memory leak which is eating up a >> lot of memory. Will have >> a patch by later today hopefully. >> Jai. >> >> Jaideep Dharap wrote: >> >>> Ok. So I decided to give it a quick shot and see how painful it was >>> going to support 1.2.4. >>> I was expecting that there would be a lot of patch conflicts. >>> >>> But I have been able to compile the kernel (with all the lustre >>> 1.2.4 patches) >>> successfully. The lustre packages have been compiled as well. I will >>> do some rudimentary >>> testing on Monday when I am back at work. >>> We should be able to have lustre 1.2.4 package for OpenSSI next week. >>> Jai. >>> >>> Roger Tsang wrote: >>> >>>>> I am not sure how much of a demand there is for lustre currently. >>>>> As a >>>>> result, >>>>> unfortunately it might be some time before I get to working on a >>>>> release >>>>> for >>>>> lustre 1.2.4 on OpenSSI. >>>>> >>>>> >>>> >>>> >>>> >>>> >>>> Well you've got me too. There will be more demand in some form if >>>> someone makes more "noise". >>>> >>>> I'm willing to help out with making Lustre 1.2.4 work on SSI as this >>>> version adds zero-config, liblustre, and HA MDS/OSS which is somewhat >>>> more attractive than 1.0.4 and in my opinion further compliments the >>>> goals of SSI. I'm sure others like me have been waiting for 1.2.x to >>>> come out before giving it more thought. >>>> >>>> As we know Lustre guarantees IO and metadata atomicity just like GFS >>>> (see below). So it seems possible to consider mounting Lustre CFS >>>> parallel as we already do GFS which hopefully will boost CFS chard >>>> performance - John? Come to thought if we can't CFS mount Lustre >>>> parallel there's no point pursuing this further in SSI. >>>> >>>> I'll do a zero-config SSI cluster using HA Lustre on channel bonded >>>> DRBD clusters with the same auto-recovery manager that Lustre 1.4.x is >>>> coming out with. This doesn't seem hard to setup as long as the >>>> software works as advertised :p >>>> >>>> "Lustre's network protocols were designed from the beginning to be >>>> completely recoverable. All transaction state is retained until the >>>> data is safely on disk, which allows Lustre to replay any lost >>>> operations if a server is rebooted or loses power. >>>> >>>> Even if a server fails while applications are using the file system, >>>> Lustre guarantees coherent data and metadata, and applications >>>> continue uninterrupted." >>>> http://www.clusterfs.com/compare.html#recovery >>>> >>>> >>>> -Roger >>>> >>>> >>>> >>> >>> >>> >>> >>> >>> ------------------------------------------------------- >>> SF email is sponsored by - The IT Product Guide >>> Read honest & candid reviews on hundreds of IT Products from real >>> users. >>> Discover which products truly live up to the hype. Start reading now. >>> http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click >>> _______________________________________________ >>> ssic-linux-devel mailing list >>> ssi...@li... >>> https://lists.sourceforge.net/lists/listinfo/ssic-linux-devel >>> >> >> >> >> > > > > |
From: Roger T. <rog...@gm...> - 2005-03-30 21:31:46
|
I can't seem to access http://openssi.org/contrib/lustre/lustre-Root/lconf On Tue, 29 Mar 2005 19:37:52 -0800, Jaideep Dharap <Jai...@hp...> wrote: > > The Lustre version 1.2.4 is available for OpenSSI for Fedora Core. Te > kernel and the lustre package has to be built from source currently. The > next release for Fedora Core should have the rpms (not sure when the > next release will be > though) > > Instructions are available at: > http://www.openssi.org/contrib/lustre/lustre-1.2.4-Howto > > Let me know if you seen any problems. > Jai. > > Jaideep Dharap wrote: > > > Unfortunately, I havent had any success on pinning down it yet. Will > > let you guys know as soon > > as I have something. > > > > Jaideep Dharap wrote: > > > >> I am currently trying to pin down a memory leak which is eating up a > >> lot of memory. Will have > >> a patch by later today hopefully. > >> Jai. > >> > >> Jaideep Dharap wrote: > >> > >>> Ok. So I decided to give it a quick shot and see how painful it was > >>> going to support 1.2.4. > >>> I was expecting that there would be a lot of patch conflicts. > >>> > >>> But I have been able to compile the kernel (with all the lustre > >>> 1.2.4 patches) > >>> successfully. The lustre packages have been compiled as well. I will > >>> do some rudimentary > >>> testing on Monday when I am back at work. > >>> We should be able to have lustre 1.2.4 package for OpenSSI next week. > >>> Jai. > >>> > >>> Roger Tsang wrote: > >>> > >>>>> I am not sure how much of a demand there is for lustre currently. > >>>>> As a > >>>>> result, > >>>>> unfortunately it might be some time before I get to working on a > >>>>> release > >>>>> for > >>>>> lustre 1.2.4 on OpenSSI. > >>>>> > >>>>> > >>>> > >>>> > >>>> > >>>> > >>>> Well you've got me too. There will be more demand in some form if > >>>> someone makes more "noise". > >>>> > >>>> I'm willing to help out with making Lustre 1.2.4 work on SSI as this > >>>> version adds zero-config, liblustre, and HA MDS/OSS which is somewhat > >>>> more attractive than 1.0.4 and in my opinion further compliments the > >>>> goals of SSI. I'm sure others like me have been waiting for 1.2.x to > >>>> come out before giving it more thought. > >>>> > >>>> As we know Lustre guarantees IO and metadata atomicity just like GFS > >>>> (see below). So it seems possible to consider mounting Lustre CFS > >>>> parallel as we already do GFS which hopefully will boost CFS chard > >>>> performance - John? Come to thought if we can't CFS mount Lustre > >>>> parallel there's no point pursuing this further in SSI. > >>>> > >>>> I'll do a zero-config SSI cluster using HA Lustre on channel bonded > >>>> DRBD clusters with the same auto-recovery manager that Lustre 1.4.x is > >>>> coming out with. This doesn't seem hard to setup as long as the > >>>> software works as advertised :p > >>>> > >>>> "Lustre's network protocols were designed from the beginning to be > >>>> completely recoverable. All transaction state is retained until the > >>>> data is safely on disk, which allows Lustre to replay any lost > >>>> operations if a server is rebooted or loses power. > >>>> > >>>> Even if a server fails while applications are using the file system, > >>>> Lustre guarantees coherent data and metadata, and applications > >>>> continue uninterrupted." > >>>> http://www.clusterfs.com/compare.html#recovery > >>>> > >>>> > >>>> -Roger > >>>> > >>>> > >>>> > >>> > >>> > >>> > >>> > >>> > >>> ------------------------------------------------------- > >>> SF email is sponsored by - The IT Product Guide > >>> Read honest & candid reviews on hundreds of IT Products from real > >>> users. > >>> Discover which products truly live up to the hype. Start reading now. > >>> http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click > >>> _______________________________________________ > >>> ssic-linux-devel mailing list > >>> ssi...@li... > >>> https://lists.sourceforge.net/lists/listinfo/ssic-linux-devel > >>> > >> > >> > >> > >> > > > > > > > > > > |
From: John B. <joh...@hp...> - 2005-03-30 22:14:51
|
Roger Tsang wrote: > I can't seem to access http://openssi.org/contrib/lustre/lustre-Root/lconf > > It's fixed. John Byrne <...snipped...> |
From: Roger T. <rog...@gm...> - 2005-03-31 10:53:16
|
On Tue, 29 Mar 2005 19:37:52 -0800, Jaideep Dharap <Jai...@hp...> wrote: > > The Lustre version 1.2.4 is available for OpenSSI for Fedora Core. Te > kernel and the lustre package has to be built from source currently. The > next release for Fedora Core should have the rpms (not sure when the > next release will be > though) > > Instructions are available at: > http://www.openssi.org/contrib/lustre/lustre-1.2.4-Howto > > Let me know if you seen any problems. > Jai. > So far this is what I have done. Update to OPENSSI-FC-1-2-STABLE branch. Replace the old lustre patch inside kernel.patch/commons/ with your lustre-1.2.4-ssi.patch. Then do make kernel.rpm in openssi directory. <snip> User address space size (3GB, 2GB, 1GB) [3GB] (NEW) Sorry, no help available for this option yet. User address space size (3GB, 2GB, 1GB) [3GB] (NEW) Sorry, no help available for this option yet. User address space size (3GB, 2GB, 1GB) [3GB] (NEW) Sorry, no help available for this option yet. User address space size (3GB, 2GB, 1GB) [3GB] (NEW) Sorry, no help available for this option yet. User address space size (3GB, 2GB, 1GB) [3GB] (NEW) Sorry, no help available for this option yet. User address space size (3GB, 2GB, 1GB) [3GB] (NEW) Sorry, no help available for this option yet. User address space size (3GB, 2GB, 1GB) [3GB] (NEW) make: *** wait: No child processes. Stop. make: *** Waiting for unfinished jobs.... make: *** wait: No child processes. Stop. [root@node1 openssi]# make[1]: *** [oldconfig_nonint] Error 1 -Roger |
From: Brian J. W. <Bri...@hp...> - 2005-03-31 20:17:50
|
Roger Tsang wrote: > Then do make kernel.rpm in openssi directory. > > <snip> > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > Sorry, no help available for this option yet. > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > Sorry, no help available for this option yet. > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > Sorry, no help available for this option yet. > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > Sorry, no help available for this option yet. > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > Sorry, no help available for this option yet. > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > Sorry, no help available for this option yet. > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) make: *** wait: No > child processes. Stop. > make: *** Waiting for unfinished jobs.... > make: *** wait: No child processes. Stop. > [root@node1 openssi]# make[1]: *** [oldconfig_nonint] Error 1 Sounds like a config file problem. Run `make fullkern', copy openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config to linux-ssi/.config, cd into linux-ssi, and run `make oldconfig'. It'll ask you the above questions and whatever else it needs answered. Then copy linux-ssi/.config back to openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config, delete linux-ssi/, cd into openssi, and run `make kernel.rpm'. It should work now. As a final step, can you compress your updated config file and reply with it? Jai will add it to his Lustre 1.2.4 package on OpenSSI.org, so that others don't need to do this. Thanks and regards, Brian |
From: Roger T. <rog...@gm...> - 2005-04-01 00:51:10
Attachments:
kernel-ssi-2.4.22-i686-smp.config.gz
|
I did a make menuconfig instead of oldconfig. make kernel.rpm completes. I've attached the .config. -Roger On Thu, 31 Mar 2005 12:15:13 -0800, Brian J. Watson <Bri...@hp...> wrote: > Roger Tsang wrote: > > Then do make kernel.rpm in openssi directory. > > > > <snip> > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > Sorry, no help available for this option yet. > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > Sorry, no help available for this option yet. > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > Sorry, no help available for this option yet. > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > Sorry, no help available for this option yet. > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > Sorry, no help available for this option yet. > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > Sorry, no help available for this option yet. > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) make: *** wait: No > > child processes. Stop. > > make: *** Waiting for unfinished jobs.... > > make: *** wait: No child processes. Stop. > > [root@node1 openssi]# make[1]: *** [oldconfig_nonint] Error 1 > > Sounds like a config file problem. Run `make fullkern', copy > openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config to > linux-ssi/.config, cd into linux-ssi, and run `make oldconfig'. It'll > ask you the above questions and whatever else it needs answered. > > Then copy linux-ssi/.config back to > openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config, delete > linux-ssi/, cd into openssi, and run `make kernel.rpm'. It should work now. > > As a final step, can you compress your updated config file and reply > with it? Jai will add it to his Lustre 1.2.4 package on OpenSSI.org, so > that others don't need to do this. > > Thanks and regards, > > Brian > |
From: Brian J. W. <Bri...@hp...> - 2005-04-01 03:17:56
|
Jai- Be sure you run `make oldconfig' on Roger's config file before bundling it with your Lustre 1.2.4 stuff. It has a different output format than `make menuconfig', and it's the format we use for the config files in openssi/kernel.configs. Thanks, Brian Roger Tsang wrote: > I did a make menuconfig instead of oldconfig. make kernel.rpm > completes. I've attached the .config. > > -Roger |
From: Roger T. <rog...@gm...> - 2005-08-06 10:04:41
|
Hi Jaideep/John, How is the Lustre patch coming along for the OPENSSI-FC branch (kernel-2.6)= ? -Roger On 3/29/05, Jaideep Dharap <Jai...@hp...> wrote: >=20 > The Lustre version 1.2.4 is available for OpenSSI for Fedora Core. Te > kernel and the lustre package has to be built from source currently. The > next release for Fedora Core should have the rpms (not sure when the > next release will be > though) >=20 > Instructions are available at: > http://www.openssi.org/contrib/lustre/lustre-1.2.4-Howto >=20 > Let me know if you seen any problems. > Jai. >=20 > Jaideep Dharap wrote: >=20 > > Unfortunately, I havent had any success on pinning down it yet. Will > > let you guys know as soon > > as I have something. > > > > Jaideep Dharap wrote: > > > >> I am currently trying to pin down a memory leak which is eating up a > >> lot of memory. Will have > >> a patch by later today hopefully. > >> Jai. > >> > >> Jaideep Dharap wrote: > >> > >>> Ok. So I decided to give it a quick shot and see how painful it was > >>> going to support 1.2.4. > >>> I was expecting that there would be a lot of patch conflicts. > >>> > >>> But I have been able to compile the kernel (with all the lustre > >>> 1.2.4 patches) > >>> successfully. The lustre packages have been compiled as well. I will > >>> do some rudimentary > >>> testing on Monday when I am back at work. > >>> We should be able to have lustre 1.2.4 package for OpenSSI next week. > >>> Jai. > >>> > >>> Roger Tsang wrote: > >>> > >>>>> I am not sure how much of a demand there is for lustre currently. > >>>>> As a > >>>>> result, > >>>>> unfortunately it might be some time before I get to working on a > >>>>> release > >>>>> for > >>>>> lustre 1.2.4 on OpenSSI. > >>>>> > >>>>> > >>>> > >>>> > >>>> > >>>> > >>>> Well you've got me too. There will be more demand in some form if > >>>> someone makes more "noise". > >>>> > >>>> I'm willing to help out with making Lustre 1.2.4 work on SSI as this > >>>> version adds zero-config, liblustre, and HA MDS/OSS which is somewha= t > >>>> more attractive than 1.0.4 and in my opinion further compliments the > >>>> goals of SSI. I'm sure others like me have been waiting for 1.2.x t= o > >>>> come out before giving it more thought. > >>>> > >>>> As we know Lustre guarantees IO and metadata atomicity just like GFS > >>>> (see below). So it seems possible to consider mounting Lustre CFS > >>>> parallel as we already do GFS which hopefully will boost CFS chard > >>>> performance - John? Come to thought if we can't CFS mount Lustre > >>>> parallel there's no point pursuing this further in SSI. > >>>> > >>>> I'll do a zero-config SSI cluster using HA Lustre on channel bonded > >>>> DRBD clusters with the same auto-recovery manager that Lustre 1.4.x = is > >>>> coming out with. This doesn't seem hard to setup as long as the > >>>> software works as advertised :p > >>>> > >>>> "Lustre's network protocols were designed from the beginning to be > >>>> completely recoverable. All transaction state is retained until the > >>>> data is safely on disk, which allows Lustre to replay any lost > >>>> operations if a server is rebooted or loses power. > >>>> > >>>> Even if a server fails while applications are using the file system, > >>>> Lustre guarantees coherent data and metadata, and applications > >>>> continue uninterrupted." > >>>> http://www.clusterfs.com/compare.html#recovery > >>>> > >>>> > >>>> -Roger > >>>> > >>>> > >>>> > >>> > >>> > >>> > >>> > >>> > >>> ------------------------------------------------------- > >>> SF email is sponsored by - The IT Product Guide > >>> Read honest & candid reviews on hundreds of IT Products from real > >>> users. > >>> Discover which products truly live up to the hype. Start reading now. > >>> http://ads.osdn.com/?ad_id=3D6595&alloc_id=3D14396&op=3Dclick > >>> _______________________________________________ > >>> ssic-linux-devel mailing list > >>> ssi...@li... > >>> https://lists.sourceforge.net/lists/listinfo/ssic-linux-devel > >>> > >> > >> > >> > >> > > > > > > > > >=20 >=20 >=20 > |
From: Roger T. <rog...@gm...> - 2005-04-01 03:13:12
|
I did a ./configure --with-linux=/usr/src/linux-2.4.22...9smp and make fails (see below). The kernel source is a fresh rpm install of the new kernel-ssi-source from this make kernel.rpm session. I sourced configs/kernel-ssi-..smp and did make dep in the kernel source tree before trying to make lustre tools. I managed to patch and build lustre using vanilla kernel-2.4.24 however - for the MDS, OST. /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:591:1: warning: multi-line comment In file included from /misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4/include/linux/lustre_lite.h:27, from dir.c:49: /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h: At top level: /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:709: error: `ext3_bread_R_ver_str' declared as function returning a function /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:709: warning: parameter names (without types) in function declaration /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742:13: invalid suffix "aaa0da5" on integer constant /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742: error: syntax error before numeric constant /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742: error: `__ext3_std_error_R_ver_str' declared as function returning a function /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742: warning: function declaration isn't a prototype /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:744: error: `ext3_abort_R_ver_str' declared as function returning a function /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:744: warning: parameter names (without types) in function declaration /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764:20: invalid suffix "bc874a" on integer constant /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764: error: syntax error before numeric constant /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764: error: `ext3_decode_error_R_ver_str' declared as function returning a function /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764: warning: function declaration isn't a prototype In file included from dir.c:51: llite_internal.h:81:19: invalid suffix "b35b69" on integer constant In file included from dir.c:51: llite_internal.h:81: error: syntax error before numeric constant llite_internal.h:81: warning: function declaration isn't a prototype llite_internal.h: In function `ll_i2uctxt': llite_internal.h:105: error: `c3cf1128' undeclared (first use in this function) llite_internal.h:105: error: called object is not a function llite_internal.h:111: error: called object is not a function llite_internal.h:311:22: invalid suffix "c" on integer constant llite_internal.h: In function `sbi2mdc': llite_internal.h:311: error: called object is not a function dir.c:87:9: invalid suffix "d4" on integer constant dir.c: In function `ll_dir_readpage': dir.c:87: error: called object is not a function dir.c:108:32: exponent has no digits dir.c: In function `ext2_put_page': dir.c:108: error: called object is not a function dir.c:239:16: invalid suffix "d54e45a" on integer constant dir.c: In function `ll_get_dir_page': dir.c:240: error: called object is not a function dir.c: In function `ll_readdir': dir.c:366: error: `ad2c844d' undeclared (first use in this function) dir.c:366: error: called object is not a function dir.c:437:60: invalid suffix "aa" on integer constant dir.c: In function `ll_dir_ioctl': dir.c:437: error: called object is not a function dir.c:487: error: `d523fdd3' undeclared (first use in this function) dir.c:487: error: called object is not a function dir.c:505:28: invalid suffix "c60d66e" on integer constant dir.c:505: error: called object is not a function dir.c:536: error: called object is not a function dir.c:544:33: invalid suffix "f2686" on integer constant dir.c:544: error: `d25469b4' undeclared (first use in this function) dir.c:544: error: called object is not a function dir.c:623: error: called object is not a function dir.c: At top level: dir.c:650: error: `da8b267c' undeclared here (not in a function) dir.c:650: error: initializer element is not constant dir.c:650: error: (near initialization for `ll_dir_operations.read') make[4]: *** [lov_obd.o] Error 1 make[4]: Leaving directory `/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4/lov' make[3]: *** [_modsubdir_lov] Error 2 make[4]: *** [dir.o] Error 1 make[4]: Leaving directory `/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4/llite' make[3]: *** [_modsubdir_llite] Error 2 make[2]: *** [_mod_/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4] Error 2 make[2]: Leaving directory `/usr/src/linux-2.4.22-1.2199.nptl_ssi_9' make[1]: *** [modules] Error 2 make[1]: Leaving directory `/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4' make: *** [all-recursive] Error 1 -Roger On Thu, 31 Mar 2005 19:51:05 -0500, Roger Tsang <rog...@gm...> wrote: > I did a make menuconfig instead of oldconfig. make kernel.rpm > completes. I've attached the .config. > > -Roger > > On Thu, 31 Mar 2005 12:15:13 -0800, Brian J. Watson > <Bri...@hp...> wrote: > > Roger Tsang wrote: > > > Then do make kernel.rpm in openssi directory. > > > > > > <snip> > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > Sorry, no help available for this option yet. > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > Sorry, no help available for this option yet. > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > Sorry, no help available for this option yet. > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > Sorry, no help available for this option yet. > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > Sorry, no help available for this option yet. > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > Sorry, no help available for this option yet. > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) make: *** wait: No > > > child processes. Stop. > > > make: *** Waiting for unfinished jobs.... > > > make: *** wait: No child processes. Stop. > > > [root@node1 openssi]# make[1]: *** [oldconfig_nonint] Error 1 > > > > Sounds like a config file problem. Run `make fullkern', copy > > openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config to > > linux-ssi/.config, cd into linux-ssi, and run `make oldconfig'. It'll > > ask you the above questions and whatever else it needs answered. > > > > Then copy linux-ssi/.config back to > > openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config, delete > > linux-ssi/, cd into openssi, and run `make kernel.rpm'. It should work now. > > > > As a final step, can you compress your updated config file and reply > > with it? Jai will add it to his Lustre 1.2.4 package on OpenSSI.org, so > > that others don't need to do this. > > > > Thanks and regards, > > > > Brian > > > > > |
From: Roger T. <rog...@gm...> - 2005-04-01 05:33:54
|
Okay that message was just reporting on my progress.. Now that I'm back from dinner, I see I forgot to do a make distclean. The lustre compile is looking good as I write this message. =) -Roger On Mar 31, 2005 10:13 PM, Roger Tsang <rog...@gm...> wrote: > I did a ./configure --with-linux=/usr/src/linux-2.4.22...9smp and > make fails (see below). > > The kernel source is a fresh rpm install of the new kernel-ssi-source > from this make kernel.rpm session. I sourced configs/kernel-ssi-..smp > and did make dep in the kernel source tree before trying to make > lustre tools. > > I managed to patch and build lustre using vanilla kernel-2.4.24 > however - for the MDS, OST. > > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:591:1: > warning: multi-line comment > In file included from > /misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4/include/linux/lustre_lite.h:27, > from dir.c:49: > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h: At top level: > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:709: > error: `ext3_bread_R_ver_str' declared as function returning a > function > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:709: > warning: parameter names (without types) in function declaration > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742:13: > invalid suffix "aaa0da5" on integer constant > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742: > error: syntax error before numeric constant > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742: > error: `__ext3_std_error_R_ver_str' declared as function returning a > function > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:742: > warning: function declaration isn't a prototype > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:744: > error: `ext3_abort_R_ver_str' declared as function returning a > function > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:744: > warning: parameter names (without types) in function declaration > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764:20: > invalid suffix "bc874a" on integer constant > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764: > error: syntax error before numeric constant > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764: > error: `ext3_decode_error_R_ver_str' declared as function returning a > function > /usr/src/linux-2.4.22-1.2199.nptl_ssi_9/include/linux/ext3_fs.h:764: > warning: function declaration isn't a prototype > In file included from dir.c:51: > llite_internal.h:81:19: invalid suffix "b35b69" on integer constant > In file included from dir.c:51: > llite_internal.h:81: error: syntax error before numeric constant > llite_internal.h:81: warning: function declaration isn't a prototype > llite_internal.h: In function `ll_i2uctxt': > llite_internal.h:105: error: `c3cf1128' undeclared (first use in this function) > llite_internal.h:105: error: called object is not a function > llite_internal.h:111: error: called object is not a function > llite_internal.h:311:22: invalid suffix "c" on integer constant > llite_internal.h: In function `sbi2mdc': > llite_internal.h:311: error: called object is not a function > dir.c:87:9: invalid suffix "d4" on integer constant > dir.c: In function `ll_dir_readpage': > dir.c:87: error: called object is not a function > dir.c:108:32: exponent has no digits > dir.c: In function `ext2_put_page': > dir.c:108: error: called object is not a function > dir.c:239:16: invalid suffix "d54e45a" on integer constant > dir.c: In function `ll_get_dir_page': > dir.c:240: error: called object is not a function > dir.c: In function `ll_readdir': > dir.c:366: error: `ad2c844d' undeclared (first use in this function) > dir.c:366: error: called object is not a function > dir.c:437:60: invalid suffix "aa" on integer constant > dir.c: In function `ll_dir_ioctl': > dir.c:437: error: called object is not a function > dir.c:487: error: `d523fdd3' undeclared (first use in this function) > dir.c:487: error: called object is not a function > dir.c:505:28: invalid suffix "c60d66e" on integer constant > dir.c:505: error: called object is not a function > dir.c:536: error: called object is not a function > dir.c:544:33: invalid suffix "f2686" on integer constant > dir.c:544: error: `d25469b4' undeclared (first use in this function) > dir.c:544: error: called object is not a function > dir.c:623: error: called object is not a function > dir.c: At top level: > dir.c:650: error: `da8b267c' undeclared here (not in a function) > dir.c:650: error: initializer element is not constant > dir.c:650: error: (near initialization for `ll_dir_operations.read') > make[4]: *** [lov_obd.o] Error 1 > make[4]: Leaving directory > `/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4/lov' > make[3]: *** [_modsubdir_lov] Error 2 > make[4]: *** [dir.o] Error 1 > make[4]: Leaving directory > `/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4/llite' > make[3]: *** [_modsubdir_llite] Error 2 > make[2]: *** [_mod_/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4] > Error 2 > make[2]: Leaving directory `/usr/src/linux-2.4.22-1.2199.nptl_ssi_9' > make[1]: *** [modules] Error 2 > make[1]: Leaving directory > `/misc/installs/openSSI/contribs/lustre-1.2.4/lustre-1.2.4' > make: *** [all-recursive] Error 1 > > -Roger > > > On Thu, 31 Mar 2005 19:51:05 -0500, Roger Tsang <rog...@gm...> wrote: > > I did a make menuconfig instead of oldconfig. make kernel.rpm > > completes. I've attached the .config. > > > > -Roger > > > > On Thu, 31 Mar 2005 12:15:13 -0800, Brian J. Watson > > <Bri...@hp...> wrote: > > > Roger Tsang wrote: > > > > Then do make kernel.rpm in openssi directory. > > > > > > > > <snip> > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > > Sorry, no help available for this option yet. > > > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > > Sorry, no help available for this option yet. > > > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > > Sorry, no help available for this option yet. > > > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > > Sorry, no help available for this option yet. > > > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > > Sorry, no help available for this option yet. > > > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) > > > > Sorry, no help available for this option yet. > > > > > > > > User address space size (3GB, 2GB, 1GB) [3GB] (NEW) make: *** wait: No > > > > child processes. Stop. > > > > make: *** Waiting for unfinished jobs.... > > > > make: *** wait: No child processes. Stop. > > > > [root@node1 openssi]# make[1]: *** [oldconfig_nonint] Error 1 > > > > > > Sounds like a config file problem. Run `make fullkern', copy > > > openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config to > > > linux-ssi/.config, cd into linux-ssi, and run `make oldconfig'. It'll > > > ask you the above questions and whatever else it needs answered. > > > > > > Then copy linux-ssi/.config back to > > > openssi/kernel.configs/kernel-ssi-2.4.22-i686-smp.config, delete > > > linux-ssi/, cd into openssi, and run `make kernel.rpm'. It should work now. > > > > > > As a final step, can you compress your updated config file and reply > > > with it? Jai will add it to his Lustre 1.2.4 package on OpenSSI.org, so > > > that others don't need to do this. > > > > > > Thanks and regards, > > > > > > Brian > > > > > > > > > > |