Menu
▾
▴
moosefs-users
|
From: Steve <st...@bo...> - 2012-01-04 15:28:43
|
Do people use moose boxes for other roles ? Sometime ago I made a moosefs linux ISO cd (not a respin) however the installer wasn't insert cd and job done. Taking it any further was beyond my capabilities. Is such a thing needed or desired ? Any collaborators Steve |
|
From: Travis H. <th...@tr...> - 2012-01-05 16:11:31
|
The chunk server daemons are very low footprint for system resource requirements. Enough so they are suitable to coexist with other system services. Where if you have a cluster of physical machines each with a local disk, just making every compute node also be a chunk server for aggregated file system capacity. Most of the time lately though we put everything in virtual machines on virtual machine hosting platforms now. Which I guess I kind of feel it is ot as efficient to have the chunk servers spread out everywhere, all VMs are backed by the same SAN anyway, so the performance over spread out disks goes away right. So lately I create a Virtual machine just for running the chunk server process. We have a "standard" of using CentOS for our VMs. Which is arguably kind of wasteful to just use it as a chunk server process, but it is pretty much set and forget and appliance-ized. I have often thought about creating a moose fs stand alone appliance. An embedded nano itx board in a 1U rackmount chassis, solid state boot, and a minimal linux distribution, with a large sata drives. Both low power and efficient, out of our virtualized platform. At least probably cheaper to grow capacity than buying more iSCSI RAID SAN products :P But this is still in my to do some day pile. On 12-01-04 10:28 AM, Steve wrote: > Do people use moose boxes for other roles ? > > > > Sometime ago I made a moosefs linux ISO cd (not a respin) however the > installer wasn't insert cd and job done. Taking it any further was beyond my > capabilities. > > > > Is such a thing needed or desired ? Any collaborators > > > > Steve > > ------------------------------------------------------------------------------ > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > infrastructure or vast IT resources to deliver seamless, secure access to > virtual desktops. With this all-in-one solution, easily deploy virtual > desktops for less than the cost of PCs and save 60% on VDI infrastructure > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Travis |
|
From: Steve <st...@bo...> - 2012-01-06 10:11:13
|
Travis, Yes I guess the world is moving on with VM's only something ive recently dabbled first ESxi and Proxmox which I currently have a vm mounted that is stored on moosefs. As only a hobbyist/home user most of my moose boxes are on various recycled PC's bits however most have ssd boot. I do have one atom based chunk although just in regular case for cheapness. I did some years back try 1u cases with the intention of having a rack but found them very noisy and the hardware expensive for home use and now have a custom homemade walk in cupboard with ample power points and LAN points for each shelf. With all cabling hidden behind including patch panel. Yes a standalone unit was in my mind when I dabbled with the distro some years ago with the idea of inserting the cd and answering little more than one question to determine the boxes role. Again hardware has moved on with usb stick more the norm for booting and ssd drives. Steve -------Original Message------- From: Travis Hein Date: 05/01/2012 16:13:03 To: moo...@li... Subject: Re: [Moosefs-users] moosefs distro The chunk server daemons are very low footprint for system resource requirements. Enough so they are suitable to coexist with other system services. Where if you have a cluster of physical machines each with a local disk, just making every compute node also be a chunk server for aggregated file system capacity. Most of the time lately though we put everything in virtual machines on virtual machine hosting platforms now. Which I guess I kind of feel it is to as efficient to have the chunk servers spread out everywhere, all VMs are backed by the same SAN anyway, so the performance over spread out disks goes away right. So lately I create a Virtual machine just for running the chunk server process. We have a "standard" of using CentOS for our VMs. Which is arguably kind of wasteful to just use it as a chunk server process, but it is pretty much set and forget and appliance-ized. I have often thought about creating a moose fs stand alone appliance. An embedded nano itx board in a 1U rackmount chassis, solid state boot, and a minimal linux distribution, with a large sata drives. Both low power and efficient, out of our virtualized platform. At least probably cheaper to grow capacity than buying more iSCSI RAID SAN products :P But this is still in my to do some day pile. On 12-01-04 10:28 AM, Steve wrote: > Do people use moose boxes for other roles ? > > > > Sometime ago I made a moosefs linux ISO cd (not a respin) however the > installer wasn't insert cd and job done. Taking it any further was beyond my > capabilities. > > > > Is such a thing needed or desired ? Any collaborators > > > > Steve > > ----------------------------------------------------------------------------- > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > infrastructure or vast IT resources to deliver seamless, secure access to > virtual desktops. With this all-in-one solution, easily deploy virtual > desktops for less than the cost of PCs and save 60% on VDI infrastructure > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Travis ----------------------------------------------------------------------------- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Ólafur Ó. <osv...@ne...> - 2012-01-06 10:19:36
|
Hi, We run the chunkservers completely from memory, they boot from USB and only use a small partition of the USB drive for the graph data so that the history isn't lost between reboots. Every chunkserver has 6x1TB disks and 3GB of ram and there are startup scripts that initialize new disks on boot if required, so a new server can just be put into the rack with a USB stick plugged in and it will clear all the disks and setup for MFS if it is not like that already. /Oli On 5.1.2012, at 16:11, Travis Hein wrote: > The chunk server daemons are very low footprint for system resource > requirements. Enough so they are suitable to coexist with other system > services. Where if you have a cluster of physical machines each with a > local disk, just making every compute node also be a chunk server for > aggregated file system capacity. > > Most of the time lately though we put everything in virtual machines on > virtual machine hosting platforms now. Which I guess I kind of feel it > is ot as efficient to have the chunk servers spread out everywhere, all > VMs are backed by the same SAN anyway, so the performance over spread > out disks goes away right. > > So lately I create a Virtual machine just for running the chunk server > process. We have a "standard" of using CentOS for our VMs. Which is > arguably kind of wasteful to just use it as a chunk server process, but > it is pretty much set and forget and appliance-ized. > > I have often thought about creating a moose fs stand alone appliance. An > embedded nano itx board in a 1U rackmount chassis, solid state boot, and > a minimal linux distribution, with a large sata drives. Both low power > and efficient, out of our virtualized platform. At least probably > cheaper to grow capacity than buying more iSCSI RAID SAN products :P > But this is still in my to do some day pile. > On 12-01-04 10:28 AM, Steve wrote: >> Do people use moose boxes for other roles ? >> >> >> >> Sometime ago I made a moosefs linux ISO cd (not a respin) however the >> installer wasn't insert cd and job done. Taking it any further was beyond my >> capabilities. >> >> >> >> Is such a thing needed or desired ? Any collaborators >> >> >> >> Steve >> >> ------------------------------------------------------------------------------ >> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex >> infrastructure or vast IT resources to deliver seamless, secure access to >> virtual desktops. With this all-in-one solution, easily deploy virtual >> desktops for less than the cost of PCs and save 60% on VDI infrastructure >> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox >> _______________________________________________ >> moosefs-users mailing list >> moo...@li... >> https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > -- > Travis > > > ------------------------------------------------------------------------------ > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > infrastructure or vast IT resources to deliver seamless, secure access to > virtual desktops. With this all-in-one solution, easily deploy virtual > desktops for less than the cost of PCs and save 60% on VDI infrastructure > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Ólafur Osvaldsson System Administrator Nethonnun ehf. e-mail: osv...@ne... phone: +354 517 3400 |
|
From: Steve <st...@bo...> - 2012-01-06 11:21:56
|
That's really cool, are you able to share the scripts, image and/or how the usb image was made ? Steve -------Original Message------- From: Ólafur Ósvaldsson Date: 06/01/2012 10:20:28 To: moo...@li... Subject: Re: [Moosefs-users] moosefs distro Hi, We run the chunkservers completely from memory, they boot from USB and only use a small partition of the USB drive for the graph data so that the history isn't lost between reboots. Every chunkserver has 6x1TB disks and 3GB of ram and there are startup scripts that initialize new disks on boot if required, so a new server can just be put into the rack with a USB stick plugged in and it will clear all the disks and setup for MFS if it is not like that already. /Oli On 5.1.2012, at 16:11, Travis Hein wrote: > The chunk server daemons are very low footprint for system resource > requirements. Enough so they are suitable to coexist with other system > services. Where if you have a cluster of physical machines each with a > local disk, just making every compute node also be a chunk server for > aggregated file system capacity. > > Most of the time lately though we put everything in virtual machines on > virtual machine hosting platforms now. Which I guess I kind of feel it > is to as efficient to have the chunk servers spread out everywhere, all > VMs are backed by the same SAN anyway, so the performance over spread > out disks goes away right. > > So lately I create a Virtual machine just for running the chunk server > process. We have a "standard" of using CentOS for our VMs. Which is > arguably kind of wasteful to just use it as a chunk server process, but > it is pretty much set and forget and appliance-ized. > > I have often thought about creating a moose fs stand alone appliance. An > embedded nano itx board in a 1U rackmount chassis, solid state boot, and > a minimal linux distribution, with a large sata drives. Both low power > and efficient, out of our virtualized platform. At least probably > cheaper to grow capacity than buying more iSCSI RAID SAN products :P > But this is still in my to do some day pile. > On 12-01-04 10:28 AM, Steve wrote: >> Do people use moose boxes for other roles ? >> >> >> >> Sometime ago I made a moosefs linux ISO cd (not a respin) however the >> installer wasn't insert cd and job done. Taking it any further was beyond my >> capabilities. >> >> >> >> Is such a thing needed or desired ? Any collaborators >> >> >> >> Steve >> >> ----------------------------------------------------------------------------- >> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex >> infrastructure or vast IT resources to deliver seamless, secure access to >> virtual desktops. With this all-in-one solution, easily deploy virtual >> desktops for less than the cost of PCs and save 60% on VDI infrastructure >> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox >> _______________________________________________ >> moosefs-users mailing list >> moo...@li... >> https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > -- > Travis > > > ----------------------------------------------------------------------------- > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > infrastructure or vast IT resources to deliver seamless, secure access to > virtual desktops. With this all-in-one solution, easily deploy virtual > desktops for less than the cost of PCs and save 60% on VDI infrastructure > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users -- Ólafur Osvaldsson System Administrator Nethonnun ehf. e-mail: osv...@ne... phone: +354 517 3400 ----------------------------------------------------------------------------- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox _______________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Ólafur Ó. <osv...@ne...> - 2012-01-06 11:36:55
|
Hi, We run a customized version of Ubuntu and to be honest I've not set it up in a distributable form. I'll check if I can gather it up next week and send the info to the list. /Oli On 6.1.2012, at 11:20, Steve wrote: > > That's really cool, are you able to share the scripts, image and/or how the > usb image was made ? > > > > Steve > > > > > > > > -------Original Message------- > > > > From: Ólafur Ósvaldsson > > Date: 06/01/2012 10:20:28 > > To: moo...@li... > > Subject: Re: [Moosefs-users] moosefs distro > > > > Hi, > > We run the chunkservers completely from memory, they boot from USB and > > only use a small partition of the USB drive for the graph data so that the > > history isn't lost between reboots. > > > > Every chunkserver has 6x1TB disks and 3GB of ram and there are startup > > scripts that initialize new disks on boot if required, so a new server can > just > > be put into the rack with a USB stick plugged in and it will clear all the > disks > > and setup for MFS if it is not like that already. > > > > /Oli > > > > On 5.1.2012, at 16:11, Travis Hein wrote: > > > >> The chunk server daemons are very low footprint for system resource > >> requirements. Enough so they are suitable to coexist with other system > >> services. Where if you have a cluster of physical machines each with a > >> local disk, just making every compute node also be a chunk server for > >> aggregated file system capacity. > >> > >> Most of the time lately though we put everything in virtual machines on > >> virtual machine hosting platforms now. Which I guess I kind of feel it > >> is to as efficient to have the chunk servers spread out everywhere, all > >> VMs are backed by the same SAN anyway, so the performance over spread > >> out disks goes away right. > >> > >> So lately I create a Virtual machine just for running the chunk server > >> process. We have a "standard" of using CentOS for our VMs. Which is > >> arguably kind of wasteful to just use it as a chunk server process, but > >> it is pretty much set and forget and appliance-ized. > >> > >> I have often thought about creating a moose fs stand alone appliance. An > >> embedded nano itx board in a 1U rackmount chassis, solid state boot, and > >> a minimal linux distribution, with a large sata drives. Both low power > >> and efficient, out of our virtualized platform. At least probably > >> cheaper to grow capacity than buying more iSCSI RAID SAN products :P > >> But this is still in my to do some day pile. > >> On 12-01-04 10:28 AM, Steve wrote: > >>> Do people use moose boxes for other roles ? > >>> > >>> > >>> > >>> Sometime ago I made a moosefs linux ISO cd (not a respin) however the > >>> installer wasn't insert cd and job done. Taking it any further was beyond > my > >>> capabilities. > >>> > >>> > >>> > >>> Is such a thing needed or desired ? Any collaborators > >>> > >>> > >>> > >>> Steve > >>> > >>> > ----------------------------------------------------------------------------- > > >>> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > > >>> infrastructure or vast IT resources to deliver seamless, secure access to > > >>> virtual desktops. With this all-in-one solution, easily deploy virtual > >>> desktops for less than the cost of PCs and save 60% on VDI infrastructure > > >>> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > >>> _______________________________________________ > >>> moosefs-users mailing list > >>> moo...@li... > >>> https://lists.sourceforge.net/lists/listinfo/moosefs-users > >> > >> > >> -- > >> Travis > >> > >> > >> > ----------------------------------------------------------------------------- > > >> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > >> infrastructure or vast IT resources to deliver seamless, secure access to > >> virtual desktops. With this all-in-one solution, easily deploy virtual > >> desktops for less than the cost of PCs and save 60% on VDI infrastructure > >> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > >> _______________________________________________ > >> moosefs-users mailing list > >> moo...@li... > >> https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > > -- > > Ólafur Osvaldsson > > System Administrator > > Nethonnun ehf. > > e-mail: osv...@ne... > > phone: +354 517 3400 > > > > > > ----------------------------------------------------------------------------- > > > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > > infrastructure or vast IT resources to deliver seamless, secure access to > > virtual desktops. With this all-in-one solution, easily deploy virtual > > desktops for less than the cost of PCs and save 60% on VDI infrastructure > > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > > _______________________________________________ > > moosefs-users mailing list > > moo...@li... > > https://lists.sourceforge.net/lists/listinfo/moosefs-users > > -- Ólafur Osvaldsson System Administrator Nethonnun ehf. e-mail: osv...@ne... phone: +354 517 3400 |
|
From: <jan...@da...> - 2012-01-06 12:36:28
|
On a related note - we were using USB sticks to boot chunkservers, but now we are using network boot for that. On chunkservers themselves is only data. This allows us to very quickly add new servers - just add new node in configs and plug the server in. In our experience using network boot is faster and safer than USB sticks (and also cheaper). On 06.01.2012 13:36, Ólafur Ósvaldsson wrote: > Hi, > We run a customized version of Ubuntu and to be honest I've not set > it up in > a distributable form. > > I'll check if I can gather it up next week and send the info to the > list. > > /Oli > > On 6.1.2012, at 11:20, Steve wrote: > >> >> That's really cool, are you able to share the scripts, image and/or >> how the >> usb image was made ? >> >> >> >> Steve >> >> >> >> >> >> >> >> -------Original Message------- >> >> >> >> From: Ólafur Ósvaldsson >> >> Date: 06/01/2012 10:20:28 >> >> To: moo...@li... >> >> Subject: Re: [Moosefs-users] moosefs distro >> >> >> >> Hi, >> >> We run the chunkservers completely from memory, they boot from USB >> and >> >> only use a small partition of the USB drive for the graph data so >> that the >> >> history isn't lost between reboots. >> >> >> >> Every chunkserver has 6x1TB disks and 3GB of ram and there are >> startup >> >> scripts that initialize new disks on boot if required, so a new >> server can >> just >> >> be put into the rack with a USB stick plugged in and it will clear >> all the >> disks >> >> and setup for MFS if it is not like that already. >> >> >> >> /Oli >> >> >> >> On 5.1.2012, at 16:11, Travis Hein wrote: >> >> >> >>> The chunk server daemons are very low footprint for system resource >> >>> requirements. Enough so they are suitable to coexist with other >>> system >> >>> services. Where if you have a cluster of physical machines each >>> with a >> >>> local disk, just making every compute node also be a chunk server >>> for >> >>> aggregated file system capacity. >> >>> >> >>> Most of the time lately though we put everything in virtual >>> machines on >> >>> virtual machine hosting platforms now. Which I guess I kind of feel >>> it >> >>> is to as efficient to have the chunk servers spread out everywhere, >>> all >> >>> VMs are backed by the same SAN anyway, so the performance over >>> spread >> >>> out disks goes away right. >> >>> >> >>> So lately I create a Virtual machine just for running the chunk >>> server >> >>> process. We have a "standard" of using CentOS for our VMs. Which is >> >>> arguably kind of wasteful to just use it as a chunk server process, >>> but >> >>> it is pretty much set and forget and appliance-ized. >> >>> >> >>> I have often thought about creating a moose fs stand alone >>> appliance. An >> >>> embedded nano itx board in a 1U rackmount chassis, solid state >>> boot, and >> >>> a minimal linux distribution, with a large sata drives. Both low >>> power >> >>> and efficient, out of our virtualized platform. At least probably >> >>> cheaper to grow capacity than buying more iSCSI RAID SAN products >>> :P >> >>> But this is still in my to do some day pile. >> >>> On 12-01-04 10:28 AM, Steve wrote: >> >>>> Do people use moose boxes for other roles ? >> >>>> >> >>>> >> >>>> >> >>>> Sometime ago I made a moosefs linux ISO cd (not a respin) however >>>> the >> >>>> installer wasn't insert cd and job done. Taking it any further was >>>> beyond >> my >> >>>> capabilities. >> >>>> >> >>>> >> >>>> >> >>>> Is such a thing needed or desired ? Any collaborators >> >>>> >> >>>> >> >>>> >> >>>> Steve >> >>>> >> >>>> >> >> ----------------------------------------------------------------------------- >> >> >>>> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a >>>> complex >> >> >>>> infrastructure or vast IT resources to deliver seamless, secure >>>> access to >> >> >>>> virtual desktops. With this all-in-one solution, easily deploy >>>> virtual >> >>>> desktops for less than the cost of PCs and save 60% on VDI >>>> infrastructure >> >> >>>> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox >> >>>> _______________________________________________ >> >>>> moosefs-users mailing list >> >>>> moo...@li... >> >>>> https://lists.sourceforge.net/lists/listinfo/moosefs-users >> >>> >> >>> >> >>> -- >> >>> Travis >> >>> >> >>> >> >>> >> >> ----------------------------------------------------------------------------- >> >> >>> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a >>> complex >> >>> infrastructure or vast IT resources to deliver seamless, secure >>> access to >> >>> virtual desktops. With this all-in-one solution, easily deploy >>> virtual >> >>> desktops for less than the cost of PCs and save 60% on VDI >>> infrastructure >> >>> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox >> >>> _______________________________________________ >> >>> moosefs-users mailing list >> >>> moo...@li... >> >>> https://lists.sourceforge.net/lists/listinfo/moosefs-users >> >> >> >> -- >> >> Ólafur Osvaldsson >> >> System Administrator >> >> Nethonnun ehf. >> >> e-mail: osv...@ne... >> >> phone: +354 517 3400 >> >> >> >> >> >> >> ----------------------------------------------------------------------------- >> >> >> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a >> complex >> >> infrastructure or vast IT resources to deliver seamless, secure >> access to >> >> virtual desktops. With this all-in-one solution, easily deploy >> virtual >> >> desktops for less than the cost of PCs and save 60% on VDI >> infrastructure >> >> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox >> >> _______________________________________________ >> >> moosefs-users mailing list >> >> moo...@li... >> >> https://lists.sourceforge.net/lists/listinfo/moosefs-users >> >> > > -- > Ólafur Osvaldsson > System Administrator > Nethonnun ehf. > e-mail: osv...@ne... > phone: +354 517 3400 > > > > ------------------------------------------------------------------------------ > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a > complex > infrastructure or vast IT resources to deliver seamless, secure > access to > virtual desktops. With this all-in-one solution, easily deploy > virtual > desktops for less than the cost of PCs and save 60% on VDI > infrastructure > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > _______________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Giovanni T. <me...@gi...> - 2012-01-06 13:55:11
|
Hi, 2012/1/6 <jan...@da...>: > On a related note - we were using USB sticks to boot chunkservers, but > now we are using network boot for that. On chunkservers themselves is > only data. This allows us to very quickly add new servers - just add new > node in configs and plug the server in. > In our experience using network boot is faster and safer than USB > sticks (and also cheaper). PXE netboot is a great choice when managing a bunch of identical machines, especially MooseFS chunk-servers that don't need any particular variation in the config files, and you can use the entire disks for the volume! I had a good experience with Debian Live http://live.debian.net/devel/live-boot/ (unfortunately this isn't in production but not for technical reasons): every machine bootstrap via PXE, download from a TFTP server the generic kernel and initrd with live-boot scripts, that downloads a squashed rootfs via HTTP and mount it. The last init.d script will mount the available machine disks on know locations and mfs-chunkserver is started. When a software upgrade is required, we simply generate a new squashed rootfs with updated software, test it under a virtual machine, and when you are sure it's working, reboot every node in sequence. -- Giovanni Toraldo http://gionn.net/ |
|
From: JV <ja...@da...> - 2012-01-06 14:04:20
|
We actually use NFS root, allowing us to have single read only base FS for every chunkserver. We can upgrade, if needed chrooting to base on master and then restarting all chunkservers. Also this system allows using different mfshdd.cfg for each chunkserver, allowing us to remove/add disks if they get hardware errors. On 06.01.2012 15:46, Giovanni Toraldo wrote: > Hi, > > 2012/1/6 <jan...@da...>: >> On a related note - we were using USB sticks to boot chunkservers, >> but >> now we are using network boot for that. On chunkservers themselves >> is >> only data. This allows us to very quickly add new servers - just add >> new >> node in configs and plug the server in. >> In our experience using network boot is faster and safer than USB >> sticks (and also cheaper). > > PXE netboot is a great choice when managing a bunch of identical > machines, especially MooseFS chunk-servers that don't need any > particular variation in the config files, and you can use the entire > disks for the volume! > > I had a good experience with Debian Live > http://live.debian.net/devel/live-boot/ (unfortunately this isn't in > production but not for technical reasons): every machine bootstrap > via > PXE, download from a TFTP server the generic kernel and initrd with > live-boot scripts, that downloads a squashed rootfs via HTTP and > mount > it. The last init.d script will mount the available machine disks on > know locations and mfs-chunkserver is started. > > When a software upgrade is required, we simply generate a new > squashed > rootfs with updated software, test it under a virtual machine, and > when you are sure it's working, reboot every node in sequence. |
|
From: Giovanni T. <me...@gi...> - 2012-01-06 14:15:49
|
2012/1/6 JV <ja...@da...>: > We actually use NFS root, allowing us to have single read only base FS > for every chunkserver. > We can upgrade, if needed chrooting to base on master and then > restarting all chunkservers. > Also this system allows using different mfshdd.cfg for each > chunkserver, allowing us to remove/add disks if they get hardware > errors. NFS is a good choice but may be a single point of failure if the server is not redundant. With PXE, each node is independent after the first boot, since their entire rootfs is kept compressed in ram (or can be written to disk after download, thanks to live-boot script support). In addition, rootfs auto-enable aufs support, so it's possibile to change files manually or via a custom post-boot script, that get lost on reboot or that can be saved on a custom partition/usb/flash. -- Giovanni Toraldo http://gionn.net/ |
|
From: Steve <st...@bo...> - 2012-02-02 15:47:51
|
Oli, Look forward to that thanks. -------Original Message------- From: Ólafur Ósvaldsson Date: 06/01/2012 11:36:55 To: Steve Cc: moo...@li... Subject: Re: [Moosefs-users] moosefs distro Hi, We run a customized version of Ubuntu and to be honest I've not set it up in a distributable form. I'll check if I can gather it up next week and send the info to the list. /Oli On 6.1.2012, at 11:20, Steve wrote: > > That's really cool, are you able to share the scripts, image and/or how the > usb image was made ? > > > > Steve > > > > > > > > -------Original Message------- > > > > From: Ólafur Ósvaldsson > > Date: 06/01/2012 10:20:28 > > To: moo...@li... > > Subject: Re: [Moosefs-users] moosefs distro > > > > Hi, > > We run the chunkservers completely from memory, they boot from USB and > > only use a small partition of the USB drive for the graph data so that the > > history isn't lost between reboots. > > > > Every chunkserver has 6x1TB disks and 3GB of ram and there are startup > > scripts that initialize new disks on boot if required, so a new server can > just > > be put into the rack with a USB stick plugged in and it will clear all the > disks > > and setup for MFS if it is not like that already. > > > > /Oli > > > > On 5.1.2012, at 16:11, Travis Hein wrote: > > > >> The chunk server daemons are very low footprint for system resource > >> requirements. Enough so they are suitable to coexist with other system > >> services. Where if you have a cluster of physical machines each with a > >> local disk, just making every compute node also be a chunk server for > >> aggregated file system capacity. > >> > >> Most of the time lately though we put everything in virtual machines on > >> virtual machine hosting platforms now. Which I guess I kind of feel it > >> is to as efficient to have the chunk servers spread out everywhere, all > >> VMs are backed by the same SAN anyway, so the performance over spread > >> out disks goes away right. > >> > >> So lately I create a Virtual machine just for running the chunk server > >> process. We have a "standard" of using CentOS for our VMs. Which is > >> arguably kind of wasteful to just use it as a chunk server process, but > >> it is pretty much set and forget and appliance-ized. > >> > >> I have often thought about creating a moose fs stand alone appliance. An > >> embedded nano itx board in a 1U rackmount chassis, solid state boot, and > >> a minimal linux distribution, with a large sata drives. Both low power > >> and efficient, out of our virtualized platform. At least probably > >> cheaper to grow capacity than buying more iSCSI RAID SAN products :P > >> But this is still in my to do some day pile. > >> On 12-01-04 10:28 AM, Steve wrote: > >>> Do people use moose boxes for other roles ? > >>> > >>> > >>> > >>> Sometime ago I made a moosefs linux ISO cd (not a respin) however the > >>> installer wasn't insert cd and job done. Taking it any further was beyond > my > >>> capabilities. > >>> > >>> > >>> > >>> Is such a thing needed or desired ? Any collaborators > >>> > >>> > >>> > >>> Steve > >>> > >>> > ----------------------------------------------------------------------------- > > >>> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > > >>> infrastructure or vast IT resources to deliver seamless, secure access to > > >>> virtual desktops. With this all-in-one solution, easily deploy virtual > >>> desktops for less than the cost of PCs and save 60% on VDI infrastructure > > >>> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > >>> _______________________________________________ > >>> moosefs-users mailing list > >>> moo...@li... > >>> https://lists.sourceforge.net/lists/listinfo/moosefs-users > >> > >> > >> -- > >> Travis > >> > >> > >> > ----------------------------------------------------------------------------- > > >> Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > >> infrastructure or vast IT resources to deliver seamless, secure access to > >> virtual desktops. With this all-in-one solution, easily deploy virtual > >> desktops for less than the cost of PCs and save 60% on VDI infrastructure > >> costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > >> _______________________________________________ > >> moosefs-users mailing list > >> moo...@li... > >> https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > > -- > > Ólafur Osvaldsson > > System Administrator > > Nethonnun ehf. > > e-mail: osv...@ne... > > phone: +354 517 3400 > > > > > > ----------------------------------------------------------------------------- > > > Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex > > infrastructure or vast IT resources to deliver seamless, secure access to > > virtual desktops. With this all-in-one solution, easily deploy virtual > > desktops for less than the cost of PCs and save 60% on VDI infrastructure > > costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox > > _______________________________________________ > > moosefs-users mailing list > > moo...@li... > > https://lists.sourceforge.net/lists/listinfo/moosefs-users > > -- Ólafur Osvaldsson System Administrator Nethonnun ehf. e-mail: osv...@ne... phone: +354 517 3400 |
×
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.
Thanks for helping keep SourceForge clean.
X