Thread: [Moosefs-users] MooseFS to NFS gateway

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 422-6466

Hello all,

Has anybody every successfully set up a machine that would mount a MooseFS
as a client and serve that mount point up to to to ohers via NFS?

Cheers,

Boris.

you can use unfs(http://unfs3.sourceforge.net/) as nfs gateway for 
moosefs and kernel nfs didn't support fuse.
> Hello all,
>
> Has anybody every successfully set up a machine that would mount a
> MooseFS as a client and serve that mount point up to to to ohers via NFS?
>
> Cheers,
>
> Boris.
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>
>
>
> _______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users

Yes, I do this one one of my machines. We have some operating systems 
(FreeBSD) that can't mount MooseFS directly. Fortunately there are few 
enough of them that I only need one gateway, for now. (I'm using Ubuntu 
10 or 11 on the gateway, but any Linux should work.)

I also have quite a number of systems that serve as SMB/Samba gateways 
for MS Windows systems.

On 05/11/2012 07:33 AM, Boris Epstein wrote:
> Hello all,
>
> Has anybody every successfully set up a machine that would mount a
> MooseFS as a client and serve that mount point up to to to ohers via NFS?
>
-- 
--
Perfection is just a word I use occasionally with mustard.
--Atom Powers--
Director of IT
DigiPen Institute of Technology
+1 (425) 895-4443

Atom,

Thanks!

Now that we are on the topic - if I need to build an SMB/CIFS gateway to
MooseFs what in your opinion would be the best way to do that?

Boris.

On Fri, May 11, 2012 at 11:55 AM, Atom Powers <ap...@di...> wrote:

> Yes, I do this one one of my machines. We have some operating systems
> (FreeBSD) that can't mount MooseFS directly. Fortunately there are few
> enough of them that I only need one gateway, for now. (I'm using Ubuntu
> 10 or 11 on the gateway, but any Linux should work.)
>
> I also have quite a number of systems that serve as SMB/Samba gateways
> for MS Windows systems.
>
> On 05/11/2012 07:33 AM, Boris Epstein wrote:
> > Hello all,
> >
> > Has anybody every successfully set up a machine that would mount a
> > MooseFS as a client and serve that mount point up to to to ohers via NFS?
> >
> --
> --
> Perfection is just a word I use occasionally with mustard.
> --Atom Powers--
> Director of IT
> DigiPen Institute of Technology
> +1 (425) 895-4443
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>

On 05/11/2012 09:00 AM, Boris Epstein wrote:
> Now that we are on the topic - if I need to build an SMB/CIFS gateway to
> MooseFs what in your opinion would be the best way to do that?

That will depend a lot on your environment. Do you have an Active 
Directory domain or do you use OpenLDAP/OpenDirectory? Are you clients 
Windows XP, Vista, 7, Samba? How many clients are you serving? What kind 
of data are they using (big files, high I/O, etc)?

I use OpenLDAP with Windows XP and 7 clients. I use MSDFS roots and 
several identically configured SMB/CIFS samba servers. Access control is 
done at the share and file system level. All the data, including the 
MSDFS links, is in the moose cluster. These are Ubuntu VMs with about a 
gig of RAM each. The vast majority of my data is static. IIR, from the 
MooseFS docs, this setup could cause problems if multiple people are 
trying to use the same file; I think MooseFS (in 1.6.20) doesn't do file 
locks and with the MSDFS you can't rely on the client to do the locking 
either.

-- 
--
Perfection is just a word I use occasionally with mustard.
--Atom Powers--
Director of IT
DigiPen Institute of Technology
+1 (425) 895-4443

On Sat, May 12, 2012 at 4:00 AM, Boris Epstein <bor...@gm...> wrote:

> Now that we are on the topic - if I need to build an SMB/CIFS gateway to
> MooseFs what in your opinion would be the best way to do that?
>

Hi Boris,

I currently use moose as third tier backup storage. I run my
masters/metaloggers on SL6.2.

None of my clients connect directly via mfsmount. On the moose master I
have samba re-exporting a mfsmount. All my windows servers connect via
samba and squirt their incrementals into the moose.
Even for the odd linux server which I need to create tarballs and send them
off I still connect via cifs due to not having to install and configure
another piece of software. For my use this is acceptable.

I also have a metalogger server using NFS to re-export a different mfsmount
directory. All my ESXi (which I am replacing with KVM) boxes connect to
this whenever I need to archive any old vm's which serve no purpose anymore
but management doesn't want to delete it.

My environment is kinda weird though, we are a MS SPLA partner providing
hosting for MS products, all running on free as in beer infrastructure
underneath lol.

I do this using UNFS3 - works fine - not exactly hyper fast but works.

http://unfs3.sourceforge.net/

-Scoleri

From: Boris Epstein [mailto:bor...@gm...]
Sent: Friday, May 11, 2012 10:33 AM
To: moo...@li...
Subject: [Moosefs-users] MooseFS to NFS gateway

Hello all,

Has anybody every successfully set up a machine that would mount a MooseFS as a client and serve that mount point up to to to ohers via NFS?

Cheers,

Boris.

Curious why you decided to use user-space NFS over the typical kernel-space NFS.

Ben

On May 11, 2012, at 10:45 AM, Scoleri, Steven wrote:

> I do this using UNFS3 – works fine – not exactly hyper fast but works.
>  
> http://unfs3.sourceforge.net/
>  
> -Scoleri
>  
> From: Boris Epstein [mailto:bor...@gm...] 
> Sent: Friday, May 11, 2012 10:33 AM
> To: moo...@li...
> Subject: [Moosefs-users] MooseFS to NFS gateway
>  
> Hello all,
>  
> Has anybody every successfully set up a machine that would mount a MooseFS as a client and serve that mount point up to to to ohers via NFS?
>  
> Cheers,
>  
> Boris.
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and 
> threat landscape has changed and how IT managers can respond. Discussions 
> will include endpoint security, mobile security and the latest in malware 
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users

The kernel nfs never worked on moose for me.  Something to do with direct i/o if remember correctly.

-Scoleri

-----Original Message-----
From: Allen, Benjamin S [mailto:bs...@la...] 
Sent: Friday, May 11, 2012 1:06 PM
To: Scoleri, Steven
Cc: Boris Epstein; moo...@li...
Subject: Re: [Moosefs-users] MooseFS to NFS gateway

Curious why you decided to use user-space NFS over the typical kernel-space NFS.

Ben

On May 11, 2012, at 10:45 AM, Scoleri, Steven wrote:

> I do this using UNFS3 - works fine - not exactly hyper fast but works.
>  
> http://unfs3.sourceforge.net/
>  
> -Scoleri
>  
> From: Boris Epstein [mailto:bor...@gm...]
> Sent: Friday, May 11, 2012 10:33 AM
> To: moo...@li...
> Subject: [Moosefs-users] MooseFS to NFS gateway
>  
> Hello all,
>  
> Has anybody every successfully set up a machine that would mount a MooseFS as a client and serve that mount point up to to to ohers via NFS?
>  
> Cheers,
>  
> Boris.
> ----------------------------------------------------------------------
> --------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and 
> threat landscape has changed and how IT managers can respond. 
> Discussions will include endpoint security, mobile security and the 
> latest in malware threats. 
> http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_____________
> __________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users

We have FreeBSD machines mounting MooseFS directly.  Never had a
problem with it.

On Fri, May 11, 2012 at 9:55 AM, Atom Powers <ap...@di...> wrote:
> Yes, I do this one one of my machines. We have some operating systems
> (FreeBSD) that can't mount MooseFS directly. Fortunately there are few
> enough of them that I only need one gateway, for now. (I'm using Ubuntu
> 10 or 11 on the gateway, but any Linux should work.)
>
> I also have quite a number of systems that serve as SMB/Samba gateways
> for MS Windows systems.
>
> On 05/11/2012 07:33 AM, Boris Epstein wrote:
>> Hello all,
>>
>> Has anybody every successfully set up a machine that would mount a
>> MooseFS as a client and serve that mount point up to to to ohers via NFS?
>>
> --
> --
> Perfection is just a word I use occasionally with mustard.
> --Atom Powers--
> Director of IT
> DigiPen Institute of Technology
> +1 (425) 895-4443
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users

On 05/14/2012 02:54 PM, Elliot Finley wrote:
> We have FreeBSD machines mounting MooseFS directly.  Never had a
> problem with it.

Good to hear. What version of FreeBSD, MooseFS are you using?

I had a small set of problems related to FUSE when I was doing my 
testing on FreeBSD 8 and Mfs 1.6.20. IIR, it was relatively minor 
problems such as not mounting automatically on boot and not being able 
to re-export via NFS; but there must have also been something big enough 
to make it worth the effort to use an NFS exporter. I just wish I could 
remember what it was.

-- 
--
Perfection is just a word I use occasionally with mustard.
--Atom Powers--
Director of IT
DigiPen Institute of Technology
+1 (425) 895-4443

MFS 1.6.20.  We haven't had any problems accessing MFS filesystems via
FreeBSD, but as you stated, there is an issue with re-export on
FreeBSD (Fuse related).  Also, we are unable to mount a MFS volume via
fstab, so we just mount them via script in /usr/local/etc/rc.d.

root:~#>mfsmount /mfsroot -H fs1-master.etv.net -S / -p
MFS Password:
mfsmaster accepted connection with parameters:
read-write,restricted_ip ; root mapped to root:wheel

root:~#>ls /mfsroot
./			fileshare/		syncrify_backups/
../			netbootclients/		vmware/
etv10/			proxmox/		windows_backups/
exchange_archive/	proxmoxv2/

root:~#>df -h /mfsroot
Filesystem    Size    Used   Avail Capacity  Mounted on
/dev/fuse0    275T     92T    182T    34%    /mfsroot

root:~#>uname -a
FreeBSD fs1-chunkserver6.etv.net 8.2-STABLE FreeBSD 8.2-STABLE #1: Thu
Feb  2 10:39:53 MST 2012
ro...@fs...:/usr/obj/usr/src/sys/GENERIC  amd64

On Mon, May 14, 2012 at 4:45 PM, Atom Powers <ap...@di...> wrote:
> On 05/14/2012 02:54 PM, Elliot Finley wrote:
>>
>> We have FreeBSD machines mounting MooseFS directly.  Never had a
>> problem with it.
>
>
> Good to hear. What version of FreeBSD, MooseFS are you using?
>
> I had a small set of problems related to FUSE when I was doing my testing on
> FreeBSD 8 and Mfs 1.6.20. IIR, it was relatively minor problems such as not
> mounting automatically on boot and not being able to re-export via NFS; but
> there must have also been something big enough to make it worth the effort
> to use an NFS exporter. I just wish I could remember what it was.
>
>
> --
> --
> Perfection is just a word I use occasionally with mustard.
> --Atom Powers--
> Director of IT
> DigiPen Institute of Technology
> +1 (425) 895-4443

Thread: [Moosefs-users] MooseFS to NFS gateway

Fault tolerant, POSIX-compliant, Net Distributed Storage / File System

moosefs-users