Re: [MooseFS-Users] input/output error in directory

[Steve W. <st...@pu...>]

On 04/02/2015 02:54 AM, Aleksander Wieliczko wrote:
> Hello everyone.
> We had similar problem with listing folders with more than one million 
> of files.
> This problem was resolved in MooseFS 2.0.60
> Which version of MooseFS are you using?
>

We're using version 2.0.50.  I mentioned earlier that I thought that 
Ubuntu clients could list the contents okay while RedHat clients 
couldn't.  After some more testing today, it looks like the only 
computer that can actually list the contents (that I've found so far) is 
the one which is also running mfs-master.

I'll need to try MooseFS 2.0.60 at some point to see if it helps get 
around the problem.

Thanks,
Steve


> Best regards
> Aleksander Wieliczko
> Technical Support Engineer
> MooseFS.com <moosefs.com>
>
> On 04/01/2015 06:06 PM, Steve Wilson wrote:
>> On 04/01/2015 11:12 AM, Ricardo J. Barberis wrote:
>>> El Miércoles 01/04/2015, Steve Wilson escribió:
>>>> Hi,
>>>>
>>>> One of our MooseFS installations has a problem with one of its
>>>> directories.  mfsdirinfo shows:
>>>>
>>>>       [root@mckinley IPAB]# mfsdirinfo database
>>>>       database:
>>>>         inodes:                    2381944
>>>>          directories:                    1
>>>>          files:                    2381943
>>>>         chunks:                    2381942
>>>>         length:                 4863750852
>>>>         size:                 168298493952
>>>>         realsize:             336596987904
>>>>
>>>>
>>>> When going into the directory and attempting to list the contents, I get
>>>> the following error from ls:
>>>>
>>>>       ls: reading directory .: Input/output error
>>>>
>>>> I can create new entries in this directory, list them, and remove them:
>>>>
>>>>       [root@mckinley x]# touch a
>>>>       [root@mckinley x]# ls -l a
>>>>       -rw-r--r-- 1 root root 0 Apr  1 10:45 a
>>>>       [root@mckinley x]# rm a
>>>>       rm: remove regular empty file `a'? y
>>>>       [root@mckinley x]#
>>>>
>>>> I don't see any MooseFS error messages in the logs and the MooseFS
>>>> filesystem check information is clean.  Any suggestions???
>>> I'm not sure, but I'd check connectivity from clients to chunkservers (i.e:
>>> firewall, routing) because creating an empty file only contacts mfsmaster and
>>> maybe ls'ing an empty file does the same.
>>>
>>> Does a simple '/bin/ls' inside database work?
>>>
>> It turns out that my RHEL 6 clients are unable to deal with the contents
>> of this directory while my Ubuntu 14.04 clients were able to access it.
>> The users who created this directory are on Ubuntu workstations but my
>> backup servers run RHEL or CentOS.  I'm fairly certain that I'm reaching
>> some OS limit since this directory has over 2 million entries in it.
>>
>> Thanks,
>> Steve
>>
>> ------------------------------------------------------------------------------
>> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
>> by Intel and developed in partnership with Slashdot Media, is your hub for all
>> things parallel software development, from weekly thought leadership blogs to
>> news, videos, case studies, tutorials and more. Take a look and join the
>> conversation now.http://goparallel.sourceforge.net/
>>
>> _________________________________________
>> moosefs-users mailing list
>> moo...@li...
>> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>