Re: [MooseFS-Users] input/output error in directory

[Aleksander W. <ale...@mo...>]

Hello everyone.
We had similar problem with listing folders with more than one million
of files.
This problem was resolved in MooseFS 2.0.60
Which version of MooseFS are you using?

Best regards
Aleksander Wieliczko
Technical Support Engineer
MooseFS.com <moosefs.com>

On 04/01/2015 06:06 PM, Steve Wilson wrote:
> On 04/01/2015 11:12 AM, Ricardo J. Barberis wrote:
>> El Miércoles 01/04/2015, Steve Wilson escribió:
>>> Hi,
>>>
>>> One of our MooseFS installations has a problem with one of its
>>> directories.  mfsdirinfo shows:
>>>
>>>      [root@mckinley IPAB]# mfsdirinfo database
>>>      database:
>>>        inodes:                    2381944
>>>         directories:                    1
>>>         files:                    2381943
>>>        chunks:                    2381942
>>>        length:                 4863750852
>>>        size:                 168298493952
>>>        realsize:             336596987904
>>>
>>>
>>> When going into the directory and attempting to list the contents, I get
>>> the following error from ls:
>>>
>>>      ls: reading directory .: Input/output error
>>>
>>> I can create new entries in this directory, list them, and remove them:
>>>
>>>      [root@mckinley x]# touch a
>>>      [root@mckinley x]# ls -l a
>>>      -rw-r--r-- 1 root root 0 Apr  1 10:45 a
>>>      [root@mckinley x]# rm a
>>>      rm: remove regular empty file `a'? y
>>>      [root@mckinley x]#
>>>
>>> I don't see any MooseFS error messages in the logs and the MooseFS
>>> filesystem check information is clean.  Any suggestions???
>> I'm not sure, but I'd check connectivity from clients to chunkservers (i.e:
>> firewall, routing) because creating an empty file only contacts mfsmaster and
>> maybe ls'ing an empty file does the same.
>>
>> Does a simple '/bin/ls' inside database work?
>>
> It turns out that my RHEL 6 clients are unable to deal with the contents 
> of this directory while my Ubuntu 14.04 clients were able to access it.  
> The users who created this directory are on Ubuntu workstations but my 
> backup servers run RHEL or CentOS.  I'm fairly certain that I'm reaching 
> some OS limit since this directory has over 2 million entries in it.
>
> Thanks,
> Steve
>
> ------------------------------------------------------------------------------
> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for all
> things parallel software development, from weekly thought leadership blogs to
> news, videos, case studies, tutorials and more. Take a look and join the 
> conversation now. http://goparallel.sourceforge.net/
>
> _________________________________________
> moosefs-users mailing list
> moo...@li...
> https://lists.sourceforge.net/lists/listinfo/moosefs-users