Re: [MooseFS-Users] Large trash space without performing deletion operations

[Piotr R. K. <pio...@mo...>]

Hi David,

> Could they also be files that were deleted during rebalancing operations?


No. Rebalancing operations are transparent for users and are done on a lower level. Rebalancing takes into consideration chunks, not files.

Best regards,
Peter

-- 
Piotr Robert Konopelko
MooseFS Client Support Team | moosefs.com <https://moosefs.com/>
> On 13 May 2017, at 7:27 PM, David Myer <dav...@pr...> wrote:
> 
> Hi,
> 
> I have looked in the mfsmeta trash and the trashed files also seem to exist in the mfs mount, so they may be temporary files created by rsync as Ben suggested.
> 
> Could they also be files that were deleted during rebalancing operations?
> 
> Thanks,
> Dave
> 
> 
>> -------- Original Message --------
>> Subject: Re: [MooseFS-Users] Large trash space without performing deletion operations
>> Local Time: May 12, 2017 6:16 PM
>> UTC Time: May 12, 2017 10:16 PM
>> From: pio...@mo...
>> To: David Myer <dav...@pr...>
>> moo...@li... <moo...@li...>
>> 
>> Maybe rsync deleted some files during syncing if it was called several times?
>> 
>> MooseFS has a system-wide trash with a per-file configurable trashtime period (see https://moosefs.com/manpages/mfstrashtime.html <https://moosefs.com/manpages/mfstrashtime.html>), by default it is 86400 seconds, so 24 hours. You can configure trashtime before file is deleted.
>> 
>> 
>> You can access the trash by mounting it:
>> 
>> mkdir /mnt/mfsmeta
>> mfsmount -H mfsmaster.host.name -o mfsmeta /mnt/mfsmeta
>> 
>> in /mnt/mfsmeta/trash you have 4096 sub-trashes, just navigate to one and list files - their names will be pseudo-paths, so you can check what actually is in trash (ls -l). You can move these files to "undel" dir, which will cause undelete or remove them from (sub)trash - just issue rm *
>> 
>> You can also mount a trash with no subtrashes (-o mfsmeta,mfsflattrash), but in case of many objects in trash, listing them may be not a good idea.
>> 
>> 
>> Best regards,
>> Peter
>> 
>> -- 
>> Piotr Robert Konopelko
>> MooseFS Client Support Team | moosefs.com <https://moosefs.com/>
>> 
>>> On 12 May 2017, at 11:59 PM, David Myer <dav...@pr... <mailto:dav...@pr...>> wrote:
>>> 
>>> Hi,
>>> 
>>> I have noticed a large amount of trashed files despite performing no deletion operations.
>>> 
>>> So far I have only been filling up my mfs mount using rsync (without any rsync destination deletion flags set).
>>> 
>>> What would be causing this large trash space?
>>> 
>>> total space: 8.0 TiB
>>> avail space: 4.2 TiB
>>> trash space: 387 GiB
>>> trash files: 915451
>>> files: 3928894
>>> chunks: 3609973
>>> all chunk copies: 7219946
>>> 
>>> Thanks,
>>> Dave
>>> ------------------------------------------------------------------------------
>>> Check out the vibrant tech community on one of the world's most
>>> engaging tech sites, Slashdot.org <http://slashdot.org/>! http://sdm.link/slashdot_________________________________________ <http://sdm.link/slashdot_________________________________________>
>>> moosefs-users mailing list
>>> moo...@li... <mailto:moo...@li...>
>>> https://lists.sourceforge.net/lists/listinfo/moosefs-users
>