Menu
▾
▴
[MooseFS-Users] converting to storage classes
|
From: William K. <bi...@ii...> - 2021-02-24 04:43:39
|
Hi, I have an approximately year old moosefs system with ~8GB data (general data storage, email, lxc containers etc.) that was using goal based allocation - I have added an ssd to and decided to use storage classes to move one chunk of each of the lxc containers to the faster SSD (seems to work well) while converting the the whole storage to sclass based goal allocation. To convert I did a mfssetsclass -r at the top of the mfs tree - after removing older snapshots (I have read an email on how they handle the conversion) I am left with ~580000 still with a goal of 3 that is reported by the cli. 1. how do I find which actual chunks are still at goal 3 2. how can I map a chunk to a file 3. I have used mfsmakesnapshot a bit indiscriminately and have likely missed some snapshots - is there a way to identify chunks/files/dirs belonging to a snapshot? The only way I can think of to remove unknown snapshotted data is to copy the whole tree and delete the old one - which is a bit drastic! Is there another mechanism that prevents some chunks from being converted to a storage class? - or am I reading this wrong? BillK +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ----------------------------------------------------------------------------------+ | Storage Classes | +----+------+------------+------+------------------+------------------------+----------------------+-------------------------------------------------------------+------------------------------------------------- ------------+---------------------------------------------------------------------+ | | | | | # of inodes | # of standard chunks | # of archived chunks | create | keep | archive | | id | name | admin only | mode +---------+--------+-------+---------+------+-------+-------+------+------------------+------+-----------------------------------+------------------+------+----------------------- ------------+------------------+------+-----------------------------------+-------+ | | | | | files | dirs | under | exact | over | under | exact | over | can be fulfilled | goal | labels | can be fulfilled | goal | labels | can be fulfilled | goal | labels | delay | +----+------+------------+------+---------+--------+-------+---------+------+-------+-------+------+------------------+------+-----------------------------------+------------------+------+----------------------- ------------+------------------+------+-----------------------------------+-------+ | 1 | 1 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | YES | 1 | * | YES | 1 | * | YES | 1 | * | - | | 2 | 2 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | YES | 2 | * , * | YES | 2 | * , * | YES | 2 | * , * | - | *| 3 | 3 | NO | STD | 0 | 0 | - | 558046 | - | - | - | - | YES | 3 | * , * , * | YES | 3 | * , * , * * * | YES | 3 | * , * , * | - |* | 4 | 4 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | YES | 4 | * , * , * , * | YES | 4 | * , * , * , * | YES | 4 | * , * , * , * | - | | 5 | 5 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | YES | 5 | * , * , * , * , * | YES | 5 | * , * , * , * , * | YES | 5 | * , * , * , * , * | - | | 6 | 6 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | YES | 6 | * , * , * , * , * , * | YES | 6 | * , * , * , * , * , * | YES | 6 | * , * , * , * , * , * | - | | 7 | 7 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | NO | 7 | * , * , * , * , * , * , * | NO | 7 | * , * , * , * , * , * , * | NO | 7 | * , * , * , * , * , * , * | - | | 8 | 8 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | NO | 8 | * , * , * , * , * , * , * , * | NO | 8 | * , * , * , * , * , * , * , * | NO | 8 | * , * , * , * , * , * , * , * | - | | 9 | 9 | NO | STD | 0 | 0 | - | 0 | - | - | - | - | NO | 9 | * , * , * , * , * , * , * , * , * | NO | 9 | * , * , * , * , * , * , * , * , * | NO | 9 | * , * , * , * , * , * , * , * , * | - | | 12 | 4SDD | NO | STD | 0 | 0 | - | 0 | - | - | - | - | YES | 1 | S | YES | 4 | S , H , H , H | YES | 4 | S , * , * , * | - | | 13 | 3SDD | NO | STD | 1543418 | 78533 | - | 622622 | - | - | - | - | YES | 1 | S | YES | 3 | S , H , H | YES | 3 | S , * , * | - | | 14 | 2SDD | NO | STD | 382182 | 12723 | - | 243527 | - | - | - | - | YES | 1 | S | YES | 2 | S , H | YES | 2 | S , * | - | | 15 | 4HDD | NO | STD | 114113 | 2657 | - | 121934 | - | - | - | - | YES | 1 | H | YES | 4 | H , H , H , H | YES | 4 | H , * , * , * | - | | 16 | 3HDD | NO | STD | 7868308 | 192272 | - | 1223147 | - | - | - | - | YES | 1 | H | YES | 3 | H , H , H | YES | 3 | H , * , * | - | | 17 | 2HDD | NO | STD | 240618 | 15832 | - | 232747 | - | - | - | - | YES | 1 | H | YES | 2 | H , H | YES | 2 | H , * | - | n2 /var/lib/lxc # mfsgetgoal -r /mnt/mfs /mnt/mfs: files with storage class '3SDD' : 1545766 files with storage class '2SDD' : 385145 files with storage class '4HDD' : 114113 files with storage class '3HDD' : 7868656 files with storage class '2HDD' : 240618 directories with storage class '3SDD' : 78533 directories with storage class '2SDD' : 12723 directories with storage class '4HDD' : 2657 directories with storage class '3HDD' : 192272 directories with storage class '2HDD' : 15832 n2 /var/lib/lxc # mfsgetsclass -r /mnt/mfs /mnt/mfs: files with storage class '3SDD' : 1545766 files with storage class '2SDD' : 385145 files with storage class '4HDD' : 114113 files with storage class '3HDD' : 7868656 files with storage class '2HDD' : 240618 directories with storage class '3SDD' : 78533 directories with storage class '2SDD' : 12723 directories with storage class '4HDD' : 2657 directories with storage class '3HDD' : 192272 directories with storage class '2HDD' : 15832 n2 /var/lib/lxc # |
