So I added a couple of drives to my mergerfs filesystem (which snapraid is monitoring). Everything was good the other day when I ran snapraid sync but when I ran it again now, here's what I got:
root@epsilon:~# snapraid syncSelftest...Loadingstatefrom/var/snapraid.content...WARNING!With5disksit's recommended to use two parity levels.Scanning...Scannedd2in0secondsScannedd3in0secondsScannedd5in0secondsScannedd4in0secondsScannedd1in0secondsUsing843MiBofmemoryforthefile-system.Initializing...Resizing...Savingstateto/var/snapraid.content...Savingstateto/mnt/disk1/.snapraid.content...Savingstateto/mnt/disk2/.snapraid.content...Savingstateto/mnt/disk3/.snapraid.content...Savingstateto/mnt/disk4/.snapraid.content...Savingstateto/mnt/disk5/.snapraid.content...Savingstateto/mnt/parity1/.snapraid.content...Verifying...Verified/mnt/disk3/.snapraid.contentin0secondsVerified/mnt/disk4/.snapraid.contentin0secondsVerified/mnt/disk1/.snapraid.contentin0secondsVerified/var/snapraid.contentin0secondsVerified/mnt/disk2/.snapraid.contentin0secondsVerified/mnt/parity1/.snapraid.contentin0secondsVerified/mnt/disk5/.snapraid.contentin0secondsUsing96MiBofmemoryfor64cachedblocks.Selecting...Syncing...Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/PhotoDirector/898c4d39831f90a1288b65041277a311/System.ni.dll_0.aux'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/PhotoDirector/898c4d39831f90a1288b65041277a311/System.ni.dll_2.aux'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni.dll'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni.dll'atposition'1'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni_1.dll'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni_1.dll'atposition'1'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni_0.dll'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni_0.dll'atposition'1'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni_2.dll'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Gradient/Microsoft.VisualStudio.Tools.Office.AppInfoDocument.v9.0.ni_2.dll'atposition'1'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/3220014388.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/skin_en-GB_female_TTS_1.lua'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/qsvg.dll'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/2672157974_2.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/462006811.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/2672157974_0.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/462006811_0.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#3 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/2672157974_1.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk5/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/PhotoDirector/898c4d39831f90a1288b65041277a311/System.ni.dll.aux'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/skin_en-GB_female_TTS.lua'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/3547987947_0.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/3547987947_1.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/skin_en-GB_female_TTS_0.lua'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/16832737.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/2672157974.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/2672157974_3.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/3547987947.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!Datachangeatfile'/mnt/disk3/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/Camera/en-GB_female_TTS/2672157974_4.pri'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Tryremovingthefilefromthearrayandrerunthe'sync'command!100%completed,25MBaccessedin0:00d19%|*****d20%|d30%|d486%|****************************************************d50%|parity0%|raid0%|hash2%|*sched10%|******misc0%||______________________________________________________________waittime(total,lessisbetter)28fileerrors0ioerrors0dataerrorsWARNING!Unexpectedfileerrors!Savingstateto/var/snapraid.content...Savingstateto/mnt/disk1/.snapraid.content...Savingstateto/mnt/disk2/.snapraid.content...Savingstateto/mnt/disk3/.snapraid.content...Savingstateto/mnt/disk4/.snapraid.content...Savingstateto/mnt/disk5/.snapraid.content...Savingstateto/mnt/parity1/.snapraid.content...Verifying...Verified/mnt/disk3/.snapraid.contentin0secondsVerified/mnt/disk2/.snapraid.contentin0secondsVerified/mnt/parity1/.snapraid.contentin0secondsVerified/mnt/disk4/.snapraid.contentin0secondsVerified/mnt/disk1/.snapraid.contentin0secondsVerified/var/snapraid.contentin0secondsVerified/mnt/disk5/.snapraid.contentin0seconds
What does "WARNING! Unexpected data modification of a file without parity!" mean? Shouldn't a sync command sync everything that is not synced and add to the parity?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I think this happened after I ran snapraid touch and yes I did rebalance the whole mergerfs array so that all drives (old and new) have approximately equal usage in terms of percentage.
Last edit: Kevin Mychal M. Ong 2022-02-12
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I see. Right, I didn't really do any copying of files. The mergerfs rebalance script just moves files to the drives in the pool using rsync. Could this be because of the file types or something?
Also, since one of my drives since to start developing bad sectors, I need to change it from a 3TB drive to a 6TB drive. What is the recommended way of doing this?
Thanks.
Kevin
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
No, I made sure snapraid Is not running when rsync was in progress. If I remember correctly, it wasn't until I issued a touch command did this issue with a couple of files appear.
Thanks for the link in replacing a disk.
Regards,
Kevin
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
After copying the files from the old drive to the new drive and running snapraid diff, I get this:
root@epsilon:~# snapraid diffLoadingstatefrom/var/snapraid.content...UUIDchangefordisk'd2'from'e53710c7-4994-42de-aa78-9e05df30ae67'to'85e786df-fd8d-4b18-9f25-2cb9069c81af'WARNING!With5disksit's recommended to use two parity levels.Comparing...WARNING!UUIDischangedfordisks:'d2'.Notusinginodestodetectmoveoperations.179133equal0added0removed0updated0moved0copied0restoredNodifferences
The UUID change is, of course, expected but what does the "not using inodes to detect move operations" warning message signify? Is it something that we need to worry about?
Regards,
Kevin
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
So after running snapraid, those errors went away. I rebalanced my drives again using the mergerfs rebalance script. After that, I ran sync and got this:
Datachangeatfile'/mnt/disk2/backup/Laptop Backup - Irene/#2 Lost Partition(NTFS)/Huawei Phone_IRENE/PhotoDirector/898c4d39831f90a1288b65041277a311/System.ni.dll.aux'atposition'0'WARNING!Unexpecteddatamodificationofafilewithoutparity!Thisfilewasdetectedasacopyofanotherfilewiththesamename, size,
andtimestamp, butthefiledataisn't matching the assumed copy.Ifthisisafalsepositive, andthefilesareexpectedtobedifferent,
youcan'sync'anywayusing'snapraid --force-nocopy sync'
So that's the exact same error as before. It happens after I do a rebalance. If it helps, this is the command used by the balance script:
So I added a couple of drives to my mergerfs filesystem (which snapraid is monitoring). Everything was good the other day when I ran snapraid sync but when I ran it again now, here's what I got:
What does "WARNING! Unexpected data modification of a file without parity!" mean? Shouldn't a sync command sync everything that is not synced and add to the parity?
I think this happened after I ran snapraid touch and yes I did rebalance the whole mergerfs array so that all drives (old and new) have approximately equal usage in terms of percentage.
Last edit: Kevin Mychal M. Ong 2022-02-12
@amadvance
Can anybody help me out here? Thanks.
Hi Kevin,
Try running sync with the --force-nocopy option.
Ciao,
Andrea
Hi Andrea,
That fixed the issue. Thanks! However, out of curiosity do you know what the root cause of the issue was?
Regards,
Kevin
Hi Kevin,
SnapRAID was thinking that such files were copies of other files, but the hash was not matching the copies. But it's not clear why this happened.
Ciao,
Andrea
Hi Andrea,
I see. Right, I didn't really do any copying of files. The mergerfs rebalance script just moves files to the drives in the pool using rsync. Could this be because of the file types or something?
Also, since one of my drives since to start developing bad sectors, I need to change it from a 3TB drive to a 6TB drive. What is the recommended way of doing this?
Thanks.
Kevin
Hi Kevin,
Did that rsync run while sync was in progress the first time you got that error ?
If yes, it could be the cause.
To replace a disk see: http://www.snapraid.it/faq#repdatadisk
Ciao,
Andrea
Hi Andrea,
No, I made sure snapraid Is not running when rsync was in progress. If I remember correctly, it wasn't until I issued a touch command did this issue with a couple of files appear.
Thanks for the link in replacing a disk.
Regards,
Kevin
Hi Andrea,
After copying the files from the old drive to the new drive and running snapraid diff, I get this:
The UUID change is, of course, expected but what does the "not using inodes to detect move operations" warning message signify? Is it something that we need to worry about?
Regards,
Kevin
So after running snapraid, those errors went away. I rebalanced my drives again using the mergerfs rebalance script. After that, I ran sync and got this:
So that's the exact same error as before. It happens after I do a rebalance. If it helps, this is the command used by the balance script:
rsync -avlHAXWE --relative --progress --remove-source-files <destination dir=""></destination>
And of course, after running snapraid --force-nocopy sync, the problem is fixed.
Last edit: Kevin Mychal M. Ong 2022-02-20