Main header at the end looks OK.
There is no start header. But it's not big problem.
Probably you have some volume corrupted or missing.
Just find bad or missing volume(s) and restore it to "correct size".
1) check that you have all volumes
2) Check that all volumes have same size. Sort all volumes by size in 7-Zip file manager and you will see "bad" volume at the end of list. Then you must restore correct size of that volume. You can add zeros with some tool, or use Split / Combine with 7-Zip file manger:
for example
a.005.7z is short/bad (100 bytes).
a.006.7z is good (1000000 bytes).
copy a.005.7z to short.001
copy a.006.7z to big
split big with 7-Zip into two volumes
100 10G
it creates
big.001 (100 bytes)
big.002 (999900 bytes)
rename big.002 to short.002
Call "Combine files" for short.001. It creates short (1000000 bytes).
copy short to a.005.7z
Last edit: Igor Pavlov 2017-12-17
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Here is screen shot of files that are not complete. I've attached it. I hope you can view it. What is confusing me is last fie no. 725 it is not same size as 2GB files but it is last one. How would I fix that one?
Ok so I was able to do your instruction on file 251 and 434 which were less size than all others. I left last 725 alone and I did not do anything with it. I was able to open the archive and started extracting files but thousands of extracted files are wrong size. Infact they were all 1KB in size. While extracting 7zip listed about 114000 errors all listed as "Data error" in bottom of extraction window. Does that mean that all those files are damaged or what? Thank you again!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
7-Zip splits all files to solid blocks.
So if you have corruption in volume 251, then 7-Zip can't extract any file after that point to start of next solid block.
You can see the number of solid blocks in Properties of archive in "Blocks".
You can see "solid block number" for each file in column "Block".
Yoiu can use "View / Flat View" and then sort by "Block" number to see what files are in same solid blocks.
So what the number of solid blocks in your archive?
Last edit: Igor Pavlov 2017-12-17
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
If I open 7zip file manager and highlight first file Graphics.7z.001 then click on yellow "info" at top right all I get is file properties not the archive info. Same thing if I click info on any of the 725 files in archive. If I open the first file .001 in file manager then it opens the archive I can click on the folder inside "Graphics" and click "Info" and it will display the archive info including "Blocks" which is 173754 but next to "Solid" is just a "-". I'm not sure what to make out of that. If I click on any folder in the archive I get the same info. Here is screen shot.
I don't know why you have so big number of errors.
How did you create that archive and how did you copy volumes?
It must show error for some files, but then it must get good files.
So I need to look some log.
Call the commands for 7z from 7-Zip 16.04 (or 17.01 beta):
7z l Graphics.7z.001 -slt > list.txt
7z t Graphics.7z.001 -bse1 > test.txt
7z a info.7z list.txt test.txt -pSomeLongPassword -mhe
and send info.7z to me via email and password in another email message.
Last edit: Igor Pavlov 2017-12-18
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
All errors up to file for Block = 114379 (but I don't know what volume is that block).
It looks like all volumes up to some volume are corrupted.
And there are no errors after Block = 114379.
It's unusual.
Try to describe all actions how that big archive was created, and all operations how it was transferred. Describe all hardware/software that was used, CPU/OS/HDDs/SDDs/network/file systems on computer/devices that was used. Describe all programs that were used and all commands that were used.
Probably some hardware or software was not good in these operations.
And did you do same operations before?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Oh man that is a big question. The way this archive was created was through Cobian Backup which uses 7zip v4.65. Its a weekly backup and i chose to split it to 2GB files as you seen. It's running on a hyperv server which most of the time is using most RAM for server operations. so that might have had some affect on the creation of this archive. I only have this last backup and nothing from before. I don't have original files either unfortunately. After fixing the 2 smaller files in archive as you instructed I was able to extract the last folder in it and it was about 100+GB but the more important folder "Clients" is the bigger one and desperate to get that back. Do you think it's possible to get more out of archive or is it damaged? I see folder and file sizes in there but don't extract. Thank you again! Waiting for your response.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I still don't understand why there is such big number of errors.
Try to describe all operations for archive.
You called create archive operation and you copied some volumes to another place while creating was not finished?
Describe all steps and hardware.
Last edit: Igor Pavlov 2017-12-21
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hardware: Xeon Processor x3460, 12GB of RAM. Running 2 hypervisor virtual machines. Windows Server 2008 R2 installed. The backup process was automated by Cobian Backup 11. I did not manually create backup. I will e-mail you screen shots of the settings it was set to. Also note that it was an incremental backup. Not sure how that relates to our problem here or if it does. So I do not have any info on what happened during that last backup. I'm not sure if there was a better way to set the setting for compression in that program. It seemed to me that using 7zip option was best at the time with 2GB splits. Your thoughts please. Thank you!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
1) If you have virtual machines, describe all levels: host, guest and so on. If you copied files from one vm to another computer, describe it too. Describe everything, but with simple sentences.
2) Did you create similar backup before. Was it OK?
3) Describe how did you copy volumes to another place.
Describe full time line and all script commands that were used.
For example,
backup command was started at HH::MM
copy operation from (what ?) to (what ?) was started at HH::MM
backup command was finished at HH::MM
copy operation was finished at HH::MM
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
1) Backup was done on Hyperv not on any virtual machines. I only mentioned them so you know that this is a busy server. Cobian Backup 11 is installed on the Hyperv not on any VM. I described in previous post the specs of the Hyperv server. The 2 VM machinves are AD and Mail. Storage is RAID but cannot remember how many HDD's I think 4x2TB drives in RAID 5 or 6. AD VM is stored on this RAID. Mail VM is stored on 2 other 240GB Intel SSD's in RAID 1. Network is Gigabit. (I hope this gives you the info you need to figure out archive resolution).
2) This was a recurring scheduled daily incremental backup scheduled at 10PM every weekday. I don't have a log to see what happened that day or how long did the process take. I remember testing this archive when it was much smaller few months ago and I was able to open it but did not test it for a while.
3) as I mentioned earlier in post that Cobian backup creates the archive on a 3TB internal HD. I copied this archive to an external 4TB (New) HD and performed your suggestions on another system (Also a server with plenty of RAM 32GB and 2 Xeon processors) to keep original archive untouched.
4) I've included all option screen shots in e-mail (sent before) to show you what Cobian backup does and what options it chooses. Unfortunately I don't have the command line that it uses. It only gives GUI interface. I don't know if you have noticed that every count of files carry a certain date which seems to indicate the incremental option I think. I can send you some screen shots but I think it should be in list.txt file I sent.
I'm looking for any suggestions to get this archive extract files and hopefully intact. Do you think there is any chance?
Thank you again!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Describe all actions for data and time line:
Cobian was started at day::hour::MM.
Cobian was finished at day::hour::MM.
Cobian created files at: Full_path_1
You called some "copy operation" for volumes from Full_path_1 to Full_path_2 at day::hour::MM.
Describe all paths where files were stored:
Full_path_1 (file system / hardware / OS), day::hour::MM
....
Full_path_N (file system / hardware / OS), day::hour::MM
You can run any OS under Hyperv. It can works so:
Computer runs some OS.
And Computer runs Hyperv under that OS.
Then you run another OS in Hyperv. And then you can run software in that another OS.
So describe all levels.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Some thing didn't work OK.
And you didn't write where there was failure.
It could be 7-Zip failure / hdd failure / network failure / ram failure / script defect and many other possible reasons.
So describe all data processing stages, including full time line for each operation. And show all scripts that were used.And try to find exact stage that was the reason of failure.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Also look the end of first volume in hex editor.
It must have data that looks like random data.
If it has zeros instead of random data at the end, then there was big problem in that data.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I still couldn't get any answer from you on why are we finding out what happened. Will that help recover data? I've asked this a few times but no answer from you. Can you please answer: Is there a chance of recovery from the archive?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Many cases are possible.
Some errors are recoverable and some error unrecoverable.
We still don't know exact type of errors in that archive.
Also there is some probability that was some problem with 7-Zip encoder or decoder. So I want to know exact reason of failure.
Without additional information, I can estimate the chance to recover data as 1-3%.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hi Igor,
I have a 725 volume archive each is about 2GB. Header seems to be damaged. I'm asking for help. You advised to supply the following info.
First 48 Bytes of header
37 7A BC AF 27 1C 00 03 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 67 FE A8 C8 1B 0E AF 1B 1D C9 4C C3 B1 48
Last 200 bytes of last volume:
C3 CB 20 6D 20 9C 7B 33 00 27 94 BD 26 28 A6 7A
72 7A 90 A5 9D A7 A6 3D 33 72 8A C7 A8 07 C1 57
F9 6F 2A 6C 3C 98 EA D0 AB 41 84 1C 00 7A 27 EA
08 A8 A7 81 1A B4 B6 F2 A0 74 8A 60 B8 BF 97 F4
92 3E 61 2F 34 4C EC AA BB D7 C7 A8 A6 2A 40 AA
B2 A2 C6 65 D1 64 56 9B 27 2C 17 D5 05 15 C1 EA
FB 82 C5 C6 41 F6 AA 92 AA 12 CE 40 0F 77 0C 64
70 99 45 C3 60 49 65 77 9C D0 A3 A6 AC 4B 75 2E
57 43 7E 7F 90 1E 36 BD D1 D7 6E 2C D5 EF 0F 56
D9 D5 3F FC 23 31 50 66 27 EE 61 C6 72 17 06 F9
FE A9 AB 2D 69 01 09 E0 D4 1F 29 00 07 0B 01 00
01 23 03 01 01 05 5D 00 00 10 00 0C E1 03 BC E6
0A 01 AD A1 5D 59 00 00
Thanks!
Pavlo
Main header at the end looks OK.
There is no start header. But it's not big problem.
Probably you have some volume corrupted or missing.
Just find bad or missing volume(s) and restore it to "correct size".
1) check that you have all volumes
2) Check that all volumes have same size. Sort all volumes by size in 7-Zip file manager and you will see "bad" volume at the end of list. Then you must restore correct size of that volume. You can add zeros with some tool, or use Split / Combine with 7-Zip file manger:
for example
a.005.7z is short/bad (100 bytes).
a.006.7z is good (1000000 bytes).
copy
a.005.7ztoshort.001copy
a.006.7ztobigsplit
bigwith 7-Zip into two volumesit creates
big.001 (100 bytes)
big.002 (999900 bytes)
rename
big.002toshort.002Call "Combine files" for
short.001. It createsshort(1000000 bytes).copy
shorttoa.005.7zLast edit: Igor Pavlov 2017-12-17
Hi Igor,
Thank you for reply.
Here is screen shot of files that are not complete. I've attached it. I hope you can view it. What is confusing me is last fie no. 725 it is not same size as 2GB files but it is last one. How would I fix that one?
Hi Igor,
Ok so I was able to do your instruction on file 251 and 434 which were less size than all others. I left last 725 alone and I did not do anything with it. I was able to open the archive and started extracting files but thousands of extracted files are wrong size. Infact they were all 1KB in size. While extracting 7zip listed about 114000 errors all listed as "Data error" in bottom of extraction window. Does that mean that all those files are damaged or what? Thank you again!
7-Zip splits all files to solid blocks.
So if you have corruption in volume 251, then 7-Zip can't extract any file after that point to start of next solid block.
You can see the number of solid blocks in Properties of archive in "Blocks".
You can see "solid block number" for each file in column "Block".
Yoiu can use "View / Flat View" and then sort by "Block" number to see what files are in same solid blocks.
So what the number of solid blocks in your archive?
Last edit: Igor Pavlov 2017-12-17
And try to think why you have corruption.
Probably you copied volumes while 7-Zip was still working.
So you copied not finished files.
If I open 7zip file manager and highlight first file Graphics.7z.001 then click on yellow "info" at top right all I get is file properties not the archive info. Same thing if I click info on any of the 725 files in archive. If I open the first file .001 in file manager then it opens the archive I can click on the folder inside "Graphics" and click "Info" and it will display the archive info including "Blocks" which is 173754 but next to "Solid" is just a "-". I'm not sure what to make out of that. If I click on any folder in the archive I get the same info. Here is screen shot.
I don't know why you have so big number of errors.
How did you create that archive and how did you copy volumes?
It must show error for some files, but then it must get good files.
So I need to look some log.
Call the commands for 7z from 7-Zip 16.04 (or 17.01 beta):
and send
info.7zto me via email and password in another email message.Last edit: Igor Pavlov 2017-12-18
First command was fast. Second command taking almost a day to finish. They might be big to send. Can I send via dropbox or other method?
You can use any method to send archive with txt files, but check that you can't open it without password.
And send password via email.
Did you get my e-mails?
All errors up to file for Block = 114379 (but I don't know what volume is that block).
It looks like all volumes up to some volume are corrupted.
And there are no errors after Block = 114379.
It's unusual.
Try to describe all actions how that big archive was created, and all operations how it was transferred. Describe all hardware/software that was used, CPU/OS/HDDs/SDDs/network/file systems on computer/devices that was used. Describe all programs that were used and all commands that were used.
Probably some hardware or software was not good in these operations.
And did you do same operations before?
Oh man that is a big question. The way this archive was created was through Cobian Backup which uses 7zip v4.65. Its a weekly backup and i chose to split it to 2GB files as you seen. It's running on a hyperv server which most of the time is using most RAM for server operations. so that might have had some affect on the creation of this archive. I only have this last backup and nothing from before. I don't have original files either unfortunately. After fixing the 2 smaller files in archive as you instructed I was able to extract the last folder in it and it was about 100+GB but the more important folder "Clients" is the bigger one and desperate to get that back. Do you think it's possible to get more out of archive or is it damaged? I see folder and file sizes in there but don't extract. Thank you again! Waiting for your response.
Just to add some info in case it helps. Conbian Backup is set to backup to an internal 3TB SATA drive so no USB external involved here.
I still don't understand why there is such big number of errors.
Try to describe all operations for archive.
You called create archive operation and you copied some volumes to another place while creating was not finished?
Describe all steps and hardware.
Last edit: Igor Pavlov 2017-12-21
Hardware: Xeon Processor x3460, 12GB of RAM. Running 2 hypervisor virtual machines. Windows Server 2008 R2 installed. The backup process was automated by Cobian Backup 11. I did not manually create backup. I will e-mail you screen shots of the settings it was set to. Also note that it was an incremental backup. Not sure how that relates to our problem here or if it does. So I do not have any info on what happened during that last backup. I'm not sure if there was a better way to set the setting for compression in that program. It seemed to me that using 7zip option was best at the time with 2GB splits. Your thoughts please. Thank you!
1) If you have virtual machines, describe all levels: host, guest and so on. If you copied files from one vm to another computer, describe it too. Describe everything, but with simple sentences.
2) Did you create similar backup before. Was it OK?
3) Describe how did you copy volumes to another place.
Describe full time line and all script commands that were used.
For example,
backup command was started at HH::MM
copy operation from (what ?) to (what ?) was started at HH::MM
backup command was finished at HH::MM
copy operation was finished at HH::MM
1) Backup was done on Hyperv not on any virtual machines. I only mentioned them so you know that this is a busy server. Cobian Backup 11 is installed on the Hyperv not on any VM. I described in previous post the specs of the Hyperv server. The 2 VM machinves are AD and Mail. Storage is RAID but cannot remember how many HDD's I think 4x2TB drives in RAID 5 or 6. AD VM is stored on this RAID. Mail VM is stored on 2 other 240GB Intel SSD's in RAID 1. Network is Gigabit. (I hope this gives you the info you need to figure out archive resolution).
2) This was a recurring scheduled daily incremental backup scheduled at 10PM every weekday. I don't have a log to see what happened that day or how long did the process take. I remember testing this archive when it was much smaller few months ago and I was able to open it but did not test it for a while.
3) as I mentioned earlier in post that Cobian backup creates the archive on a 3TB internal HD. I copied this archive to an external 4TB (New) HD and performed your suggestions on another system (Also a server with plenty of RAM 32GB and 2 Xeon processors) to keep original archive untouched.
4) I've included all option screen shots in e-mail (sent before) to show you what Cobian backup does and what options it chooses. Unfortunately I don't have the command line that it uses. It only gives GUI interface. I don't know if you have noticed that every count of files carry a certain date which seems to indicate the incremental option I think. I can send you some screen shots but I think it should be in list.txt file I sent.
I'm looking for any suggestions to get this archive extract files and hopefully intact. Do you think there is any chance?
Thank you again!
Describe all actions for data and time line:
Cobian was started at day::hour::MM.
Cobian was finished at day::hour::MM.
Cobian created files at: Full_path_1
You called some "copy operation" for volumes from Full_path_1 to Full_path_2 at day::hour::MM.
Describe all paths where files were stored:
Full_path_1 (file system / hardware / OS), day::hour::MM
....
Full_path_N (file system / hardware / OS), day::hour::MM
You can run any OS under Hyperv. It can works so:
Computer runs some OS.
And Computer runs Hyperv under that OS.
Then you run another OS in Hyperv. And then you can run software in that another OS.
So describe all levels.
Is it possible to recover any files from this archive? Are these questions meant to find out what might have happened?
Some thing didn't work OK.
And you didn't write where there was failure.
It could be 7-Zip failure / hdd failure / network failure / ram failure / script defect and many other possible reasons.
So describe all data processing stages, including full time line for each operation. And show all scripts that were used.And try to find exact stage that was the reason of failure.
Also look the end of first volume in hex editor.
It must have data that looks like random data.
If it has zeros instead of random data at the end, then there was big problem in that data.
Answer to your last post is here. These are the last few lines from first volume.
Offset(h) 00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F
7F8DCE60 CB 95 2C 2A 8C 71 52 04 C0 90 27 55 8F D2 1D 9C Ë•,*ŒqR.À.'U.Ò.œ
7F8DCE70 0D 8E 93 A5 63 97 05 44 17 29 A1 BF 3D 64 18 80 .Ž“¥c—.D.)¡¿=d.€
7F8DCE80 85 B0 68 5F 8C 83 B0 49 5D 39 AC D0 4A 8C D4 94 …°h_Œƒ°I]9¬ÐJŒÔ”
7F8DCE90 53 CD 07 CF 1E D1 E0 71 E0 86 AE 70 93 F2 AE 5D SÍ.Ï.Ñàqà†®p“ò®]
7F8DCEA0 25 E9 FD 5C FE D0 9F 69 0A CF 5B 2B 79 89 25 6A %éý\þПi.Ï[+y‰%j
7F8DCEB0 84 09 A6 EE F3 C3 D6 AD 33 D6 D3 25 C1 03 63 89 „.¦îóÃÖ.3ÖÓ%Á.c‰
7F8DCEC0 12 42 77 22 33 71 76 6A ED B8 21 8F F0 2E BD 6D .Bw"3qvjí¸!.ð.½m
7F8DCED0 8A 10 7E B7 6F D0 70 00 33 4B CF 20 FB 26 C5 BF Š.~·oÐp.3KÏ û&Å¿
7F8DCEE0 73 F4 65 23 A5 8F 56 9B 76 70 28 7C DC EA 2B 7B sôe#¥.V›vp(|Üê+{
7F8DCEF0 DF D7 FE C3 9A 6D 8A 50 D3 7D 07 8F ED F3 FE 43 ß×þÚmŠPÓ}..íóþC
I still couldn't get any answer from you on why are we finding out what happened. Will that help recover data? I've asked this a few times but no answer from you. Can you please answer: Is there a chance of recovery from the archive?
Many cases are possible.
Some errors are recoverable and some error unrecoverable.
We still don't know exact type of errors in that archive.
Also there is some probability that was some problem with 7-Zip encoder or decoder. So I want to know exact reason of failure.
Without additional information, I can estimate the chance to recover data as 1-3%.