[Bacula-bugs] [bacula 0001813]: VolumeToCatalog verify fails where Director attempts to check one m

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

A NOTE has been added to this issue. 
====================================================================== 
http://bugs.bacula.org/view.php?id=1813 
====================================================================== 
Reported By:                starlight
Assigned To:                
====================================================================== 
Project:                    bacula
Issue ID:                   1813
Category:                   Director
Reproducibility:            have not tried
Severity:                   minor
Priority:                   normal
Status:                     feedback
====================================================================== 
Date Submitted:             2012-01-08 20:08 UTC
Last Modified:              2012-11-18 15:15 UTC
====================================================================== 
Summary:                    VolumeToCatalog verify fails where Director attempts
to check one more file than exists in jobs
Description: 
On all the Windows client systems the VolumeToCatalog verify is failing
consistenly on all jobs.  The Client daemon status shows the correct number of
file and a status of OK, the Storage daemon reports a status of OK with zero
files, but the Director daemon reports an error while attempting to verify one
more file than is present in each job.  The number of files was confirmed by
running 'bls'.

Sample job output attached.

Steps to Reproduce: 
Run backup and VolumeToCatalog verify on Windows client.

Additional Information: 
BTW it would be nice if one could run a VolumeToCatalog verify job from a
different client node (e.g. the one running the Director).  We have a bunch of
development servers with various older OSs that are used for compiling and
testing, but remain powered down most of the time.  Presently one cannot verify
the backup volumes for these unless they are powered up, so it can't be
scheduled automatically.  Such a feature would also appeal to sites with large
numbers of laptops which may be down or disconnected.

Another nice feature would be a way to somehow specify that all jobs for a
particular client be VolumeToCatalog verified in a job definition.  I may end up
writing a script that does this, but it would be handy to be able to program
such a verify more easily.

====================================================================== 

---------------------------------------------------------------------- 
 (0006332) kern (administrator) - 2012-05-24 07:12
 http://bugs.bacula.org/view.php?id=1813#c6332 
---------------------------------------------------------------------- 
Something is clearly failing. 

In order to reproduce this and fix it, please provide:

1. The output from the original job of one of the ones that is failing
2. Your bacula-dir.conf file, particularly the FileSets that are involved.
3. The exact commands you use to create and run the jobs that fail.

---------------------------------------------------------------------- 
 (0006524) elemay (reporter) - 2012-10-11 11:26
 http://bugs.bacula.org/view.php?id=1813#c6524 
---------------------------------------------------------------------- 
Hi,

i have the exact same problem.

bacula 5.2.5 (director - Ubuntu 12.04 x64,sd - Ubuntu 12.04 x64 and fd - Windows
XP Pro i386)

FileSet:

FileSet {
  Name = "LC"
  Include {
    Options {
      signature = SHA1
      compression = GZIP
      verify = pins1
      recurse = yes
      sparse = yes
      check file changes = yes
      ignore case = yes
    }
    File = "c:/LC"
    Exclude Dir Containing = "excludemefrombackup.txt"
  }

Output from Backup Job:

11-Oct 10:16 bacula-dir JobId 1893: Start Backup JobId 1893,
Job=LC.2012-10-11_10.16.05_48
11-Oct 10:16 bacula-dir JobId 1893: Using Device "File"
11-Oct 10:16 bacula-sd JobId 1893: Volume "file-0043" previously written, moving
to end of data.
11-Oct 10:16 bacula-sd JobId 1893: Ready to append to end of Volume "file-0043"
size=19701238792
11-Oct 10:16 lc-fd JobId 1893: Generate VSS snapshots. Driver="VSS WinXP",
Drive(s)="C"
11-Oct 10:21 lc-fd JobId 1893: VSS Writer (BackupComplete): "Microsoft Writer
(Service State)", State: 0x1 (VSS_WS_STABLE)
11-Oct 10:21 lc-fd JobId 1893: VSS Writer (BackupComplete): "Microsoft Writer
(Bootable State)", State: 0x1 (VSS_WS_STABLE)
11-Oct 10:21 lc-fd JobId 1893: VSS Writer (BackupComplete): "MSDEWriter", State:
0x1 (VSS_WS_STABLE)
11-Oct 10:21 lc-fd JobId 1893: VSS Writer (BackupComplete): "WMI Writer", State:
0x1 (VSS_WS_STABLE)
11-Oct 10:21 bacula-sd JobId 1893: Job write elapsed time = 00:05:26, Transfer
rate = 4.801 M Bytes/second
11-Oct 10:21 bacula-sd JobId 1893: Sending spooled attrs to the Director.
Despooling 44,003,801 bytes ...
11-Oct 12:20 bacula-dir JobId 1893: Bacula bacula-dir 5.2.5 (26Jan12):
  Build OS:               x86_64-pc-linux-gnu ubuntu 12.04
  JobId:                  1893
  Job:                    LC.2012-10-11_10.16.05_48
  Backup Level:           Full
  Client:                 "lc-fd" 5.2.5 (26Jan12) Microsoft Windows XP
Professional Service Pack 3 (build 2600),Cross-compile,Win32
  FileSet:                "LC" 2012-08-08 20:41:09
  Pool:                   "File" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "File" (From Pool resource)
  Scheduled time:         11-Oct-2012 10:16:02
  Start time:             11-Oct-2012 10:16:08
  End time:               11-Oct-2012 12:20:54
  Elapsed time:           2 hours 4 mins 46 secs
  Priority:               2
  FD Files Written:       144,539
  SD Files Written:       144,539
  FD Bytes Written:       1,543,259,900 (1.543 GB)
  SD Bytes Written:       1,565,295,065 (1.565 GB)
  Rate:                   206.2 KB/s
  Software Compression:   62.9 %
  VSS:                    yes
  Encryption:             no
  Accurate:               yes
  Volume name(s):         file-0043
  Volume Session Id:      34
  Volume Session Time:    1349861399
  Last Volume Bytes:      21,273,219,933 (21.27 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

11-Oct 12:20 bacula-dir JobId 1893: Begin pruning Jobs older than 2 years 6
months 2 days 12 hours .
11-Oct 12:20 bacula-dir JobId 1893: No Jobs found to prune.
11-Oct 12:20 bacula-dir JobId 1893: Begin pruning Files.
11-Oct 12:20 bacula-dir JobId 1893: No Files found to prune.
11-Oct 12:20 bacula-dir JobId 1893: End auto prune.

Output from Verify Job:

11-Oct 12:20 bacula-dir JobId 1894: Verifying against JobId=1893
Job=LC.2012-10-11_10.16.05_48
11-Oct 12:20 bacula-dir JobId 1894: Bootstrap records written to
/var/lib/bacula/bacula-dir.restore.19.bsr
11-Oct 12:20 bacula-dir JobId 1894: Start Verify JobId=1894
Level=VolumeToCatalog Job=LC-Verify.2012-10-11_10.16.10_49
11-Oct 12:20 bacula-dir JobId 1894: Using Device "File"
11-Oct 12:20 bacula-sd JobId 1894: Ready to read from volume "file-0043" on
device "File" (/bacula/archivefiles).
11-Oct 12:20 bacula-sd JobId 1894: Forward spacing Volume "file-0043" to
file:block 4:2521369608.
11-Oct 12:22 bacula-sd JobId 1894: End of Volume at file 4 on device "File"
(/bacula/archivefiles), Volume "file-0043"
11-Oct 12:22 bacula-sd JobId 1894: End of all volumes.
11-Oct 12:22 bacula-dir JobId 1894: Error: Bacula bacula-dir 5.2.5 (26Jan12):
  Build OS:               x86_64-pc-linux-gnu ubuntu 12.04
  JobId:                  1894
  Job:                    LC-Verify.2012-10-11_10.16.10_49
  FileSet:                LC
  Verify Level:           VolumeToCatalog
  Client:                 lc-fd
  Verify JobId:           1893
  Verify Job:             LC
  Start time:             11-Oct-2012 12:20:56
  End time:               11-Oct-2012 12:22:29
  Files Expected:         144,539
  Files Examined:         144,538
  Non-fatal FD errors:    0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            *** Verify Error ***

11-Oct 12:22 bacula-dir JobId 1894: Begin pruning Jobs older than 2 years 6
months 2 days 12 hours .
11-Oct 12:22 bacula-dir JobId 1894: No Jobs found to prune.
11-Oct 12:22 bacula-dir JobId 1894: Begin pruning Files.
11-Oct 12:22 bacula-dir JobId 1894: No Files found to prune.
11-Oct 12:22 bacula-dir JobId 1894: End auto prune.

How i started the Jobs:

both of the above jobs i started manually, but the same effect occurs if its
scheduled.

cheers 

---------------------------------------------------------------------- 
 (0006547) compass (reporter) - 2012-11-18 15:15
 http://bugs.bacula.org/view.php?id=1813#c6547 
---------------------------------------------------------------------- 
Have same problem.  Config and output attached. 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2012-01-08 20:08 starlight      New Issue                                    
2012-01-08 20:08 starlight      File Added: w2k3r2_x64_verify_error_output.txt  

2012-05-24 07:12 kern           Note Added: 0006332                          
2012-05-24 07:12 kern           Status                   new => feedback     
2012-10-11 11:26 elemay         Note Added: 0006524                          
2012-11-18 15:15 compass        Note Added: 0006547                          
======================================================================

[Bacula-bugs] [bacula 0001813]: VolumeToCatalog verify fails where Director attempts to check one m

[Bacula-bugs] [bacula 0001813]: VolumeToCatalog verify fails where Director attempts to check one more file than exists in jobs