[flexbackup-help] Problem with backup...

[Jim C. <jc...@tl...>]

I have four machines (including the machine that is doing the backing
up) that I am backing up to DAT.  I will paste the config file below.  I
continue to get an error (that doesn't fail if I do it by command line)


I am still not sure why the backup continues to try and grab a copy of
lost+found.  Clearly, there is a permissions problem but sudo is working
on all the machines I'm backing up.  The keyless ssh connections also
work. (note, I have more comments after the screen dump and config dump
in this mail).

Here's a dump of my session:

[backup@web2 ~]$ sudo flexbackup -set tlb

flexbackup version 1.2.1 (http://flexbackup.sourceforge.net)
/etc/flexbackup.conf syntax OK

|------------------------------------------------------------
| Checking /bin/sh on this machine... bash2
| Checking shell on lb1... bash2
| Checking shell on web3... bash2
| Checking shell on web1... bash2
| Checking for required programs on host lb1...
-------------
                                     W A R N I N G
                                     -------------

                           THIS IS A PRIVATE COMPUTER SYSTEM.

This computer system including all related equipment, network devices
(specifically
including Internet access), are provided only for authorized use. All
computer systems
may be monitored for all lawful purposes, including to ensure that their
use is
authorized, for management of the system, to facilitate protection
against unauthorized
access, and to verify security procedures, survivability and operational
security.
Monitoring includes active attacks by authorized personnel and their
entities to test or
verify the security of the system. During monitoring, information may be
examined,
recorded, copied and used for authorized purposes. All information
including personal
information, placed on or sent over this system may be monitored. Uses
of this system,
authorized or unauthorized, constitutes consent to monitoring of this
system.
Unauthorized use may subject you to criminal prosecution. Evidence of
any such
unauthorized use collected during monitoring may be used for
administrative, criminal or
other adverse action. Use of this system constitutes consent to
monitoring for these
purposes.



Ok
| Checking for required programs on host web3...
-------------
                                     W A R N I N G
                                     -------------

                           THIS IS A PRIVATE COMPUTER SYSTEM.

This computer system including all related equipment, network devices
(specifically
including Internet access), are provided only for authorized use. All
computer systems
may be monitored for all lawful purposes, including to ensure that their
use is
authorized, for management of the system, to facilitate protection
against unauthorized
access, and to verify security procedures, survivability and operational
security.
Monitoring includes active attacks by authorized personnel and their
entities to test or
verify the security of the system. During monitoring, information may be
examined,
recorded, copied and used for authorized purposes. All information
including personal
information, placed on or sent over this system may be monitored. Uses
of this system,
authorized or unauthorized, constitutes consent to monitoring of this
system.
Unauthorized use may subject you to criminal prosecution. Evidence of
any such
unauthorized use collected during monitoring may be used for
administrative, criminal or
other adverse action. Use of this system constitutes consent to
monitoring for these
purposes.



Ok
| Checking for required programs on host web1...
-------------
                                     W A R N I N G
                                     -------------

                           THIS IS A PRIVATE COMPUTER SYSTEM.

This computer system including all related equipment, network devices
(specifically
including Internet access), are provided only for authorized use. All
computer systems
may be monitored for all lawful purposes, including to ensure that their
use is
authorized, for management of the system, to facilitate protection
against unauthorized
access, and to verify security procedures, survivability and operational
security.
Monitoring includes active attacks by authorized personnel and their
entities to test or
verify the security of the system. During monitoring, information may be
examined,
recorded, copied and used for authorized purposes. All information
including personal
information, placed on or sent over this system may be monitored. Uses
of this system,
authorized or unauthorized, constitutes consent to monitoring of this
system.
Unauthorized use may subject you to criminal prosecution. Evidence of
any such
unauthorized use collected during monitoring may be used for
administrative, criminal or
other adverse action. Use of this system constitutes consent to
monitoring for these
purposes.



Ok
|------------------------------------------------------------
| Doing level 0 backup of set tlb using star
| ERROR: Tape doesn't have an index! (use -newtape?)
| Making sure tape is at end of data...
| Backup set "tlb" (lb1:/boot lb1:/etc lb1:/root lb1:/usr/sbin
lb1:/usr/bin lb1:/home lb1:/bin lb1:/sbin lb1:/lib lb1:/var/log
lb1:/var/backup lb1:/usr/lib lb1:/usr/local/src web1:/home web1:/var/log
web1:/boot /root web1:/etc web1:/var/backup web1:/usr/bin web1:/usr/sbin
web1:/sbin web1:/bin web1:/usr/lib web1:/lib /home /var/log /root /boot
/etc /var/backup /usr/sbin /usr/bin /sbin /bin /lib /usr/lib web3:/etc
web3:/boot web3:/root web3:/var/log web3:/var/backup web3:/usr/local
web3:/usr/bin web3:/usr/sbin web3:/bin)
| Tape #0
|------------------------------------------------------------
At block 0.
|------------------------------------------------------------
| Backup of: lb1:/boot
| Date of this level 0 backup: Fri Mar 18 09:01:55 2005
| Date of last level 0 backup: the epoch
|------------------------------------------------------------
| ssh -l backup lb1 'cd "/boot" && find . -depth -xdev ! -type s !
-regex \
|   ".*/[Cc]ache/.*" ! -regex ".*~"$ ! -regex "lost+found" -print | sudo
\
|   star -c list=3D- -p -l -D -B -dirmode VOLHDR=3D"level 0 lb1:/boot =
Fri
Mar \
|   18 09:01:55 2005 star+gzip from web2.tlb.local" H=3Dexustar -fifo \
|   -fifostats -acl -v -sparse -atime blocks=3D20 file=3D- | gzip -9; \
|   x=3D(${PIPESTATUS[@]}); i=3D0; while [ $i -lt ${#x[@]} ]; do [ =
${x[$i]}
-eq \
|   0 ] || exit ${x[$i]}; i=3D$(($i+1)); done' | dd ibs=3D10k obs=3D10k =
\
|   conv=3Dnoerror,sync of=3D"/dev/tape"
|------------------------------------------------------------
                                     -------------
                                     W A R N I N G
                                     -------------

                           THIS IS A PRIVATE COMPUTER SYSTEM.

This computer system including all related equipment, network devices
(specifically
including Internet access), are provided only for authorized use. All
computer systems
may be monitored for all lawful purposes, including to ensure that their
use is
authorized, for management of the system, to facilitate protection
against unauthorized
access, and to verify security procedures, survivability and operational
security.
Monitoring includes active attacks by authorized personnel and their
entities to test or
verify the security of the system. During monitoring, information may be
examined,
recorded, copied and used for authorized purposes. All information
including personal
information, placed on or sent over this system may be monitored. Uses
of this system,
authorized or unauthorized, constitutes consent to monitoring of this
system.
Unauthorized use may subject you to criminal prosecution. Evidence of
any such
unauthorized use collected during monitoring may be used for
administrative, criminal or
other adverse action. Use of this system constitutes consent to
monitoring for these
purposes.



find: ./lost+found: Permission denied
a level 0 lb1:/boot Fri Mar 18 09:01:55 2005 star+gzip from
web2.tlb.local special
a lost+found directory
a grub/grub.conf 565 bytes, 2 tape blocks
a grub/splash.xpm.gz 11050 bytes, 22 tape blocks
a grub/menu.lst symbolic link to ./grub.conf
a grub/device.map 82 bytes, 1 tape blocks
a grub/stage1 512 bytes, 1 tape blocks
a grub/stage2 106364 bytes, 208 tape blocks
a grub/e2fs_stage1_5 7840 bytes, 16 tape blocks
a grub/fat_stage1_5 7536 bytes, 15 tape blocks
a grub/ffs_stage1_5 6880 bytes, 14 tape blocks
a grub/jfs_stage1_5 8448 bytes, 17 tape blocks
a grub/minix_stage1_5 7040 bytes, 14 tape blocks
a grub/reiserfs_stage1_5 9408 bytes, 19 tape blocks
a grub/vstafs_stage1_5 6528 bytes, 13 tape blocks
a grub/xfs_stage1_5 9320 bytes, 19 tape blocks
a grub directory
a message.ja 21282 bytes, 42 tape blocks
a message 23108 bytes, 46 tape blocks
a boot.b 5824 bytes, 12 tape blocks
a chain.b 612 bytes, 2 tape blocks
a os2_d.b 640 bytes, 2 tape blocks
a vmlinuz symbolic link to vmlinuz-2.4.20-20.8.um.1
a System.map symbolic link to System.map-2.4.20-20.8.um.1
a module-info symbolic link to module-info-2.4.20-20.8.um.1
a kernel.h 473 bytes, 1 tape blocks
a module-info-2.4.20-20.8.um.1 15438 bytes, 31 tape blocks
a System.map-2.4.20-20.8.um.1 519383 bytes, 1015 tape blocks
a config-2.4.20-20.8.um.1 44790 bytes, 88 tape blocks
a initrd-2.4.20-20.8.um.1.img 148886 bytes, 291 tape blocks
a vmlinux-2.4.20-20.8.um.1 3175731 bytes, 6203 tape blocks
a vmlinuz-2.4.20-20.8.um.1 1120646 bytes, 2189 tape blocks
a . directory
star: fifo had 125 puts 520 gets.
star: fifo was 1 times empty and 0 times full.
star: fifo held 5181440 bytes max, size was 8396800 bytes
star: 520 blocks + 0 bytes (total of 5324800 bytes =3D 5200.00k).
0+688 records in
688+0 records out

ERROR: non-zero exit from:
ssh -l backup lb1 'cd "/boot" && find . -depth -xdev ! -type s ! -regex
".*/[Cc]ache/.*" ! -regex ".*~"$ ! -regex "lost+found" -print | sudo
star -c list=3D- -p -l -D -B -dirmode VOLHDR=3D"level 0 lb1:/boot Fri =
Mar 18
09:01:55 2005 star+gzip from web2.tlb.local" H=3Dexustar -fifo =
-fifostats
-acl -v -sparse -atime blocks=3D20 file=3D- | gzip -9; =
x=3D(${PIPESTATUS[@]});
i=3D0; while [ $i -lt ${#x[@]} ]; do [ ${x[$i]} -eq 0 ] || exit =
${x[$i]};
i=3D$(($i+1)); done' | dd ibs=3D10k obs=3D10k conv=3Dnoerror,sync =
of=3D"/dev/tape"

ERROR: exiting
|------------------------------------------------------------
| Backup start: Fri Mar 18 09:01:55 2005
| Backup end:   Fri Mar 18 09:02:03 2005
|------------------------------------------------------------
At block 688.
|------------------------------------------------------------
| Rewinding...
| Compressing log (tlb.0.200503180901.gz)
| Linking tlb.latest.gz -> tlb.0.200503180901.gz
|------------------------------------------------------------


Here's a dump of my config file:

[backup@web2 ~]$ sudo cat /etc/flexbackup.conf
# -*-Mode: perl-*-
# ----------------------------------------------------------------------
# Flexbackup configuration file
#   check "flexbackup -help" for usage information
# ----------------------------------------------------------------------
# General configuration section

# Archive type?  afio, dump, tar, cpio, star, pax, zip, lha, ar, shar
# 'copy' or 'rsync' are extra options if running in archive-to-disk
mode.
# 'filelist' dumps a list of files in your cwd - for debugging
setup/exclusion
$type =3D 'star';

# Configure backup "sets".
# Not needed if you use "-dir <dir>" to backup one tree at a time.
# Each set is a simple space-separated list of filesystems
# Remote filesystems should denoted as 'host:dir'
# You can use anything (other than 'all') as set names
#
# Example:
#  $set{'set1'} =3D "/home /usr";
#  $set{'set2'} =3D "/dir3 machine2:/dir4 machine3:/dir5";
#
# "-set all" will back up all defined sets. If you are doing a full
backup
# using tapes, each "set" will go onto a different tape and you will be
# prompted for tape change in between.
#
$set{'tlb'}  =3D 'lb1:/boot '         .
               'lb1:/etc '          .
               'lb1:/root '         .
               'lb1:/usr/sbin '     .
               'lb1:/usr/bin '      .
               'lb1:/home '         .
               'lb1:/bin '          .
               'lb1:/sbin '         .
               'lb1:/lib '          .
               'lb1:/var/log '      .
               'lb1:/var/backup '   .
               'lb1:/usr/lib '      .
               'lb1:/usr/local/src '.
               'web1:/home '        .
               'web1:/var/log '     .
               'web1:/boot /root '  .
               'web1:/etc '         .
               'web1:/var/backup '  .
               'web1:/usr/bin '     .
               'web1:/usr/sbin '    .
               'web1:/sbin '        .
               'web1:/bin '         .
               'web1:/usr/lib '     .
               'web1:/lib '         .
               '/home '             .
               '/var/log '          .
               '/root '             .
               '/boot '             .
               '/etc '              .
               '/var/backup '       .
               '/usr/sbin '         .
               '/usr/bin '          .
               '/sbin '             .
               '/bin '              .
               '/lib '              .
               '/usr/lib '          .
               'web3:/etc '         .
               'web3:/boot '        .
               'web3:/root '        .
               'web3:/var/log '     .
               'web3:/var/backup '  .
               'web3:/usr/local '   .
               'web3:/usr/bin '     .
               'web3:/usr/sbin '    .
               'web3:/bin';

## Individual sets (requires a tape per set
$set{'lb1'}  =3D 'lb1:/boot '.
               'lb1:/etc '.
               'lb1:/root '.
               'lb1:/usr/sbin '.
               'lb1:/usr/bin '.
               'lb1:/home '.
               'lb1:/bin '.
               'lb1:/sbin '.
               'lb1:/lib '.
               'lb1:/var/log '.
               'lb1:/var/backup '.
               'lb1:/usr/lib '.
               'lb1:/usr/local/src';
$set{'web1'} =3D 'web1:/home '.
               'web1:/var/log '.
               'web1:/boot /root '.
               'web1:/etc '.
               'web1:/var/backup '.
               'web1:/usr/bin '.
               'web1:/usr/sbin '.
               'web1:/sbin '.
               'web1:/bin '.
               'web1:/usr/lib '.
               'web1:/lib';
$set{'web2'} =3D '/home /var/log /root /boot /etc /var/backup =
/usr/sbin'.
               '/usr/bin /sbin /bin /lib /usr/lib';
$set{'web3'} =3D 'web3:/etc '.
               'web3:/boot '.
               'web3:/root '.
               'web3:/var/log '.
               'web3:/var/backup '.
               'web3:/usr/local '.
               'web3:/usr/bin '.
               'web3:/usr/sbin '.
               'web3:/bin';

# Subtree pruning
# A space-separated list of directories to prune from each backup.
# Key is a filesystem or host:dir spec as outlined above
# regular expressions allowed (not shell-type wildcards!)
$prune{'/'}     =3D "tmp proc lost+found";
$prune{'/usr'}  =3D "lost+found";
$prune{'/boot'} =3D "lost+found";

# Compression
$compress    =3D 'gzip'; # one of
false/gzip/bzip2/lzop/zip/compress/hardware
$compr_level =3D '9';    # compression level (1-9) (for
gzip/bzip2/lzop/zip)

# Buffering program - to help streaming
$buffer =3D 'false';         # one of false/buffer/mbuffer
$buffer_megs =3D '10';        # buffer memory size (in megabytes)
$buffer_fill_pct =3D '75';    # start writing when buffer this percent
full
$buffer_pause_usec =3D '100'; # pause after write (tape devices only)

# Device to backup to.  -->> non-rewinding version, please! <<--
#
# Examples:
#    Linux SCSI: /dev/nst0     Linux IDE: /dev/nht0
#    Linux ftape: /dev/nqft0   FreeBSD SCSI: /dev/nrsa0 (4.x compat
device node)
#                              FreeBSD SCSI: /dev/nsa0  (5.x)
#
# If a directory, will archive to files in that directory rather than a
device
# If "host:/dev/tapedevice", will use remote tape drive via rsh/ssh
#
$device =3D '/dev/tape';

# Block size (in kilobytes!) to use for archive programs and dd. Default
is
# 10 for most things.  Some tape drives need 32 or 64.  Set to '0' to
# disable all blocking
$blksize =3D '10';

# Block size (in bytes!) to use for the tape device, with "mt setblk" or
# equivalent. If set to 0, will use "variable" block size for the tape
# device (which is recommended). Comment out or set to "$blksize * 1024"
to
# have it be the same as the archiver block size above.
$mt_blksize =3D "0";

# Padding.  True to pad blocks to blocksize
# (devices only, not used when archiving to files)
$pad_blocks =3D 'true';

# Other global flags
$remoteshell =3D 'ssh'; # command for remote shell (rsh/ssh/ssh2)
$remoteuser =3D 'backup'; # if non-null, secondary username for remote
shells
$label =3D 'true';      # somehow store identifying label in archive?
$verbose =3D 'true';    # echo each file?
$sparse =3D 'true';     # handle sparse files?
$indexes =3D 'true';    # false to turn off all table-of-contents =
support

# If backing up to files, use static filenames - no date stamp
# (same level backup of same directory will overwrite old backups)
$staticfiles =3D 'false';

# True to try and preserve file access times during backup, if the
selected
# archive program can do so. Note that if this is true, -cnewer checks
(file
# permission/status changes only, not content) are turned off when
deciding
# which files to archive on the local system.
$atime_preserve =3D 'true';

# Span across filesytems? ("dump" will ignore this option)
# Set to "false" (don't) , "local" (all but nfs/smbfs), or "all"
(everything)
$traverse_fs =3D 'false';

# Exclude files that match these *regular expressions* (not shell
wildcards)
# from the backups (no affect on 'dump' archives). You can list more
than one,
# just keep incrementing the index in the brackets for each.  Also,
strip off
# leading directories (the filesystem specs above or the "-dir" flag).
# Matches paths, not filenames, so put .* on the front/back as needed.
# Comment these out to exclude nothing.
$exclude_expr[0] =3D '.*/[Cc]ache/.*';
$exclude_expr[1] =3D '.*~$';
$exclude_expr[2] =3D '^#.*';
$exclude_expr[2] =3D 'lost+found';

# If true (default), and using a tape device, level zero "set" backups
# assume you want to erase and use a new tape for each set. If false,
level
# zero "set" backups append to tapes.  To force an erase for any backup,
# use "-erase" on the commandline.
$erase_tape_set_level_zero =3D 'false';

# Set this to "true" to make erase operations just call "mt rewind" -
not
# "mt rewind' followed by "mt erase".  (For some tape drives, erase
takes
# hours rather than seconds or is otherwise undesirable)
$erase_rewind_only =3D 'false';

# ----------------------------------------------------------------------
# Log/stamp files, path for temporary files

$logdir =3D '/var/log/flexbackup';   # directory for log files
$comp_log =3D 'gzip';                # compress log?
false/gzip/bzip2/lzop/compress/zip
$staticlogs =3D 'false';             # static log filenames w/ no date
stamp
$prefix =3D '';                # log files will start with this prefix
$tmpdir =3D '/tmp';                  # used for temporary refdate files,
etc
$stampdir =3D '/var/lib/flexbackup'; # directory for backup timestamps
$index =3D '/var/lib/flexbackup/index'; # DB filename for tape indexes
$keyfile =3D '00-index-key';         # filename for keyfile if archiving
to dir
$sprefix =3D '';                     # stamp files will start with this
prefix

# ----------------------------------------------------------------------
# Parameters for 'afio' only

# File extensions that should not be compressed (seperate with spaces)
$afio_nocompress_types =3D 'mp3 MP3 Z z gz gif zip ZIP lha jpeg jpg JPG
taz tgz deb rpm bz2 lzo';

# True to show block numbers
$afio_echo_block =3D 'false';

# Files less than this size (kilobytes) won't be compressed
$afio_compress_threshold =3D '3';

# Maximum amount of memory (megabytes) to use for temporary storage of
# compression results.  If a compressed file is bigger than this,
compression
# will have to run twice on the file (see manpage).
$afio_compress_cache_size =3D '2';

# ----------------------------------------------------------------------
# Parameters for 'tar' only

# True to show record numbers
$tar_echo_record_num =3D 'false';

# ----------------------------------------------------------------------
# Parameters for 'cpio' only

# Format of cpio archive
$cpio_format =3D 'newc';

# ----------------------------------------------------------------------
# Parameters for 'dump' only

# Estimated tape size (in kilobytes). This number doesn't really do much
# but help 'dump' get size estimates if set to zero uses 'dump -a'
$dump_length =3D '0';

# True to use /etc/dumpdates (could mess things up if you dump
subdirectories
# of mount points).  False to use flexbackup's timestamps.
$dump_use_dumpdates =3D 'false';

# ----------------------------------------------------------------------
# Parameters for 'star' only

# Use fifo (buffering)? (you probably want to set $buffer=3Dfalse above =
if
so)
$star_fifo =3D 'true';

# Handle ACLs?
$star_acl =3D 'true';

# Format of star archive
$star_format =3D 'exustar';

# True to show block numbers
$star_echo_block_num =3D 'false';

# ----------------------------------------------------------------------
# Parameters for 'pax' only

# Format of pax archive
$pax_format =3D 'ustar';

# ----------------------------------------------------------------------
# Parameters for 'zip' only

# File extensions that should not be compressed (seperate with spaces)
$zip_nocompress_types =3D 'mp3 MP3 Z z gz gif zip ZIP lha jpeg jpg JPG =
taz
tgz deb rpm bz2 lzo';

# ----------------------------------------------------------------------
# Parameters for 'package delta' backups

# Archive a list of all installed packages in the top level of each
backup?
# Can be 'false', 'true' (save it for any backup), or
# 'rootonly' (saves list only if the filesystem is '/')
$pkgdelta_archive_list =3D 'rootonly';

# Archive files not "owned" by packages?
$pkgdelta_archive_unowned =3D 'true';

# Archive any package-owned files which have been modified?
$pkgdelta_archive_changed =3D 'true';

# ----------------------------------------------------------------------
# Paths to commands. Default will look for them in $PATH. Use this if
# you want to set commands explicitly.  You can use full paths or just
# change command names.
#
# Example: If GNU tar is called "gtar" on your system:
$path{'tar'}  =3D 'sudo tar';
$path{'afio'} =3D 'sudo afio';
$path{'cpio'} =3D 'sudo cpio';
$path{'dump'} =3D 'sudo dump';
$path{'star'} =3D 'sudo star';

#
# Or can be used to "sudo" certain commands. Examples:
#    $path{'find'} =3D 'sudo find';
#    $path{'dump'} =3D 'sudo dump';
#    $path{'afio'} =3D 'sudo -u nonrootuser afio';
#

# ----------------------------------------------------------------------
# mt operation overrides.  Set if flexbackup doesn't know the right mt
# command(s) for your OS/device, or you want to override things.
#
# Example: use "mt status" instead of "mt tell"
#   $mt{'tell'} =3D 'status';


######################################################################
#
# $Id: flexbackup.conf,v 1.74 2003/09/21 22:59:58 edwinh Exp $
# $Name: v1_2_1 $
#
# Leave '1;' on the the next line - for perl 'require'
1;

I ran the -newtape option and it didn't solve the problem.
Additionally, I changed from using buffer and afio to star and that
didn't help anything either.  You know, just troubleshooting.  I thought
there may be an application error or something.

Any help would be greatly appreciated.  Note, that I'm using the tlb set
only (not the all set) because I want to put all the backups onto one
tape for now.

----------------------------------------
Jim Conner -- Senior Systems Engineer=20
818.735.8970- Perl Developer
TLBCreative  http://www.tlbcreative.com
13232 Lindero Rd. Ste 200
Westlake Village,CA 91361