flexbackup-help — Support/help/usage

[flexbackup-help] Problem using -pipe

[Paulo da S. <psd...@es...>]

Hi!

If I use -pipe (flexbackup -dir foo -pipe | split -b ... -
/bar/SomePrefix_) how do I then extract files using flexbackup?

This does not work:
cat /bar/SomePrefix_* | flexbackup -extract -onefile SomeFile -pipe

Thanks for any help

[flexbackup-help] A problem (BUG?) using afio

[Paulo da S. <psd...@es...>]

Hi!

I am just trying flexbackup using afio. afio, when processing a big
file, one requiring a special not cpio compatible header, causes a
warning to be issued. Unfortunately flexbackup "aborts". Using
-ignore-errors works but I think this is a poor solution since it may
mask other pertinent errors.

Thanks for any comments.

[flexbackup-help] re-set date of full backup

[Bas v. d. B. <bv...@ch...>]

Hello,

I have flexbackup running to make a diff every week on a different 
partition. This diff is then ftp'd to an external fileserver. If this is 
succesfull I have a copy of the complete server, so I'd like flexbackup 
to start making diff-backups from that point on. How do I do this 
without making a full backup first, am I missing something obvious here?

I'd think I would have to use flexbackup -newtape, is this correct? It 
throws me the following error which is a config-problem I guess...

*> flexbackup -newtape*

flexbackup version 1.2.1 (http://flexbackup.sourceforge.net)
/etc/flexbackup.conf syntax OK

 $buffer not found in config: default=false

Errors:
 sudo afio not found in $PATH


thanks in advance...

Bas

[flexbackup-help] NFS and OpenBSD support

[Preston A. E. <pr...@go...>]

Hi,

I'm using flexbackup on my OpenBSD box.  I wanted flexbackup to support
being able to mount remote filesystems via. NFS, do the backup, and then
unmount them again.  Handling any failure conditions appropriately, of
course :)

Since neither OpenBSD was correctly supported (find does not support -regex
on OpenBSD), and mounting via. NFS was supported, I added both :)

The patch for this support is available at:
http://www.goth.net/~prez/flexbackup-1.2.1-nfs_openbsd.patch.gz

Note, this enables support for using NFS within the sets, nowhere else in
the file.  Basically instead of using rsh/ssh, it will use nfs.

There are a few new options added to the config file, they are:

$remotestyle    - values are 'shell' or 'nfs' (using 'shell' will have all
remote entries listed in sets use ssh/rsh, 'nfs' will try to mount them,
defaults to 'nfs').
$nfs_mount      - The command to use to mount your NFS partition (defaults
to just 'mount', but you can use this to add arguments to this command).
$nfs_umount     - The command to unmount the mounted NFS partition (defaults
to 'umount').
$nfs_mountpoint - Where we want to mount the NFS partition to (defaults to
'/mnt').

Also, for OpenBSD support, you will be required to have egrep and tr on your
system (they're standard utilities, so they should exist).

Hope you find it useful :)

PreZ :)

Re: [flexbackup-help] gzip not reaped.

[Steven W. O. <st...@sy...>]

On Monday, Nov 27th 2006 at 10:20 -0500, quoth Steven W. Orr:

=>On Saturday, Nov 25th 2006 at 10:29 -0500, quoth Steven W. Orr:
=>
=>=>On Friday, Nov 24th 2006 at 22:33 -0500, quoth Steven W. Orr:
=>=>
=>=>=>
=>=>=>Ok. I got a new one today and I'm leaving it around so we can figure this 
=>=>=>thing out.
=>=>=>
=>=>=>Here's the cron tree:
=>=>=>
=>=>=> 3480 ?        Ss     0:01 crond
=>=>=>16571 ?        S      0:00  \_ crond
=>=>=>16572 ?        Ss     0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>=>=>16846 ?        Z      0:00      |   \_ [sh] <defunct>
=>=>=>16573 ?        S      0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>=>=>
=>=>=>And here's the gzip:
=>=>=>
=>=>=>16860 ?        S      0:01 gzip -9
=>=>=>
=>=>=>and ps -ef shows
=>=>=>
=>=>=>root     16860     1  0 03:31 ?        00:00:01 gzip -9
=>=>=>root     16571  3480  0 03:31 ?        00:00:00 crond
=>=>=>root     16572 16571  0 03:31 ?        00:00:00 /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>=>=>smmsp    16573 16571  0 03:31 ?        00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>=>=>root     16846 16572  0 03:31 ?        00:00:00 [sh] <defunct>
=>=>=>
=>=>=>which shows that gzip is now the child of init which means that his parent 
=>=>=>exited and orphaned him. And 16846 seems to not be getting cleanup up by 
=>=>=>flexbackup.
=>=>=>
=>=>=>Anyone have an idea of what this all means?
=>=>
=>=>Next day and we got lucky. It happened again
=>=>
=>=>
=>=>root      3480  0.0  0.0   2668   468 ?        Ss   Aug27   0:01 crond
=>=>root     16571  0.0  0.0   3292   988 ?        S    Nov24   0:00  \_ crond
=>=>root     16572  0.0  0.5   8320  5960 ?        Ss   Nov24   0:00  |   \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>=>root     16846  0.0  0.0      0     0 ?        Z    Nov24   0:00  |   |  \_ [sh] <defunct>
=>=>smmsp    16573  0.0  0.2   7344  2744 ?        S    Nov24   0:00  |   \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>=>root     21193  0.0  0.0   3292   988 ?        S    03:31   0:00  \_ crond
=>=>root     21194  0.0  0.5   8320  5952 ?        Ss   03:31   0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -differential
=>=>root     21377  0.0  0.0      0     0 ?        Z    03:31   0:00      |  \_ [sh] <defunct>
=>=>smmsp    21195  0.0  0.2   7344  2728 ?        S    03:31   0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>=>
=>=>and we now have two gzips owned by init.
=>=>
=>=>526 > ps -ef | grep gzip
=>=>root     16860     1  0 Nov24 ?        00:00:01 gzip -9
=>=>root     21419     1  0 03:31 ?        00:00:03 gzip -9
=>=>steveo    5813  9890  0 10:28 pts/3    00:00:00 grep gzip
=>=>527 > 
=>
=>
=>Ok. I promise I won't post any more examples. I just had one more from 
=>last night.
=>
=> 3480 ?        Ss     0:01 crond
=>16571 ?        S      0:00  \_ crond
=>16572 ?        Ss     0:00  |   \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>16846 ?        Z      0:00  |   |   \_ [sh] <defunct>
=>16573 ?        S      0:00  |   \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>21193 ?        S      0:00  \_ crond
=>21194 ?        Ss     0:00  |   \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -differential
=>21377 ?        Z      0:00  |   |   \_ [sh] <defunct>
=>21195 ?        S      0:00  |   \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>17332 ?        S      0:00  \_ crond
=>17333 ?        Ss     0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>17705 ?        Z      0:00      |   \_ [sh] <defunct>
=>17334 ?        S      0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>
=>524 >  ps -ef | grep gzip
=>root     16860     1  0 Nov24 ?        00:00:01 gzip -9
=>root     21419     1  0 Nov25 ?        00:00:03 gzip -9
=>root     17719     1  0 03:32 ?        00:00:01 gzip -9
=>steveo   12378  3292  0 10:17 pts/5    00:00:00 grep gzip
=>525 >
=>
=>Also, I included my flexbackup.conf, if that helps. Thanks.
=>
=>$type = 'afio';
=>$set{'backup'} = "/e/web /usr/share/emacs/site-lisp /usr/local /etc /boot 
=>/root /var/spool/mail /var/log";
=>$prune{'/e/web'} = "steveo/mpg";
=>$compress = 'gzip'; # one of false/gzip/bzip2/lzop/zip/compress/hardware
=>$compr_level = '9'; # compression level (1-9) (for gzip/bzip2/lzop/zip)
=>$buffer = 'buffer';         # one of false/buffer/mbuffer
=>$buffer_megs = '10';        # buffer memory size (in megabytes)
=>$buffer_fill_pct = '75';    # start writing when buffer this percent full
=>$buffer_pause_usec = '100'; # pause after write (tape devices only)
=>$device = '/d2/backup';
=>$blksize = '10';
=>$mt_blksize = "0";
=>$pad_blocks = 'true';
=>$remoteshell = 'ssh'; # command for remote shell (rsh/ssh/ssh2)
=>$remoteuser = '';     # if non-null, secondary username for remote shells
=>$label = 'true';      # somehow store identifying label in archive?
=>$verbose = 'true';    # echo each file?
=>$sparse = 'true';     # handle sparse files?
=>$indexes = 'true';    # false to turn off all table-of-contents support
=>$staticfiles = 'false';
=>$atime_preserve = 'false';
=>$traverse_fs = 'false';
=>$exclude_expr[0] = '.*/[Cc]ache/.*';
=>$exclude_expr[1] = '.*~$';
=>$erase_tape_set_level_zero = 'true';
=>$erase_rewind_only = 'false';
=>$logdir = '/var/log/flexbackup';   # directory for log files
=>$comp_log = 'bzip2';                # compress log? false/gzip/bzip2/lzop/compress/zip
=>$staticlogs = 'false';             # static log filenames w/ no date stamp
=>$prefix = '';                      # log files will start with this prefix
=>$tmpdir = '/tmp';                  # used for temporary refdate files, etc
=>$stampdir = '/var/lib/flexbackup'; # directory for backup timestamps
=>$index = '/var/lib/flexbackup/index'; # DB filename for tape indexes
=>$keyfile = '00-index-key';         # filename for keyfile if archiving to dir
=>$sprefix = '';                     # stamp files will start with this prefix
=>$afio_nocompress_types = 'mp3 MP3 Z z gz gif GIF zip ZIP lha jpeg jpg JPG 
=>taz tgz deb rpm bz2 lzo png';
=>$afio_echo_block = 'false';
=>$afio_compress_threshold = '3';
=>$afio_compress_cache_size = '2';
=>$tar_echo_record_num = 'false';
=>$cpio_format = 'newc';
=>$dump_length = '0';
=>$dump_use_dumpdates = 'false';
=>$star_fifo = 'true';
=>$star_acl = 'true';
=>$star_format = 'exustar';
=>$star_echo_block_num = 'false';
=>$pax_format = 'ustar';
=>$zip_nocompress_types = 'mp3 MP3 Z z gz gif zip ZIP lha jpeg jpg JPG taz tgz deb rpm bz2 lzo';
=>$pkgdelta_archive_list = 'rootonly';
=>$pkgdelta_archive_unowned = 'true';
=>$pkgdelta_archive_changed = 'true';
=>1;

Hi. Sorry to bother people. I have had this problem continue to happen. I 
had problems getting it fully and properly described on the first couple 
of shots, but now that it is I never got anyone to respond. There's an 
article in this month's Linux Journal discussing a backup setup using 
Duplicity. I'd rather not switch, so if anyone can advise on how to fix 
this problem I'd appreciate it. I'm thinking a possible race condition on 
proper child reaping. Can this be fixed?

TIA

-- 
Time flies like the wind. Fruit flies like a banana. Stranger things have  .0.
happened but none stranger than this. Does your driver's license say Organ ..0
Donor?Black holes are where God divided by zero. Listen to me! We are all- 000
individuals! What if this weren't a hypothetical question?
steveo at syslang.net

Re: [flexbackup-help] gzip not reaped.

[Steven W. O. <st...@sy...>]

On Saturday, Nov 25th 2006 at 10:29 -0500, quoth Steven W. Orr:

=>On Friday, Nov 24th 2006 at 22:33 -0500, quoth Steven W. Orr:
=>
=>=>On Wednesday, Nov 22nd 2006 at 10:51 -0500, quoth Charlie Brady:
=>=>
=>=>=>
=>=>=>On Wed, 22 Nov 2006, Steven W. Orr wrote:
=>=>=>
=>=>=>> =>Whatever is feeding the standard input of that process has not terminated. 
=>=>=>> =>What does "ps fax" tell you?
=>=>=>> =>
=>=>=>> =>> Do we need to modify flexbackup to set SIG_IGN for SIGCHLD?
=>=>=>> =>
=>=>=>> =>I don't know why you are suggesting that.
=>=>=>> 
=>=>=>> Right. It's not a zombie like I said above, but since it's not, you're 
=>=>=>> correct that the issue of SIG_IGN for SIGCHLD would be a red herring. From 
=>=>=>> the ps output above, it's in a sleep state. Your question about who the 
=>=>=>> parent is is good. I don't remember because I just killed the process 
=>=>=>> after I sent this message but I believe (from previous incidents) it is 
=>=>=>> the child of flexbackup. So the tree should be
=>=>=>> 
=>=>=>> cron
=>=>=>> \_bash
=>=>=>>      \_flexbackup
=>=>=>>           \_gzip
=>=>=>
=>=>=>No, the tree should never be just that. Something should be feeding gzip, 
=>=>=>and gzip should be feeding something. Both "somethings" should be children 
=>=>=>of flexbackup. The exact identity of the "somethings" will depend on your 
=>=>=>configuration.
=>=>=> 
=>=>=>> What I think is happening is that flexbackup is waiting for gzip to 
=>=>=>> complete before it exits. But gzip doesn't exit because it's waiting for 
=>=>=>> more input, not knowing that more isn't coming. 
=>=>=>
=>=>=>Yes, and you need to determine why no more input is coming, and yet the 
=>=>=>program providing such input to gzip has not exited.
=>=>=>
=>=>=>> Sometimes I can go a month without a hangup, and sometimes it hangs 
=>=>=>> multiple times per week. Do we need to wait for a reoccurance or is this 
=>=>=>> enough to be able to work with?
=>=>=>
=>=>=>It's not enough because you haven't given us the full information. Since 
=>=>=>you've killed the gzip process, we can't determine what was feeding it 
=>=>=>input and why it was blocked. If you can show the actual process tree 
=>=>=>rather than what you think "should" be there, then we can provide more 
=>=>=>debugging instructions.
=>=>=>
=>=>=>Perhaps if you describe your configuration someone can speculate about 
=>=>=>what process was blocked and why.
=>=>
=>=>Ok. I got a new one today and I'm leaving it around so we can figure this 
=>=>thing out.
=>=>
=>=>Here's the cron tree:
=>=>
=>=> 3480 ?        Ss     0:01 crond
=>=>16571 ?        S      0:00  \_ crond
=>=>16572 ?        Ss     0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>=>16846 ?        Z      0:00      |   \_ [sh] <defunct>
=>=>16573 ?        S      0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>=>
=>=>And here's the gzip:
=>=>
=>=>16860 ?        S      0:01 gzip -9
=>=>
=>=>and ps -ef shows
=>=>
=>=>root     16860     1  0 03:31 ?        00:00:01 gzip -9
=>=>root     16571  3480  0 03:31 ?        00:00:00 crond
=>=>root     16572 16571  0 03:31 ?        00:00:00 /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>=>smmsp    16573 16571  0 03:31 ?        00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>=>root     16846 16572  0 03:31 ?        00:00:00 [sh] <defunct>
=>=>
=>=>which shows that gzip is now the child of init which means that his parent 
=>=>exited and orphaned him. And 16846 seems to not be getting cleanup up by 
=>=>flexbackup.
=>=>
=>=>Anyone have an idea of what this all means?
=>
=>Next day and we got lucky. It happened again
=>
=>
=>root      3480  0.0  0.0   2668   468 ?        Ss   Aug27   0:01 crond
=>root     16571  0.0  0.0   3292   988 ?        S    Nov24   0:00  \_ crond
=>root     16572  0.0  0.5   8320  5960 ?        Ss   Nov24   0:00  |   \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>root     16846  0.0  0.0      0     0 ?        Z    Nov24   0:00  |   |  \_ [sh] <defunct>
=>smmsp    16573  0.0  0.2   7344  2744 ?        S    Nov24   0:00  |   \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>root     21193  0.0  0.0   3292   988 ?        S    03:31   0:00  \_ crond
=>root     21194  0.0  0.5   8320  5952 ?        Ss   03:31   0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -differential
=>root     21377  0.0  0.0      0     0 ?        Z    03:31   0:00      |  \_ [sh] <defunct>
=>smmsp    21195  0.0  0.2   7344  2728 ?        S    03:31   0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>
=>and we now have two gzips owned by init.
=>
=>526 > ps -ef | grep gzip
=>root     16860     1  0 Nov24 ?        00:00:01 gzip -9
=>root     21419     1  0 03:31 ?        00:00:03 gzip -9
=>steveo    5813  9890  0 10:28 pts/3    00:00:00 grep gzip
=>527 > 


Ok. I promise I won't post any more examples. I just had one more from 
last night.

 3480 ?        Ss     0:01 crond
16571 ?        S      0:00  \_ crond
16572 ?        Ss     0:00  |   \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
16846 ?        Z      0:00  |   |   \_ [sh] <defunct>
16573 ?        S      0:00  |   \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
21193 ?        S      0:00  \_ crond
21194 ?        Ss     0:00  |   \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -differential
21377 ?        Z      0:00  |   |   \_ [sh] <defunct>
21195 ?        S      0:00  |   \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
17332 ?        S      0:00  \_ crond
17333 ?        Ss     0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
17705 ?        Z      0:00      |   \_ [sh] <defunct>
17334 ?        S      0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t

524 >  ps -ef | grep gzip
root     16860     1  0 Nov24 ?        00:00:01 gzip -9
root     21419     1  0 Nov25 ?        00:00:03 gzip -9
root     17719     1  0 03:32 ?        00:00:01 gzip -9
steveo   12378  3292  0 10:17 pts/5    00:00:00 grep gzip
525 >

Also, I included my flexbackup.conf, if that helps. Thanks.

$type = 'afio';
$set{'backup'} = "/e/web /usr/share/emacs/site-lisp /usr/local /etc /boot 
/root /var/spool/mail /var/log";
$prune{'/e/web'} = "steveo/mpg";
$compress = 'gzip'; # one of false/gzip/bzip2/lzop/zip/compress/hardware
$compr_level = '9'; # compression level (1-9) (for gzip/bzip2/lzop/zip)
$buffer = 'buffer';         # one of false/buffer/mbuffer
$buffer_megs = '10';        # buffer memory size (in megabytes)
$buffer_fill_pct = '75';    # start writing when buffer this percent full
$buffer_pause_usec = '100'; # pause after write (tape devices only)
$device = '/d2/backup';
$blksize = '10';
$mt_blksize = "0";
$pad_blocks = 'true';
$remoteshell = 'ssh'; # command for remote shell (rsh/ssh/ssh2)
$remoteuser = '';     # if non-null, secondary username for remote shells
$label = 'true';      # somehow store identifying label in archive?
$verbose = 'true';    # echo each file?
$sparse = 'true';     # handle sparse files?
$indexes = 'true';    # false to turn off all table-of-contents support
$staticfiles = 'false';
$atime_preserve = 'false';
$traverse_fs = 'false';
$exclude_expr[0] = '.*/[Cc]ache/.*';
$exclude_expr[1] = '.*~$';
$erase_tape_set_level_zero = 'true';
$erase_rewind_only = 'false';
$logdir = '/var/log/flexbackup';   # directory for log files
$comp_log = 'bzip2';                # compress log? false/gzip/bzip2/lzop/compress/zip
$staticlogs = 'false';             # static log filenames w/ no date stamp
$prefix = '';                      # log files will start with this prefix
$tmpdir = '/tmp';                  # used for temporary refdate files, etc
$stampdir = '/var/lib/flexbackup'; # directory for backup timestamps
$index = '/var/lib/flexbackup/index'; # DB filename for tape indexes
$keyfile = '00-index-key';         # filename for keyfile if archiving to dir
$sprefix = '';                     # stamp files will start with this prefix
$afio_nocompress_types = 'mp3 MP3 Z z gz gif GIF zip ZIP lha jpeg jpg JPG 
taz tgz deb rpm bz2 lzo png';
$afio_echo_block = 'false';
$afio_compress_threshold = '3';
$afio_compress_cache_size = '2';
$tar_echo_record_num = 'false';
$cpio_format = 'newc';
$dump_length = '0';
$dump_use_dumpdates = 'false';
$star_fifo = 'true';
$star_acl = 'true';
$star_format = 'exustar';
$star_echo_block_num = 'false';
$pax_format = 'ustar';
$zip_nocompress_types = 'mp3 MP3 Z z gz gif zip ZIP lha jpeg jpg JPG taz tgz deb rpm bz2 lzo';
$pkgdelta_archive_list = 'rootonly';
$pkgdelta_archive_unowned = 'true';
$pkgdelta_archive_changed = 'true';
1;

Re: [flexbackup-help] gzip not reaped.

[Steven W. O. <st...@sy...>]

On Friday, Nov 24th 2006 at 22:33 -0500, quoth Steven W. Orr:

=>On Wednesday, Nov 22nd 2006 at 10:51 -0500, quoth Charlie Brady:
=>
=>=>
=>=>On Wed, 22 Nov 2006, Steven W. Orr wrote:
=>=>
=>=>> =>Whatever is feeding the standard input of that process has not terminated. 
=>=>> =>What does "ps fax" tell you?
=>=>> =>
=>=>> =>> Do we need to modify flexbackup to set SIG_IGN for SIGCHLD?
=>=>> =>
=>=>> =>I don't know why you are suggesting that.
=>=>> 
=>=>> Right. It's not a zombie like I said above, but since it's not, you're 
=>=>> correct that the issue of SIG_IGN for SIGCHLD would be a red herring. From 
=>=>> the ps output above, it's in a sleep state. Your question about who the 
=>=>> parent is is good. I don't remember because I just killed the process 
=>=>> after I sent this message but I believe (from previous incidents) it is 
=>=>> the child of flexbackup. So the tree should be
=>=>> 
=>=>> cron
=>=>> \_bash
=>=>>      \_flexbackup
=>=>>           \_gzip
=>=>
=>=>No, the tree should never be just that. Something should be feeding gzip, 
=>=>and gzip should be feeding something. Both "somethings" should be children 
=>=>of flexbackup. The exact identity of the "somethings" will depend on your 
=>=>configuration.
=>=> 
=>=>> What I think is happening is that flexbackup is waiting for gzip to 
=>=>> complete before it exits. But gzip doesn't exit because it's waiting for 
=>=>> more input, not knowing that more isn't coming. 
=>=>
=>=>Yes, and you need to determine why no more input is coming, and yet the 
=>=>program providing such input to gzip has not exited.
=>=>
=>=>> Sometimes I can go a month without a hangup, and sometimes it hangs 
=>=>> multiple times per week. Do we need to wait for a reoccurance or is this 
=>=>> enough to be able to work with?
=>=>
=>=>It's not enough because you haven't given us the full information. Since 
=>=>you've killed the gzip process, we can't determine what was feeding it 
=>=>input and why it was blocked. If you can show the actual process tree 
=>=>rather than what you think "should" be there, then we can provide more 
=>=>debugging instructions.
=>=>
=>=>Perhaps if you describe your configuration someone can speculate about 
=>=>what process was blocked and why.
=>
=>Ok. I got a new one today and I'm leaving it around so we can figure this 
=>thing out.
=>
=>Here's the cron tree:
=>
=> 3480 ?        Ss     0:01 crond
=>16571 ?        S      0:00  \_ crond
=>16572 ?        Ss     0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>16846 ?        Z      0:00      |   \_ [sh] <defunct>
=>16573 ?        S      0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>
=>And here's the gzip:
=>
=>16860 ?        S      0:01 gzip -9
=>
=>and ps -ef shows
=>
=>root     16860     1  0 03:31 ?        00:00:01 gzip -9
=>root     16571  3480  0 03:31 ?        00:00:00 crond
=>root     16572 16571  0 03:31 ?        00:00:00 /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
=>smmsp    16573 16571  0 03:31 ?        00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
=>root     16846 16572  0 03:31 ?        00:00:00 [sh] <defunct>
=>
=>which shows that gzip is now the child of init which means that his parent 
=>exited and orphaned him. And 16846 seems to not be getting cleanup up by 
=>flexbackup.
=>
=>Anyone have an idea of what this all means?

Next day and we got lucky. It happened again


root      3480  0.0  0.0   2668   468 ?        Ss   Aug27   0:01 crond
root     16571  0.0  0.0   3292   988 ?        S    Nov24   0:00  \_ crond
root     16572  0.0  0.5   8320  5960 ?        Ss   Nov24   0:00  |   \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
root     16846  0.0  0.0      0     0 ?        Z    Nov24   0:00  |   |  \_ [sh] <defunct>
smmsp    16573  0.0  0.2   7344  2744 ?        S    Nov24   0:00  |   \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
root     21193  0.0  0.0   3292   988 ?        S    03:31   0:00  \_ crond
root     21194  0.0  0.5   8320  5952 ?        Ss   03:31   0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -differential
root     21377  0.0  0.0      0     0 ?        Z    03:31   0:00      |  \_ [sh] <defunct>
smmsp    21195  0.0  0.2   7344  2728 ?        S    03:31   0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t

and we now have two gzips owned by init.

526 > ps -ef | grep gzip
root     16860     1  0 Nov24 ?        00:00:01 gzip -9
root     21419     1  0 03:31 ?        00:00:03 gzip -9
steveo    5813  9890  0 10:28 pts/3    00:00:00 grep gzip
527 > 

-- 
Time flies like the wind. Fruit flies like a banana. Stranger things have  .0.
happened but none stranger than this. Does your driver's license say Organ ..0
Donor?Black holes are where God divided by zero. Listen to me! We are all- 000
individuals! What if this weren't a hypothetical question?
steveo at syslang.net

Re: [flexbackup-help] gzip not reaped.

[Steven W. O. <st...@sy...>]

On Wednesday, Nov 22nd 2006 at 10:51 -0500, quoth Charlie Brady:

=>
=>On Wed, 22 Nov 2006, Steven W. Orr wrote:
=>
=>> =>Whatever is feeding the standard input of that process has not terminated. 
=>> =>What does "ps fax" tell you?
=>> =>
=>> =>> Do we need to modify flexbackup to set SIG_IGN for SIGCHLD?
=>> =>
=>> =>I don't know why you are suggesting that.
=>> 
=>> Right. It's not a zombie like I said above, but since it's not, you're 
=>> correct that the issue of SIG_IGN for SIGCHLD would be a red herring. From 
=>> the ps output above, it's in a sleep state. Your question about who the 
=>> parent is is good. I don't remember because I just killed the process 
=>> after I sent this message but I believe (from previous incidents) it is 
=>> the child of flexbackup. So the tree should be
=>> 
=>> cron
=>> \_bash
=>>      \_flexbackup
=>>           \_gzip
=>
=>No, the tree should never be just that. Something should be feeding gzip, 
=>and gzip should be feeding something. Both "somethings" should be children 
=>of flexbackup. The exact identity of the "somethings" will depend on your 
=>configuration.
=> 
=>> What I think is happening is that flexbackup is waiting for gzip to 
=>> complete before it exits. But gzip doesn't exit because it's waiting for 
=>> more input, not knowing that more isn't coming. 
=>
=>Yes, and you need to determine why no more input is coming, and yet the 
=>program providing such input to gzip has not exited.
=>
=>> Sometimes I can go a month without a hangup, and sometimes it hangs 
=>> multiple times per week. Do we need to wait for a reoccurance or is this 
=>> enough to be able to work with?
=>
=>It's not enough because you haven't given us the full information. Since 
=>you've killed the gzip process, we can't determine what was feeding it 
=>input and why it was blocked. If you can show the actual process tree 
=>rather than what you think "should" be there, then we can provide more 
=>debugging instructions.
=>
=>Perhaps if you describe your configuration someone can speculate about 
=>what process was blocked and why.

Ok. I got a new one today and I'm leaving it around so we can figure this 
thing out.

Here's the cron tree:

 3480 ?        Ss     0:01 crond
16571 ?        S      0:00  \_ crond
16572 ?        Ss     0:00      \_ /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
16846 ?        Z      0:00      |   \_ [sh] <defunct>
16573 ?        S      0:00      \_ /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t

And here's the gzip:

16860 ?        S      0:01 gzip -9

and ps -ef shows

root     16860     1  0 03:31 ?        00:00:01 gzip -9
root     16571  3480  0 03:31 ?        00:00:00 crond
root     16572 16571  0 03:31 ?        00:00:00 /usr/bin/perl -w /usr/bin/flexbackup -set backup -incremental
smmsp    16573 16571  0 03:31 ?        00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
root     16846 16572  0 03:31 ?        00:00:00 [sh] <defunct>

which shows that gzip is now the child of init which means that his parent 
exited and orphaned him. And 16846 seems to not be getting cleanup up by 
flexbackup.

Anyone have an idea of what this all means?

-- 
Time flies like the wind. Fruit flies like a banana. Stranger things have  .0.
happened but none stranger than this. Does your driver's license say Organ ..0
Donor?Black holes are where God divided by zero. Listen to me! We are all- 000
individuals! What if this weren't a hypothetical question?
steveo at syslang.net

Re: [flexbackup-help] gzip not reaped.

[Charlie B. <cha...@e-...>]

On Wed, 22 Nov 2006, Steven W. Orr wrote:

> =>Whatever is feeding the standard input of that process has not terminated. 
> =>What does "ps fax" tell you?
> =>
> =>> Do we need to modify flexbackup to set SIG_IGN for SIGCHLD?
> =>
> =>I don't know why you are suggesting that.
> 
> Right. It's not a zombie like I said above, but since it's not, you're 
> correct that the issue of SIG_IGN for SIGCHLD would be a red herring. From 
> the ps output above, it's in a sleep state. Your question about who the 
> parent is is good. I don't remember because I just killed the process 
> after I sent this message but I believe (from previous incidents) it is 
> the child of flexbackup. So the tree should be
> 
> cron
> \_bash
>      \_flexbackup
>           \_gzip

No, the tree should never be just that. Something should be feeding gzip, 
and gzip should be feeding something. Both "somethings" should be children 
of flexbackup. The exact identity of the "somethings" will depend on your 
configuration.
 
> What I think is happening is that flexbackup is waiting for gzip to 
> complete before it exits. But gzip doesn't exit because it's waiting for 
> more input, not knowing that more isn't coming. 

Yes, and you need to determine why no more input is coming, and yet the 
program providing such input to gzip has not exited.

> Sometimes I can go a month without a hangup, and sometimes it hangs 
> multiple times per week. Do we need to wait for a reoccurance or is this 
> enough to be able to work with?

It's not enough because you haven't given us the full information. Since 
you've killed the gzip process, we can't determine what was feeding it 
input and why it was blocked. If you can show the actual process tree 
rather than what you think "should" be there, then we can provide more 
debugging instructions.

Perhaps if you describe your configuration someone can speculate about 
what process was blocked and why.

--
Charlie

Re: [flexbackup-help] gzip not reaped.

[Steven W. O. <st...@sy...>]

On Wednesday, Nov 22nd 2006 at 10:01 -0500, quoth Charlie Brady:

=>
=>On Wed, 22 Nov 2006, Steven W. Orr wrote:
=>
=>> I'm running 1.2.1 and on an occasional basis I end up with a gzip process 
=>> that does not get reaped. It's not a zombie process, it's just hanging 
=>> waiting for it's parent to reap it.
=>
=>Your statement doesn't make sense.
=>
=>A zombie is a process which has exited. The process's remains are kept by
=>the kernel waiting for the parent to reap. Running processes (which have
=>not exited) do not wait for their parents to reap them.
=>
=>A process is either still running, or it is a process which is a zombie 
=>and has not been reaped. There's no such thing as a dead process which has 
=>not been reaped which is not a zombie
=>
=>> Here's what ps shows:
=>> 
=>> root     23277  0.0  0.0   1784   592 ?        S    03:31   0:03 gzip -9
=>
=>Whatever is feeding the standard input of that process has not terminated. 
=>What does "ps fax" tell you?
=>
=>> Do we need to modify flexbackup to set SIG_IGN for SIGCHLD?
=>
=>I don't know why you are suggesting that.

Right. It's not a zombie like I said above, but since it's not, you're 
correct that the issue of SIG_IGN for SIGCHLD would be a red herring. From 
the ps output above, it's in a sleep state. Your question about who the 
parent is is good. I don't remember because I just killed the process 
after I sent this message but I believe (from previous incidents) it is 
the child of flexbackup. So the tree should be

cron
\_bash
     \_flexbackup
          \_gzip

What I think is happening is that flexbackup is waiting for gzip to 
complete before it exits. But gzip doesn't exit because it's waiting for 
more input, not knowing that more isn't coming. 

Sometimes I can go a month without a hangup, and sometimes it hangs 
multiple times per week. Do we need to wait for a reoccurance or is this 
enough to be able to work with?

-- 
Time flies like the wind. Fruit flies like a banana. Stranger things have  .0.
happened but none stranger than this. Does your driver's license say Organ ..0
Donor?Black holes are where God divided by zero. Listen to me! We are all- 000
individuals! What if this weren't a hypothetical question?
steveo at syslang.net

Re: [flexbackup-help] gzip not reaped.

[Charlie B. <cha...@e-...>]

On Wed, 22 Nov 2006, Steven W. Orr wrote:

> I'm running 1.2.1 and on an occasional basis I end up with a gzip process 
> that does not get reaped. It's not a zombie process, it's just hanging 
> waiting for it's parent to reap it.

Your statement doesn't make sense.

A zombie is a process which has exited. The process's remains are kept by
the kernel waiting for the parent to reap. Running processes (which have
not exited) do not wait for their parents to reap them.

A process is either still running, or it is a process which is a zombie 
and has not been reaped. There's no such thing as a dead process which has 
not been reaped which is not a zombie

> Here's what ps shows:
> 
> root     23277  0.0  0.0   1784   592 ?        S    03:31   0:03 gzip -9

Whatever is feeding the standard input of that process has not terminated. 
What does "ps fax" tell you?

> Do we need to modify flexbackup to set SIG_IGN for SIGCHLD?

I don't know why you are suggesting that.

> Anybody home?

Lights are on.

[flexbackup-help] gzip not reaped.

[Steven W. O. <st...@sy...>]

I'm running 1.2.1 and on an occasional basis I end up with a gzip process 
that does not get reaped. It's not a zombie process, it's just hanging 
waiting for it's parent to reap it. Here's what ps shows:

root     23277  0.0  0.0   1784   592 ?        S    03:31   0:03 gzip -9

Do we need to modify flexbackup to set SIG_IGN for SIGCHLD?

Anybody home?

TIA

-- 
Time flies like the wind. Fruit flies like a banana. Stranger things have  .0.
happened but none stranger than this. Does your driver's license say Organ ..0
Donor?Black holes are where God divided by zero. Listen to me! We are all- 000
individuals! What if this weren't a hypothetical question?
steveo at syslang.net

Re: [flexbackup-help] Configuration problems (with prune)

[Niall B. <ni...@la...>]

Hi Peter,
I'm not sure how complete the error report below is, but
the regex exclusions are listed on the command line,
and it's also exluding fstype proc which should catch the local one.

You've actually combined two of the suggestions I've made below.
I was suggesting either extending the set to include all below
and leaving your prune lists the way they were, or just using 
$set{'everything'} = "/"; with the extended prune list.
Try rolling back to those two options.
Did you leave in your original sets of prunes in addition
to the new one? I think it would be a good idea.

Also double check the numbering of your exclude expressions.
I see [Cc]ache mentioned, which is the default exclude_expr[0].
Make sure your new ones have unique numbers.

What filesystem are you mounting the remote systems with?
Any chance you can avoid exporting the remote proc directories anyway?

While testing the syntax and exclusions, it could be worth backing up
to a directory rather than to a tape, just to take tape error out of
the equation. If you have the room, just change $device to a directory
name and add that directory name to the exclusions.
It makes it much easier to compare your results too.

"dd: opening `/dev/st0': Read-only file system" looks like you may have
an issue here, so either fix that or sidestep it until the rest of the 
configuration is working.

Good luck,
Niall



> Niall,
>
> thanks so much for your input into this little problem of mine.
>
> I modified my script to be as  you suggested but I'm still having some
> problems with it.
>
> Seems the exclusions are still being ignored, and worse, an error is now being
> generated from the run.
>
> I defined a set call "full" (wouldn't let me make it called "full") and set
> the prune up as per your listing.
>
> This is the outcome:
>
> [root@xacomfw1 etc]# flexbackup -set full
>
> flexbackup version 1.2.1 (http://flexbackup.sourceforge.net)
> /etc/flexbackup.conf syntax OK
>
> |------------------------------------------------------------
> | Checking /bin/sh on this machine... bash2
> |------------------------------------------------------------
> | Doing level 0 backup of set full using tar
> | Retensioning tape...
> | Rewinding & erasing tape...
> | Creating index key 200610181137
> | Backup set "full" (/ /mnt/cxaa /mnt/xacom4 /mnt/xacomfs1)
> | Tape #0
> |------------------------------------------------------------
> At block 0.
> |------------------------------------------------------------
> | File number 1, tape index 200610181137
> | Backup of: /
> | Date of this level 0 backup: Wed Oct 18 11:37:38 2006
> | Date of last level 0 backup: the epoch
> |------------------------------------------------------------
> | cd "/" && find . -regex "\./\(tmp proc var bin sbin lib dev usr \
> |   'lost+found' /mnt/cxaa/mnt /mnt/cxaa/tmp /mnt/cxaa/proc \
> |   /mnt/cxaa/tapedir /mnt/cxaa/var /mnt/cxaa/bin /mnt/cxaa/sbin \
> |   /mnt/cxaa/xemacs /mnt/cxaa/lib /mnt/cxaa/dev /mnt/cxaa/cdrom \
> |   /mnt/cxaa/usr/tmp /mnt/cxaa/usr/lib /mnt/cxaa/usr/bin \
> |   /mnt/cxaa/usr/sbin /mnt/cxaa/usr/spol /mnt/cxaa/usr/test /mnt/cxaa/usr/ \
> |   /mnt/cxaa/usr/local /mnt/cxaa/usr/diag /mnt/cxaa/usr/hung \
> |   /mnt/xacom4/mnt /mnt/xacom4/tmp /mnt/xacom4/proc /mnt/xacom4/var \
> |   /mnt/xacom4/bin /mnt/xacom4/sbin /mnt/xacom4/lib /mnt/xacom4/dev \
> |   /mnt/xacom4/cdrom /mnt/xacom4/install /mnt/xacom4/ibin \
> |   /mnt/xacom4/usr/tmp /mnt/xacom4/usr/bin /mnt/xacom4/usr/sbin \
> |   /mnt/xacom4/usr/lib /mnt/xacom4/usr/local /mnt/xacom4/usr/man \
> |   /mnt/xacom4/usr/fmc2 /mnt/xacom4/usr/lpd /mnt/xacom4/usr/lbin \
> |   /mnt/xacomfs1/tmp /mnt/xacomfs1/registry /mnt/xacomfs1/backups \
> |   '/mnt/xacomfs1/documents/1-to review then delete\)/.*" -prune -o ! \
> |   -fstype proc ! -fstype devpts ! -fstype devfs ! -fstype tmpfs ! -type s \
> |   ! -regex ".*/[Cc]ache/.*" ! -regex ".*~"$ ! -regex ".*/tmp/.*" ! -regex \
> |   ".*/proc/.*" -print0 | tar --create --null --files-from=- \
> |   --ignore-failed-read --same-permissions --no-recursion --totals --label \
> |   "level 0 / Wed Oct 18 11:37:38 2006 tar+gzip from xacomfw1" --verbose \
> |   --sparse -b 64 --file - | gzip -4 | dd ibs=32k obs=32k \
> |   conv=noerror,sync of="/dev/st0"
> |------------------------------------------------------------
> level 0 / Wed Oct 18 11:37:38 2006 tar+gzip from xacomfw1
> dd: opening `/dev/st0': Read-only file system
> ./
> ./lost+found/
> ./u/
> find: ./proc/4168: No such file or directory
> find: ./proc/4168: No such file or directory
> find: ./proc/4168: No such file or directory
> find: ./proc/4168: No such file or directory
> find: ./proc/4168: No such file or directory
> ./var/
> ./var/lib/
> ./var/lib/rpm/
> ./var/lib/rpm/Packages
>
> ERROR: non-zero exit from:
> cd "/" && find . -regex "\./\(tmp proc var bin sbin lib dev
> usr 'lost+found' /mnt/cxaa/mnt /mnt/cxaa/tmp /mnt/cxaa/proc /mnt/cxaa/tapedir /mnt/cxaa/var /mnt/cxaa/bin /mnt/cxaa/sbin /mnt/cxaa/xemacs /mnt/cxaa/lib /mnt/cxaa/dev /mnt/cxaa/cdrom /mnt/cxaa/usr/tmp /mnt/cxaa/usr/lib /mnt/cxaa/usr/bin /mnt/cxaa/usr/sbin /mnt/cxaa/usr/spol /mnt/cxaa/usr/test /mnt/cxaa/usr/ /mnt/cxaa/usr/local /mnt/cxaa/usr/diag /mnt/cxaa/usr/hung /mnt/xacom4/mnt /mnt/xacom4/tmp /mnt/xacom4/proc /mnt/xacom4/var /mnt/xacom4/bin /mnt/xacom4/sbin /mnt/xacom4/lib /mnt/xacom4/dev /mnt/xacom4/cdrom /mnt/xacom4/install /mnt/xacom4/ibin /mnt/xacom4/usr/tmp /mnt/xacom4/usr/bin /mnt/xacom4/usr/sbin /mnt/xacom4/usr/lib /mnt/xacom4/usr/local /mnt/xacom4/usr/man /mnt/xacom4/usr/fmc2 /mnt/xacom4/usr/lpd /mnt/xacom4/usr/lbin /mnt/xacomfs1/tmp /mnt/xacomfs1/registry /mnt/xacomfs1/backups '/mnt/xacomfs1/documents/1-to
> review then delete\)/.*" -prune -o ! -fstype proc ! -fstype devpts ! -fstype
> devfs ! -fstype tmpfs ! -type
> s ! -regex ".*/[Cc]ache/.*" ! -regex ".*~"$ ! -regex ".*/tmp/.*" ! -regex ".*/proc/.*" -print0 |
> tar --create --null --files-from=- --ignore-failed-read --same-permissions --no-recursion --totals --label "level
> 0 / Wed Oct 18 11:37:38 2006 tar+gzip from xacomfw1" --verbose --sparse -b
> 64 --file - | gzip -4 | dd ibs=32k obs=32k conv=noerror,sync of="/dev/st0"
>
> ERROR: exiting
> |------------------------------------------------------------
> | Backup start: Wed Oct 18 11:37:38 2006
> | Backup end:   Wed Oct 18 11:37:39 2006
> |------------------------------------------------------------
> At block 0.
> |------------------------------------------------------------
> | Rewinding...
> | Compressing log (full.0.200610181137.gz)
> | Linking full.latest.gz -> full.0.200610181137.gz
> |------------------------------------------------------------
>
>
> Any more ideas?
>
> Ta.
>
> Peter.
>
> On Tuesday 17 October 2006 20:08, Niall Brosnan wrote:
>>> Peter Nunn wrote:
>>> I seem to be having some serious problems getting flexbackup to exclude
>>> the directories I have in my prune list.
>>>
>>> I have as machine with several others mounted in /mnt and am trying to
>>> backup the important data on them to tape.
>>
>> Hi Peter,
>> could you confirm for me that this works OK for your root
>> filesystem, but fails for the submounted systems?
>> i.e. do you exclude /tmp but include /mnt/cxaa/tmp ?
>>
>> If you want a set with local and the others, you might
>> be better off not spanning filesystems, and instead using
>> $set{'all'} = "/ /mnt/cxaa /mnt/xacom4 /mnt/xacomfs1";
>>
>> I suspect it's not reading the prune lists for those
>> directories that are not included in the "local" set.
>> All my configs fully root excluded paths back to an element in the backup
>> set list.
>> Try this prune list instead with your current local set definition:
>>
>> $prune{'/'} = "tmp proc var bin sbin lib dev usr 'lost+found' /mnt/cxaa/mnt
>> /mnt/cxaa/tmp /mnt/cxaa/proc /mnt/cxaa/tapedir /mnt/cxaa/var /mnt/cxaa/bin
>> /mnt/cxaa/sbin /mnt/cxaa/xemacs /mnt/cxaa/lib /mnt/cxaa/dev /mnt/cxaa/cdrom
>> /mnt/cxaa/usr/tmp /mnt/cxaa/usr/lib /mnt/cxaa/usr/bin /mnt/cxaa/usr/sbin
>> /mnt/cxaa/usr/spol /mnt/cxaa/usr/test /mnt/cxaa/usr/ /mnt/cxaa/usr/local
>> /mnt/cxaa/usr/diag /mnt/cxaa/usr/hung /mnt/xacom4/mnt /mnt/xacom4/tmp
>> /mnt/xacom4/proc /mnt/xacom4/var /mnt/xacom4/bin /mnt/xacom4/sbin
>> /mnt/xacom4/lib /mnt/xacom4/dev /mnt/xacom4/cdrom /mnt/xacom4/install
>> /mnt/xacom4/ibin /mnt/xacom4/usr/tmp /mnt/xacom4/usr/bin
>> /mnt/xacom4/usr/sbin /mnt/xacom4/usr/lib /mnt/xacom4/usr/local
>> /mnt/xacom4/usr/man
>> /mnt/xacom4/usr/fmc2 /mnt/xacom4/usr/lpd /mnt/xacom4/usr/lbin
>> /mnt/xacomfs1/tmp /mnt/xacomfs1/registry /mnt/xacomfs1/backups
>> '/mnt/xacomfs1/documents/1-to review then delete'";
>>
>>
>> These expressions may also help:
>> $exclude_expr[0] = '.*/proc/.*';
>> $exclude_expr[1] = '.*/tmp/.*';
>>
>> Finally, what backup format are you using?
>> If you're using dump, then some of these excludes won't work, but then
>> you couldn't be using it for the non local mounts anyway.
>>
>> Hope that helps to some degree.
>> I'll check in later today to see if you've had a chance to test it.
>> I'm in Ireland, so we'll be a bit out of sync.
>>
>> All the best,
>> Niall Brosnan
>> CsC
>>
>>> I seem to be having some serious problems getting flexbackup to exclude
>>> the directories I have in my prune list.
>>>
>>> I have as machine with several others mounted in /mnt and am trying to
>>> backup the important data on them to tape.
>>>
>>> My setup looks like...
>>>
>>> $set{'local'} = "/";
>>> $set{'cxaa'} = "/mnt/cxaa";
>>> $set{'xacom4'} = "/mnt/xacom4";
>>> $set{'xacomfs1'} = "/mnt/xacomfs1";
>>>
>>> where local basically gets everything and the others should let me chose
>>> an individual machine if I want to go that way.
>>>
>>> The prunes are as follows...
>>>
>>> $prune{'/'} = "tmp proc var bin sbin lib dev usr 'lost+found'";
>>> $prune{'/mnt/cxaa'} = "mnt tmp proc tapedir var bin sbin xemacs lib dev
>>> cdrom";
>>> $prune{'/mnt/cxaa/usr'} = "tmp lib bin sbin spol test  local diag hung";
>>> $prune{'/mnt/xacom4'} = "mnt tmp proc var bin sbin lib dev cdrom install
>>> ibin";
>>> $prune{'/mnt/xacom4/usr'} = "tmp bin sbin lib local man fmc2 lpd lbin";
>>> $prune{'/mnt/xacomfs1'} = "tmp registry backups";
>>> $prune{'/mnt/xacomfs1/documents'} =  "'1-to review then delete'
>>> Temp 'Temporary Transfer Location' Testing VET 'WInzip 8.0' 'Social
>>> Events' Year2000 teemp Logs Projects_Backup";
>>>
>>> As I understand it, this should remove the directories mentioned here
>>> from the
>>> list.. however..
>>>
>>> when I do a flexbackup -set local
>>>
>>> I get
>>>
>>> ./var, ./lost+found, ./usr etc etc.. in the list of files being backed
>>> up.
>>>
>>> What do I have wrong??
>>>
>>> Thanks.
>>>
>>> Peter Nunn.
>>>
>>>
>>> --
>>> Use Computes?....                           ...Think IT!
>>>
>>> -------------------------------------------------------------------------
>>> Using Tomcat but need to do more? Need to support web services, security?
>>> Get stuff done quickly with pre-integrated technology to make your job
>>> easier Download IBM WebSphere Application Server v.1.0.1 based on Apache
>>> Geronimo
>>> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>>> _______________________________________________
>>> flexbackup-help mailing list
>>> fle...@li...
>>> https://lists.sourceforge.net/lists/listinfo/flexbackup-help
>>
>> -------------------------------------------------------------------------
>> Using Tomcat but need to do more? Need to support web services, security?
>> Get stuff done quickly with pre-integrated technology to make your job
>> easier Download IBM WebSphere Application Server v.1.0.1 based on Apache
>> Geronimo
>> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>> _______________________________________________
>> flexbackup-help mailing list
>> fle...@li...
>> https://lists.sourceforge.net/lists/listinfo/flexbackup-help
>
> -- 
> Use Computes?....                           ...Think IT!
>

#    The information transmitted in this Notice is intended only for        #
#    the person or entity to which it is addressed and may contain          #
#    confidential and/or privileged material.                               #
#    Any review, reproduction, retransmission, dissemination or other use   #
#    of, or taking of any action in reliance upon, this information by      #
#    persons or entities other than the intended recipient is prohibited.   #

# Niall Brosnan                           # Tel: +353-87-2337386            #
# Communication Systems Consultants       # Fax: +353-1-4926806             #
# Athronan, Dunsany, Co. Meath, Ireland   # mail: ni...@cs... #
# GPG key fingerprint = 597C 0514 95B9 48DD 216F B892 5B51 D257 0D44 5B01   #

Un*x: Because cat is faster than a mouse.

Re: [flexbackup-help] Configuration problems (with prune)

[Peter N. <pn...@in...>]

Niall,

thanks so much for your input into this little problem of mine.

I modified my script to be as  you suggested but I'm still having some 
problems with it.

Seems the exclusions are still being ignored, and worse, an error is now being 
generated from the run.

I defined a set call "full" (wouldn't let me make it called "full") and set 
the prune up as per your listing.

This is the outcome:

[root@xacomfw1 etc]# flexbackup -set full

flexbackup version 1.2.1 (http://flexbackup.sourceforge.net)
/etc/flexbackup.conf syntax OK

|------------------------------------------------------------
| Checking /bin/sh on this machine... bash2
|------------------------------------------------------------
| Doing level 0 backup of set full using tar
| Retensioning tape...
| Rewinding & erasing tape...
| Creating index key 200610181137
| Backup set "full" (/ /mnt/cxaa /mnt/xacom4 /mnt/xacomfs1)
| Tape #0
|------------------------------------------------------------
At block 0.
|------------------------------------------------------------
| File number 1, tape index 200610181137
| Backup of: /
| Date of this level 0 backup: Wed Oct 18 11:37:38 2006
| Date of last level 0 backup: the epoch
|------------------------------------------------------------
| cd "/" && find . -regex "\./\(tmp proc var bin sbin lib dev usr \
|   'lost+found' /mnt/cxaa/mnt /mnt/cxaa/tmp /mnt/cxaa/proc \
|   /mnt/cxaa/tapedir /mnt/cxaa/var /mnt/cxaa/bin /mnt/cxaa/sbin \
|   /mnt/cxaa/xemacs /mnt/cxaa/lib /mnt/cxaa/dev /mnt/cxaa/cdrom \
|   /mnt/cxaa/usr/tmp /mnt/cxaa/usr/lib /mnt/cxaa/usr/bin \
|   /mnt/cxaa/usr/sbin /mnt/cxaa/usr/spol /mnt/cxaa/usr/test /mnt/cxaa/usr/ \
|   /mnt/cxaa/usr/local /mnt/cxaa/usr/diag /mnt/cxaa/usr/hung \
|   /mnt/xacom4/mnt /mnt/xacom4/tmp /mnt/xacom4/proc /mnt/xacom4/var \
|   /mnt/xacom4/bin /mnt/xacom4/sbin /mnt/xacom4/lib /mnt/xacom4/dev \
|   /mnt/xacom4/cdrom /mnt/xacom4/install /mnt/xacom4/ibin \
|   /mnt/xacom4/usr/tmp /mnt/xacom4/usr/bin /mnt/xacom4/usr/sbin \
|   /mnt/xacom4/usr/lib /mnt/xacom4/usr/local /mnt/xacom4/usr/man \
|   /mnt/xacom4/usr/fmc2 /mnt/xacom4/usr/lpd /mnt/xacom4/usr/lbin \
|   /mnt/xacomfs1/tmp /mnt/xacomfs1/registry /mnt/xacomfs1/backups \
|   '/mnt/xacomfs1/documents/1-to review then delete\)/.*" -prune -o ! \
|   -fstype proc ! -fstype devpts ! -fstype devfs ! -fstype tmpfs ! -type s \
|   ! -regex ".*/[Cc]ache/.*" ! -regex ".*~"$ ! -regex ".*/tmp/.*" ! -regex \
|   ".*/proc/.*" -print0 | tar --create --null --files-from=- \
|   --ignore-failed-read --same-permissions --no-recursion --totals --label \
|   "level 0 / Wed Oct 18 11:37:38 2006 tar+gzip from xacomfw1" --verbose \
|   --sparse -b 64 --file - | gzip -4 | dd ibs=32k obs=32k \
|   conv=noerror,sync of="/dev/st0"
|------------------------------------------------------------
level 0 / Wed Oct 18 11:37:38 2006 tar+gzip from xacomfw1
dd: opening `/dev/st0': Read-only file system
./
./lost+found/
./u/
find: ./proc/4168: No such file or directory
find: ./proc/4168: No such file or directory
find: ./proc/4168: No such file or directory
find: ./proc/4168: No such file or directory
find: ./proc/4168: No such file or directory
./var/
./var/lib/
./var/lib/rpm/
./var/lib/rpm/Packages

ERROR: non-zero exit from:
cd "/" && find . -regex "\./\(tmp proc var bin sbin lib dev 
usr 'lost+found' /mnt/cxaa/mnt /mnt/cxaa/tmp /mnt/cxaa/proc /mnt/cxaa/tapedir /mnt/cxaa/var /mnt/cxaa/bin /mnt/cxaa/sbin /mnt/cxaa/xemacs /mnt/cxaa/lib /mnt/cxaa/dev /mnt/cxaa/cdrom /mnt/cxaa/usr/tmp /mnt/cxaa/usr/lib /mnt/cxaa/usr/bin /mnt/cxaa/usr/sbin /mnt/cxaa/usr/spol /mnt/cxaa/usr/test /mnt/cxaa/usr/ /mnt/cxaa/usr/local /mnt/cxaa/usr/diag /mnt/cxaa/usr/hung /mnt/xacom4/mnt /mnt/xacom4/tmp /mnt/xacom4/proc /mnt/xacom4/var /mnt/xacom4/bin /mnt/xacom4/sbin /mnt/xacom4/lib /mnt/xacom4/dev /mnt/xacom4/cdrom /mnt/xacom4/install /mnt/xacom4/ibin /mnt/xacom4/usr/tmp /mnt/xacom4/usr/bin /mnt/xacom4/usr/sbin /mnt/xacom4/usr/lib /mnt/xacom4/usr/local /mnt/xacom4/usr/man /mnt/xacom4/usr/fmc2 /mnt/xacom4/usr/lpd /mnt/xacom4/usr/lbin /mnt/xacomfs1/tmp /mnt/xacomfs1/registry /mnt/xacomfs1/backups '/mnt/xacomfs1/documents/1-to 
review then delete\)/.*" -prune -o ! -fstype proc ! -fstype devpts ! -fstype 
devfs ! -fstype tmpfs ! -type 
s ! -regex ".*/[Cc]ache/.*" ! -regex ".*~"$ ! -regex ".*/tmp/.*" ! -regex ".*/proc/.*" -print0 | 
tar --create --null --files-from=- --ignore-failed-read --same-permissions --no-recursion --totals --label "level 
0 / Wed Oct 18 11:37:38 2006 tar+gzip from xacomfw1" --verbose --sparse -b 
64 --file - | gzip -4 | dd ibs=32k obs=32k conv=noerror,sync of="/dev/st0"

ERROR: exiting
|------------------------------------------------------------
| Backup start: Wed Oct 18 11:37:38 2006
| Backup end:   Wed Oct 18 11:37:39 2006
|------------------------------------------------------------
At block 0.
|------------------------------------------------------------
| Rewinding...
| Compressing log (full.0.200610181137.gz)
| Linking full.latest.gz -> full.0.200610181137.gz
|------------------------------------------------------------


Any more ideas?

Ta.

Peter.

On Tuesday 17 October 2006 20:08, Niall Brosnan wrote:
> > Peter Nunn wrote:
> > I seem to be having some serious problems getting flexbackup to exclude
> > the directories I have in my prune list.
> >
> > I have as machine with several others mounted in /mnt and am trying to
> > backup the important data on them to tape.
>
> Hi Peter,
> could you confirm for me that this works OK for your root
> filesystem, but fails for the submounted systems?
> i.e. do you exclude /tmp but include /mnt/cxaa/tmp ?
>
> If you want a set with local and the others, you might
> be better off not spanning filesystems, and instead using
> $set{'all'} = "/ /mnt/cxaa /mnt/xacom4 /mnt/xacomfs1";
>
> I suspect it's not reading the prune lists for those
> directories that are not included in the "local" set.
> All my configs fully root excluded paths back to an element in the backup
> set list.
> Try this prune list instead with your current local set definition:
>
> $prune{'/'} = "tmp proc var bin sbin lib dev usr 'lost+found' /mnt/cxaa/mnt
> /mnt/cxaa/tmp /mnt/cxaa/proc /mnt/cxaa/tapedir /mnt/cxaa/var /mnt/cxaa/bin
> /mnt/cxaa/sbin /mnt/cxaa/xemacs /mnt/cxaa/lib /mnt/cxaa/dev /mnt/cxaa/cdrom
> /mnt/cxaa/usr/tmp /mnt/cxaa/usr/lib /mnt/cxaa/usr/bin /mnt/cxaa/usr/sbin
> /mnt/cxaa/usr/spol /mnt/cxaa/usr/test /mnt/cxaa/usr/ /mnt/cxaa/usr/local
> /mnt/cxaa/usr/diag /mnt/cxaa/usr/hung /mnt/xacom4/mnt /mnt/xacom4/tmp
> /mnt/xacom4/proc /mnt/xacom4/var /mnt/xacom4/bin /mnt/xacom4/sbin
> /mnt/xacom4/lib /mnt/xacom4/dev /mnt/xacom4/cdrom /mnt/xacom4/install
> /mnt/xacom4/ibin /mnt/xacom4/usr/tmp /mnt/xacom4/usr/bin
> /mnt/xacom4/usr/sbin /mnt/xacom4/usr/lib /mnt/xacom4/usr/local
> /mnt/xacom4/usr/man
> /mnt/xacom4/usr/fmc2 /mnt/xacom4/usr/lpd /mnt/xacom4/usr/lbin
> /mnt/xacomfs1/tmp /mnt/xacomfs1/registry /mnt/xacomfs1/backups
> '/mnt/xacomfs1/documents/1-to review then delete'";
>
>
> These expressions may also help:
> $exclude_expr[0] = '.*/proc/.*';
> $exclude_expr[1] = '.*/tmp/.*';
>
> Finally, what backup format are you using?
> If you're using dump, then some of these excludes won't work, but then
> you couldn't be using it for the non local mounts anyway.
>
> Hope that helps to some degree.
> I'll check in later today to see if you've had a chance to test it.
> I'm in Ireland, so we'll be a bit out of sync.
>
> All the best,
> Niall Brosnan
> CsC
>
> > I seem to be having some serious problems getting flexbackup to exclude
> > the directories I have in my prune list.
> >
> > I have as machine with several others mounted in /mnt and am trying to
> > backup the important data on them to tape.
> >
> > My setup looks like...
> >
> > $set{'local'} = "/";
> > $set{'cxaa'} = "/mnt/cxaa";
> > $set{'xacom4'} = "/mnt/xacom4";
> > $set{'xacomfs1'} = "/mnt/xacomfs1";
> >
> > where local basically gets everything and the others should let me chose
> > an individual machine if I want to go that way.
> >
> > The prunes are as follows...
> >
> > $prune{'/'} = "tmp proc var bin sbin lib dev usr 'lost+found'";
> > $prune{'/mnt/cxaa'} = "mnt tmp proc tapedir var bin sbin xemacs lib dev
> > cdrom";
> > $prune{'/mnt/cxaa/usr'} = "tmp lib bin sbin spol test  local diag hung";
> > $prune{'/mnt/xacom4'} = "mnt tmp proc var bin sbin lib dev cdrom install
> > ibin";
> > $prune{'/mnt/xacom4/usr'} = "tmp bin sbin lib local man fmc2 lpd lbin";
> > $prune{'/mnt/xacomfs1'} = "tmp registry backups";
> > $prune{'/mnt/xacomfs1/documents'} =  "'1-to review then delete'
> > Temp 'Temporary Transfer Location' Testing VET 'WInzip 8.0' 'Social
> > Events' Year2000 teemp Logs Projects_Backup";
> >
> > As I understand it, this should remove the directories mentioned here
> > from the
> > list.. however..
> >
> > when I do a flexbackup -set local
> >
> > I get
> >
> > ./var, ./lost+found, ./usr etc etc.. in the list of files being backed
> > up.
> >
> > What do I have wrong??
> >
> > Thanks.
> >
> > Peter Nunn.
> >
> >
> > --
> > Use Computes?....                           ...Think IT!
> >
> > -------------------------------------------------------------------------
> > Using Tomcat but need to do more? Need to support web services, security?
> > Get stuff done quickly with pre-integrated technology to make your job
> > easier Download IBM WebSphere Application Server v.1.0.1 based on Apache
> > Geronimo
> > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> > _______________________________________________
> > flexbackup-help mailing list
> > fle...@li...
> > https://lists.sourceforge.net/lists/listinfo/flexbackup-help
>
> -------------------------------------------------------------------------
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job
> easier Download IBM WebSphere Application Server v.1.0.1 based on Apache
> Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> flexbackup-help mailing list
> fle...@li...
> https://lists.sourceforge.net/lists/listinfo/flexbackup-help

-- 
Use Computes?....                           ...Think IT!

Re: [flexbackup-help] Configuration problems (with prune)

[Niall B. <ni...@la...>]

> Peter Nunn wrote:
> I seem to be having some serious problems getting flexbackup to exclude the
> directories I have in my prune list.
> 
> I have as machine with several others mounted in /mnt and am trying to backup
> the important data on them to tape.

Hi Peter,
could you confirm for me that this works OK for your root
filesystem, but fails for the submounted systems?
i.e. do you exclude /tmp but include /mnt/cxaa/tmp ?

If you want a set with local and the others, you might
be better off not spanning filesystems, and instead using
$set{'all'} = "/ /mnt/cxaa /mnt/xacom4 /mnt/xacomfs1";

I suspect it's not reading the prune lists for those
directories that are not included in the "local" set.
All my configs fully root excluded paths back to an element in the backup set 
list.
Try this prune list instead with your current local set definition:

$prune{'/'} = "tmp proc var bin sbin lib dev usr 'lost+found' /mnt/cxaa/mnt 
/mnt/cxaa/tmp /mnt/cxaa/proc /mnt/cxaa/tapedir /mnt/cxaa/var /mnt/cxaa/bin 
/mnt/cxaa/sbin /mnt/cxaa/xemacs /mnt/cxaa/lib /mnt/cxaa/dev /mnt/cxaa/cdrom 
/mnt/cxaa/usr/tmp /mnt/cxaa/usr/lib /mnt/cxaa/usr/bin /mnt/cxaa/usr/sbin 
/mnt/cxaa/usr/spol /mnt/cxaa/usr/test /mnt/cxaa/usr/ /mnt/cxaa/usr/local 
/mnt/cxaa/usr/diag /mnt/cxaa/usr/hung /mnt/xacom4/mnt /mnt/xacom4/tmp 
/mnt/xacom4/proc /mnt/xacom4/var /mnt/xacom4/bin /mnt/xacom4/sbin 
/mnt/xacom4/lib /mnt/xacom4/dev /mnt/xacom4/cdrom /mnt/xacom4/install 
/mnt/xacom4/ibin /mnt/xacom4/usr/tmp /mnt/xacom4/usr/bin /mnt/xacom4/usr/sbin 
/mnt/xacom4/usr/lib /mnt/xacom4/usr/local /mnt/xacom4/usr/man 
/mnt/xacom4/usr/fmc2 /mnt/xacom4/usr/lpd /mnt/xacom4/usr/lbin /mnt/xacomfs1/tmp 
/mnt/xacomfs1/registry /mnt/xacomfs1/backups '/mnt/xacomfs1/documents/1-to 
review then delete'";


These expressions may also help:
$exclude_expr[0] = '.*/proc/.*';
$exclude_expr[1] = '.*/tmp/.*';

Finally, what backup format are you using?
If you're using dump, then some of these excludes won't work, but then
you couldn't be using it for the non local mounts anyway.

Hope that helps to some degree.
I'll check in later today to see if you've had a chance to test it.
I'm in Ireland, so we'll be a bit out of sync.

All the best,
Niall Brosnan
CsC

> I seem to be having some serious problems getting flexbackup to exclude the
> directories I have in my prune list.
> 
> I have as machine with several others mounted in /mnt and am trying to backup
> the important data on them to tape.
> 
> My setup looks like...
> 
> $set{'local'} = "/";
> $set{'cxaa'} = "/mnt/cxaa";
> $set{'xacom4'} = "/mnt/xacom4";
> $set{'xacomfs1'} = "/mnt/xacomfs1";
> 
> where local basically gets everything and the others should let me chose an
> individual machine if I want to go that way.
> 
> The prunes are as follows...
> 
> $prune{'/'} = "tmp proc var bin sbin lib dev usr 'lost+found'";
> $prune{'/mnt/cxaa'} = "mnt tmp proc tapedir var bin sbin xemacs lib dev
> cdrom";
> $prune{'/mnt/cxaa/usr'} = "tmp lib bin sbin spol test  local diag hung";
> $prune{'/mnt/xacom4'} = "mnt tmp proc var bin sbin lib dev cdrom install
> ibin";
> $prune{'/mnt/xacom4/usr'} = "tmp bin sbin lib local man fmc2 lpd lbin";
> $prune{'/mnt/xacomfs1'} = "tmp registry backups";
> $prune{'/mnt/xacomfs1/documents'} =  "'1-to review then delete'
> Temp 'Temporary Transfer Location' Testing VET 'WInzip 8.0' 'Social Events'
> Year2000 teemp Logs Projects_Backup";
> 
> As I understand it, this should remove the directories mentioned here from 
> the
> list.. however..
> 
> when I do a flexbackup -set local
> 
> I get
> 
> ./var, ./lost+found, ./usr etc etc.. in the list of files being backed up.
> 
> What do I have wrong??
> 
> Thanks.
> 
> Peter Nunn.
> 
> 
> -- 
> Use Computes?....                           ...Think IT!
> 
> -------------------------------------------------------------------------
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> flexbackup-help mailing list
> fle...@li...
> https://lists.sourceforge.net/lists/listinfo/flexbackup-help

Re: [flexbackup-help] Is anyone actually alive on this list?

[Tim B. <ti...@ne...>]

I am, but I can't help.

Peter Nunn wrote:

>Hi folks,
>
>asked a question a few days ago and haven't heard a thing from the list since 
>then... is anyone actually alive out there??
>
>Peter.
>
>  
>

[flexbackup-help] Is anyone actually alive on this list?

[Peter N. <pn...@in...>]

Hi folks,

asked a question a few days ago and haven't heard a thing from the list since 
then... is anyone actually alive out there??

Peter.

-- 
Use Computes?....                           ...Think IT!

[flexbackup-help] Configuration problems (with prune)

[Peter N. <pn...@in...>]

I seem to be having some serious problems getting flexbackup to exclude the 
directories I have in my prune list.

I have as machine with several others mounted in /mnt and am trying to backup 
the important data on them to tape.

My setup looks like...

$set{'local'} = "/";
$set{'cxaa'} = "/mnt/cxaa";
$set{'xacom4'} = "/mnt/xacom4";
$set{'xacomfs1'} = "/mnt/xacomfs1";

where local basically gets everything and the others should let me chose an 
individual machine if I want to go that way.

The prunes are as follows...

$prune{'/'} = "tmp proc var bin sbin lib dev usr 'lost+found'";
$prune{'/mnt/cxaa'} = "mnt tmp proc tapedir var bin sbin xemacs lib dev 
cdrom";
$prune{'/mnt/cxaa/usr'} = "tmp lib bin sbin spol test  local diag hung";
$prune{'/mnt/xacom4'} = "mnt tmp proc var bin sbin lib dev cdrom install 
ibin";
$prune{'/mnt/xacom4/usr'} = "tmp bin sbin lib local man fmc2 lpd lbin";
$prune{'/mnt/xacomfs1'} = "tmp registry backups";
$prune{'/mnt/xacomfs1/documents'} =  "'1-to review then delete' 
Temp 'Temporary Transfer Location' Testing VET 'WInzip 8.0' 'Social Events' 
Year2000 teemp Logs Projects_Backup";

As I understand it, this should remove the directories mentioned here from the 
list.. however.. 

when I do a flexbackup -set local

I get

./var, ./lost+found, ./usr etc etc.. in the list of files being backed up.

What do I have wrong??

Thanks.

Peter Nunn.


-- 
Use Computes?....                           ...Think IT!

Re: [flexbackup-help] I/O Errors

[Kristian R. <kr...@pm...>]

Corey;


Am Thu, 24 Aug 2006 20:26:12 -0700 (PDT)
schrieb Corey Emery <sna...@ya...>:

> I've done everything in the FAQ and I keep getting I/O
> errors. The drive appears to respond otherwise. I'm
> running OpenSuse 10.0. Any suggestions? 

can you please post the whole error message as well as some details on
the situation it appears in? Goin' through similar problems right now
with another backup solution, I learnt that most of these errors still
somehow relate to the hardware used...

Cheers,
Kris

-- 
Kristian Rink   -- Programmierung/Systembetreuung
planConnect GmbH * Strehlener Str. 12 - 14 * 01069 Dresden
Tel: 0351 4657770 * Fax: 0351 4657778 * kr...@pm...

[flexbackup-help] I/O Errors

[Corey E. <sna...@ya...>]

I've done everything in the FAQ and I keep getting I/O
errors. The drive appears to respond otherwise. I'm
running OpenSuse 10.0. Any suggestions? 

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

[flexbackup-help] state of the tool, multi-tape support?

[Kristian R. <kr...@pm...>]

Hi all;

I came across flexbackup searching for a lightweight backup system for
our production environment, and what I saw in fb so far seems kinda
pleasing. However, two questions:

(a) Is the tool still actively maintained? For what I see, the last
release has been quite some time ago...

(b) Does anyone have any experience using flexbackup together with tape
changers / autoloaders (mtx)? Or, even "worse", the spanning of backup
sets across multiple tapes?

Thanks for any hints and bye,
Kristian


-- 
Kristian Rink   -- Programmierung/Systembetreuung
planConnect GmbH * Strehlener Str. 12 - 14 * 01069 Dresden
Tel: 0351 4657770 * Fax: 0351 4657778 * kr...@pm...

[flexbackup-help] (no subject)

[<lio...@fr...>]

i use flexbackup 1.2.1 on a debian sarge.
I do backup with afio and bzip2 on travan tape 4/8 Go Seagate STT8000A.

All my backup process fine :

afio: 145m+690k+0 bytes written in 346 seconds. The operation was success=
ful.
Kilobytes Out 149170
Kilobytes Out 149170

But when i want to decompresss with flexbackup -extract command, afio tel=
l me :

| Logging output to "flexbackup.extract.200608181908.log"
| Trying "mt defblksize" instead of "mt setblk"
| Reading from CURRENT TAPE POSITION
|------------------------------------------------------------
At block 7062477.
|------------------------------------------------------------
| buffer -m 10m -p 75 -s 10k -t -u 100 -i "/dev/nst0" | afio -i -z -x -D =
\
|   /usr/bin/flexbackup -P bzip2 -Q -d -Z -v   -b 10k -
|------------------------------------------------------------
buffer (reader): failed to read input: Input/output error
afio: "-": No input
|------------------------------------------------------------
At block 7062477.


I don't understand my problem !!

Somebody can help me ?

i post my flexbackup.conf

Thanks you for your help and sorry for my english, i'm french people.

[flexbackup-help] Afio problem

[Lionel D. <lio...@fr...>]

i use flexbackup 1.2.1 on a debian sarge.
I do backup with afio and bzip2 on travan tape 4/8 Go Seagate STT8000A.

All my backup process fine :

afio: 145m+690k+0 bytes written in 346 seconds. The operation was successful.
Kilobytes Out 149170
Kilobytes Out 149170

But when i want to decompresss with flexbackup -extract command, afio tell me :

| Logging output to "flexbackup.extract.200608181908.log"
| Trying "mt defblksize" instead of "mt setblk"
| Reading from CURRENT TAPE POSITION
|------------------------------------------------------------
At block 7062477.
|------------------------------------------------------------
| buffer -m 10m -p 75 -s 10k -t -u 100 -i "/dev/nst0" | afio -i -z -x -D \
|   /usr/bin/flexbackup -P bzip2 -Q -d -Z -v   -b 10k -
|------------------------------------------------------------
buffer (reader): failed to read input: Input/output error
afio: "-": No input
|------------------------------------------------------------
At block 7062477.


I don't understand my problem !!

Somebody can help me ?

i post my flexbackup.conf 

Thanks you for your help and sorry for my english, i'm french people 

Re: [flexbackup-help] What a shame flexbackup is *almost* there - but I have to reject it

[<fle...@wo...>]

Hi

I didn't mean to be rude either,=20

it's just that having a backupsystem that really works like it "should be"=
=20
just doesn't exist currently (to my knowledge).

=46or you're example, (a.conf, b.conf) you need some filesystem support to =
be=20
able to replicate your changes to another system/backup.

Currently there's no method/sw that I know of that is supporting=20
windows/unix/linux and is in common practise=20
(otherwise it's difficult to use in an enterprise environment due to the sh=
ere=20
amount of servers and different OS's).

What you maybe are searching maybe FAM (File Alteration Monitor)?!?=20
http://oss.sgi.com/projects/fam/faq.html

And use of a FAM mirror
http://www.linuxfocus.org/common/src/article199/fam_mirror

Unless you set up something like that, you're not getting any solution to y=
our=20
a.conf/b.conf problem, the "old" methods" of full/incremental/differential=
=20
backups just doesn't provide that functionality. Also isn't a tape backup=20
system flexible enough, or fast enough to support that.

> I will not trust my system+data to such a backup-system. Are *you*
> comfortable with that? What is the down side of being able to restore
> reliably?
Rather too much than too little data protection is what keeps an enterprise=
=20
datacenter running...

> You are right, I don't know "EMC Networker, Veritas Netbackup, HP Data
> Protector", but I'm willing to bet they can restore a directory
> containing *exactly* b.conf. (Am I right?)
They can, if you really have an full backup just before the crash/logical=20
accident happens. For incrementals, it's just to restore full+incrementals=
=20
and get all those a.conf's as well ;-(

=2D-Robert

On Fri 4 August 2006 09:50, Peter Valdemar M=F8rch wrote:
> flexbackup-at-worreby.ch |Lists| wrote:
>   > 1. Have you the slightest idea how it's done in the reality?
> >
> >     That's standard procedure to restore full backup plus all
> >     incrementals you have, if you invented some other schema,
> >     please let me know
> >     (at work we're currently backing up between 15-20 TB / night)
>
> and
>
>  > 2. What's worse? Dataloss or too much data!!!
>
> Let us first agree that data loss is totally unacceptable.
> I'm not arguing that data loss is a good thing. (Am i? Where?)
>
> But for me, "too much data" is *ALSO* unacceptable, because it does not
> represent reality. Let me illustrate with a scenario:
>
> * I start with a directory e.g. under Apache's configuration that
>    has a single file a.conf
> * I make a full backup.
> * rm a.conf
> * Add a file b.conf
> * (Notice that at no point in time was there ever more
>    than one file in the directory)
> * I make an incremental backup.
> * Hard disk crash
> * Restore full backup
> * Restore incremental backup
>
> Result with current flexbackup:
>
> A directory containing both a.conf AND b.conf.
>
> Wouldn't you rather end up with a directory containing *exactly* b.conf
> - the exact contents of the directory when the incremental backup was mad=
e?
>
> Ok, so in a directory where there is supposed to be 1 single file you
> may be able to remember yourself to delete a.conf (because it is *not*
> supposed to be there). Lets just hope I slept well and didn't remove
> b.conf instead by accident because I was tired... ;)
>
> But with "between 15-20 TB" of data as you put it? Who can remember
> which of the gazillion files to delete?
>
> No, I don't want that to be a guessing game.
>
> In some (most?) cases, "too much data" is just annoying - not really
> catastrophic. But in some cases (e.g. conf.d, cron.d, *.d directories,
> or a file containing sensitive data that was deleted) this *is*
> catastrophic. I could end up with a system that won't boot or misbehaves
> or is dangerous after a full+incremental restore.
>
> I will not trust my system+data to such a backup-system. Are *you*
> comfortable with that? What is the down side of being able to restore
> reliably?
>
> You are right, I don't know "EMC Networker, Veritas Netbackup, HP Data
> Protector", but I'm willing to bet they can restore a directory
> containing *exactly* b.conf. (Am I right?)
>
> Peter

=2D-=20
=2D-Robert

Robert Worreby
Birkenweg 82
CH-3123 Belp
http://counter.li.org

Re: [flexbackup-help] Let me contribute and introduce some new functionality to Flexbackup...

[<swp...@sn...>]

Charlie Brady charlieb-flexbackup-at-e-smith.com |Lists| wrote:
> I don't know. Is that question relevant to this list? Are you offering =
to=20
> sponsor the development of the features you find missing?

No, in fact, I'm strongly considering implementing them directly myself! =
:D

As I wrote in my original post:
> I'm tempted to take a stab at adding the meta data to the created and=20
> backuped data and implementing -restore and -search. I've just never=20
> used a tape backup system, only to-disk. Would anybody we willing to=20
> test any such enhancements on a tape-drive?

To business:

Charlie Brady charlieb-flexbackup-at-e-smith.com |Lists| wrote:

> to create such a thing, you need a considerably more=20
> sophisticated process for creating incremental backups.

I'm thinking that when creating a backup, incremental, differential or=20
otherwise, all that needs to get stored is the full current "list of=20
files" that currently exist on the disk within the backup set's directori=
es.

 From that, after restoring either a full backup set a=20
full+incremental+incremental or whatever, then the "list of files" from=20
the last restored set (incremental or full) will contain exactly which=20
files should be present. Then one can (offer to) remove the files that=20
are not in the "list of files" or just present a list of files suggested=20
for deletion.

It should be really easy! (Well, we'll see... :D)

 From the posts in this thread I'm aware that this new functionality=20
maybe shouldn't be the default. But I need it so I think I'll introduce=20
it as optional behavior.

Peter
--=20
Peter Valdemar M=F8rch
http://www.morch.com