flexbackup-help — Support/help/usage

[flexbackup-help] Remote restore

[<pru...@la...>]

Hi,

I use a server to backup itself and a remote server (with the
hel=
p of ssh). Now i'd like to know how to restore files of the
remote serve=
r directly on the remote server.

The only thing i managed to do is res=
toring files on the
backup server and using ssh to copy restored files t=
o the
remote server.

Is there a way to do this with flexbackup (i see=
 no options to
restore on a remote directory)? Or is there a way to use=0D
=
flexbackup on the remote server to use the tape on the backup
server ?=0D
=

Thanks.
=0A=0AAcc=E9dez au courrier =E9lectronique de La Poste : www.l=
aposte.net ; =0A3615 LAPOSTENET (0,34=80/mn) ; t=E9l : 08 92 68 13 50 (0,=
34=80/mn)=0A=0A

[flexbackup-help] I've found a large bug in checkinpath

[Jeff M. <in...@bi...>]

This is a fun little bug, it's regarding the parts of checkinpath that 
check $ENV{PATH}

I was getting the error from my cron [cron cleans out the path a bit, 
for some reason /usr/local/bin/sudo was not being found]. I thought this 
meant on the remote server.

After much mucking about, i decided to link /usr/bin/sudo to 
/usr/local/bin/sudo on the backup server. And badabing it started working.

Lets say my backup machine is called "backup" and the remove machine is 
called "client".

Techically there would be no need for sudo to be installed on "backup", 
however checkinpath is clearly only ever checking the local machine and 
not "client" where it really counts. Find/sudo/tar all of those things 
need to exist on the client, not really on the backup machine.

Jeff.

Re: [flexbackup-help] IDE tape drive problem

[Roger P. <rp...@pr...>]

On Wed, 11 Feb 2004 16:55:54 -0500
"Toby Deitrich" <to...@so...> wrote:

> Hi all-
>  
> I am a Linux newbie, so please forgive my ignorance.  I have an i586 box
> running SuSE Linux 9.0 and it has a Seagate STT3401A IDE tape drive.  I
> tried using tar, and I got I/O errors, and after fishing around on
> Google I found out that the ide-tape module doesn't work, but the
> ide-scsi does.  Ok, installed that (did rmmod and modprobe) and now I
> can tar to/from the tape drive.  I can also run Taper, but I don't much
> like the interface, and for some reason I can't get Taper to execute via
> cron.  I'd rather use flexbackup anyway, because it seems
> cleaner/better.  However.
>  
> Now that I have the ide-scsi module installed, flexbackup tries to do a
> mt -f /dev/nst0 setblk and defblksize and gets an I/O error and fails.
> This happens even if I do flexbackup -test-tape-drive.  Presumably
> because my tape drive isn't really a SCSI drive. ?  
>  
> I read the flexbackup FAQ and tried setting $mt{'setblk'} = '' or
> $mt{'setblk'} = 'nop' but it doesn't make any difference, I still get
> the error. I tried the -ignore-errors switch but it still failed.
>  
> Has anyone out there been able to use and IDE tape drive with
> flexbackup?  I'd greatly appreciate any help.
>  
> Next time, I'm buying a SCSI tape drive!
>  
> Thanks,
> Toby
>  
> 


I'm using a Seagate ST20000A drive, and had the same problems, try
setting differnt block sizes, I use $blksize=32, $mt_blksize=0
successfully. Use the"-test-tape-drive" option until you find the correct
one.  Also, ensure you have the latest flexbackup, 1.2.1
from http://flexbackup.sourceforge.net/




--------------------------------------------------------------------------
PLEASE NOTE: NEW EMAIL ADDRESS, please change your nicknames, thanks.
Roger Pryor P. Eng.                Email: rp...@pr...
Pryor and Pryor Inc.           Telephone: (+1) 604-685-2621
602 - 1230 Comox Street,        Internet: http://www.pryor-and-pryor.com
Vancouver, B.C., V6E 1K7, Canada

Re: [flexbackup-help] Installing FlexBackup on SuSe8.2 and Perl.

[Jeff M. <in...@bi...>]

There is a very slim chance you have "everything to do with perl" 
installed on your machine. Perl is HUGE, GIANT, MASSIVE. [cpan.org]

If i were you I'd download the source code, try to run the perl script
and when it barfs, it will tell you what modules you are missing.

RPMs take all the "administration" out of "system administrators" but
that's a whole other holy war.

Jeff.

rob...@ro... wrote:
> Hi everyone,
> I apologise in advance if my question seems too simplistic, but i'm having
> trouble installing FlexBackup on my SuSe8.2 box which I use as a file
> server and router/firewall in my home office.
> 
> When I try and install the FlexBackup RPM which I downloaded from the
> FlexBackup site, my RPM manager (YaST2) whines about not having certain
> Perl modules.
> 
> Can anyone tell me what is going on because I *think* I have everyting to
> do with Perl installed on my machine, but it still comes up with these
> dependancy conflicts.
> 
> Thanks,
> 
> Rob.
> 
> --------------------------------------------------------------------
> mail2web - Check your email from the web at
> http://mail2web.com/ .
> 
> 
> 
> 
> -------------------------------------------------------
> SF.Net is sponsored by: Speed Start Your Linux Apps Now.
> Build and deploy apps & Web services for Linux with
> a free DVD software kit from IBM. Click Now!
> http://ads.osdn.com/?ad_id56&alloc_id438&op=click
> _______________________________________________
> flexbackup-help mailing list
> fle...@li...
> https://lists.sourceforge.net/lists/listinfo/flexbackup-help

Re: [flexbackup-help] good ole "ERROR: non-zero exit from"

[Jeff M. <in...@bi...>]

ok, i found it.

i went into flexbackup perl file and took out all the

-fstype stuff. and it worked.

i'm not using any weird file systems to i'm not concerned.

jeff.

Jeff MacDOnald wrote:
> Yeah, I tried something along those lines..
> 
> I took the "ssh" line and plunked it into a file then
> ran it..
> 
> ie: here is the content of the file
> 
> ssh -l backup bilbo.mydomain.ca cd "/usr/home" && sudo find -E . -depth 
> ! -fstype nfs ! -fsty
> pe smbfs ! -fstype bind ! -fstype proc ! -fstype devpts ! -fstype devfs 
> ! -fstype tmpfs ! -ty
> pe s -print0 | sudo tar --create --null --files-from=- 
> --ignore-failed-read --same-permission
> s --no-recursion --totals --label "level 0 bilbo.mydomain.ca:/usr/home 
> Thu Feb 12 10:39:02 20
> 04 tar+gzip from gollum.mydomain.ca" --verbose --sparse -b 20 --file - | 
> sudo gzip -4; x=(${P
> IPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ]; do [ ${x[$i]} -eq 0 ] || 
> exit ${x[$i]}; i=$((
> $i+1)); done
> 
> Then i ran it "sh foo.sh" and got
> 
> -su-2.05b$ sh foo.sh
> foo.sh: 1: Syntax error: Bad substitution
> 
> Soooo I took out the first part [the ssh command] and just started the
> script with the "sudo tar" line. I put this modified version on bilbo
> and tried to run it and got the exact same error.
> 
> So i tink the error must be that chunk in the end, but i don't know 
> shell scripting very well so i'm kinda lost.
> 
> Jeff.
> 
> 
> 
> John Reynolds wrote:
> 
>> Jeff MacDOnald wrote:
>>
>>> i think i found it. tar on freebsd does not support --no-recursion yet
>>> it does support -norecurse
>>>
>>> are these intended to be the same thing ?
>>>
>>
>> What version of FreeBSD are you using? In FreeBSD 5.1-current (I'm too 
>> lazy to upgrade to 5.2 just yet) I see:
>>
>>   -n, --norecurse
>>       --no-recursion   avoid descending automatically in directories
>>
>> Seems to be the same thing.
>>
>> All I can offer as advice to debug is try logging into bilbo as 
>> "backup" and try running the find command itself. That's about the 
>> only thing you can do is try to isolate what is dying piece-meal.
>>
>> -Jr
>>
>>
> 
> 
> -------------------------------------------------------
> SF.Net is sponsored by: Speed Start Your Linux Apps Now.
> Build and deploy apps & Web services for Linux with
> a free DVD software kit from IBM. Click Now!
> http://ads.osdn.com/?ad_id=1356&alloc_id=3438&op=click
> _______________________________________________
> flexbackup-help mailing list
> fle...@li...
> https://lists.sourceforge.net/lists/listinfo/flexbackup-help

Re: [flexbackup-help] good ole "ERROR: non-zero exit from"

[Jeff M. <in...@bi...>]

Yeah, I tried something along those lines..

I took the "ssh" line and plunked it into a file then
ran it..

ie: here is the content of the file

ssh -l backup bilbo.mydomain.ca cd "/usr/home" && sudo find -E . -depth 
! -fstype nfs ! -fsty
pe smbfs ! -fstype bind ! -fstype proc ! -fstype devpts ! -fstype devfs 
! -fstype tmpfs ! -ty
pe s -print0 | sudo tar --create --null --files-from=- 
--ignore-failed-read --same-permission
s --no-recursion --totals --label "level 0 bilbo.mydomain.ca:/usr/home 
Thu Feb 12 10:39:02 20
04 tar+gzip from gollum.mydomain.ca" --verbose --sparse -b 20 --file - | 
sudo gzip -4; x=(${P
IPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ]; do [ ${x[$i]} -eq 0 ] || 
exit ${x[$i]}; i=$((
$i+1)); done

Then i ran it "sh foo.sh" and got

-su-2.05b$ sh foo.sh
foo.sh: 1: Syntax error: Bad substitution

Soooo I took out the first part [the ssh command] and just started the
script with the "sudo tar" line. I put this modified version on bilbo
and tried to run it and got the exact same error.

So i tink the error must be that chunk in the end, but i don't know 
shell scripting very well so i'm kinda lost.

Jeff.



John Reynolds wrote:
> Jeff MacDOnald wrote:
> 
>> i think i found it. tar on freebsd does not support --no-recursion yet
>> it does support -norecurse
>>
>> are these intended to be the same thing ?
>>
> 
> What version of FreeBSD are you using? In FreeBSD 5.1-current (I'm too 
> lazy to upgrade to 5.2 just yet) I see:
> 
>   -n, --norecurse
>       --no-recursion   avoid descending automatically in directories
> 
> Seems to be the same thing.
> 
> All I can offer as advice to debug is try logging into bilbo as "backup" 
> and try running the find command itself. That's about the only thing you 
> can do is try to isolate what is dying piece-meal.
> 
> -Jr
> 
> 

[flexbackup-help] Installing FlexBackup on SuSe8.2 and Perl.

[<rob...@ro...>]

Hi everyone,
I apologise in advance if my question seems too simplistic, but i'm having=

trouble installing FlexBackup on my SuSe8=2E2 box which I use as a file
server and router/firewall in my home office=2E

When I try and install the FlexBackup RPM which I downloaded from the
FlexBackup site, my RPM manager (YaST2) whines about not having certain
Perl modules=2E

Can anyone tell me what is going on because I *think* I have everyting to
do with Perl installed on my machine, but it still comes up with these
dependancy conflicts=2E

Thanks,

Rob=2E

--------------------------------------------------------------------
mail2web - Check your email from the web at
http://mail2web=2Ecom/ =2E

[flexbackup-help] Backup terminated: pre-backup failed - status: 256

[Gordon L. <co...@bi...>]

Anyone got any ideas on what this actually means?

Ta
Jo

[flexbackup-help] IDE tape drive problem

[Toby D. <to...@so...>]

Hi all-
 
I am a Linux newbie, so please forgive my ignorance.  I have an i586 box
running SuSE Linux 9.0 and it has a Seagate STT3401A IDE tape drive.  I
tried using tar, and I got I/O errors, and after fishing around on
Google I found out that the ide-tape module doesn't work, but the
ide-scsi does.  Ok, installed that (did rmmod and modprobe) and now I
can tar to/from the tape drive.  I can also run Taper, but I don't much
like the interface, and for some reason I can't get Taper to execute via
cron.  I'd rather use flexbackup anyway, because it seems
cleaner/better.  However.
 
Now that I have the ide-scsi module installed, flexbackup tries to do a
mt -f /dev/nst0 setblk and defblksize and gets an I/O error and fails.
This happens even if I do flexbackup -test-tape-drive.  Presumably
because my tape drive isn't really a SCSI drive. ?  
 
I read the flexbackup FAQ and tried setting $mt{'setblk'} = '' or
$mt{'setblk'} = 'nop' but it doesn't make any difference, I still get
the error. I tried the -ignore-errors switch but it still failed.
 
Has anyone out there been able to use and IDE tape drive with
flexbackup?  I'd greatly appreciate any help.
 
Next time, I'm buying a SCSI tape drive!
 
Thanks,
Toby
 

Re: [flexbackup-help] good ole "ERROR: non-zero exit from"

[Jeff M. <in...@bi...>]

i was wrong, that doesn't fix it.

jeff.

Jeff MacDOnald wrote:
> i think i found it. tar on freebsd does not support --no-recursion yet
> it does support -norecurse
> 
> are these intended to be the same thing ?
> 
> Jeff MacDOnald wrote:
> 
>> HI,
>>
>> Trying to backup remote machine, all machines in my scenerio are
>> FreeBSD. I've read the list archives and saw the find -E mentioned a 
>> few times. I checked and my 'find' supports this.
>>
>> My log for this transaction does not mention -E, however it doesn't 
>> really mention anything else. Wondering if someone can point me in the 
>> right direction.
>>
>> ===== log file with hostnames alterd to procect the innocent =====
>>
>>
>> flexbackup version 1.2.1 (http://flexbackup.sourceforge.net)
>>
>> |------------------------------------------------------------
>> | Checking /bin/sh on this machine... unknown (probably Bourne Shell)
>> | Checking shell on bilbo.mydomain.ca... bash2
>> | Checking for required programs on host bilbo.mydomain.ca... Ok
>> |------------------------------------------------------------
>> | Doing level 0 backup of set bilbo using tar
>> | Found directory index key 200402111356
>> | Backup set "bilbo" (bilbo.mydomain.ca:/usr/home)
>> |------------------------------------------------------------
>> | Backup of: bilbo.mydomain.ca:/usr/home
>> | Date of this level 0 backup: Wed Feb 11 15:47:20 2004
>> | Date of last level 0 backup: the epoch
>> |------------------------------------------------------------
>> | /tmp/collectexit.40281.sh ssh -l backup bilbo.mydomain.ca 'cd
>> |   "/usr/home" && sudo find -E . -depth ! -fstype nfs ! -fstype smbfs !
>> |   -fstype bind ! -fstype proc ! -fstype devpts ! -fstype devfs ! 
>> -fstype
>> |   tmpfs ! -type s -print0 | sudo tar --create --null --files-from=-
>> |   --ignore-failed-read --same-permissions --no-recursion --totals 
>> --label
>> |   "level 0 bilbo.mydomain.ca:/usr/home Wed Feb 11 15:47:20 2004
>> |   tar+gzip from gollum.mydomain.ca" --verbose --sparse -b 20 --file -
>> |   | sudo gzip -4; x=(${PIPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ];
>> |   do [ ${x[$i]} -eq 0 ] || exit ${x[$i]}; i=$(($i+1)); done' |
>> |   /tmp/collectexit.40281.sh dd ibs=10k obs=10k conv=noerror
>> |   of="/dr/dr01/backup/data/bilbo.mydomain.ca-usr-home.0.200402111547.t
>> |   ar.gz"
>> | [ ! -e /tmp/exitstatus.40281 ]
>> |------------------------------------------------------------
>> find: level 0 bilbo.mydomain.ca:/usr/home Wed Feb 11 15:47:20 2004 
>> tar+gzip from gollum.mydomain.ca
>> nfs: unknown file type
>> Total bytes written: 10240 (10kB, 3.1MB/s)
>> 0+1 records in
>> 0+1 records out
>> 149 bytes transferred in 0.712470 secs (209 bytes/sec)
>>
>> ERROR: non-zero exit from:
>> ssh -l backup bilbo.mydomain.ca cd "/usr/home" && sudo find -E . 
>> -depth ! -fstype nfs ! -fstype smbfs ! -fstype bi
>> nd ! -fstype proc ! -fstype devpts ! -fstype devfs ! -fstype tmpfs ! 
>> -type s -print0 | sudo tar --create --null --
>> files-from=- --ignore-failed-read --same-permissions --no-recursion 
>> --totals --label "level 0 bilbo.mydomain.ca:/u
>> sr/home Wed Feb 11 15:47:20 2004 tar+gzip from gollum.mydomain.ca" 
>> --verbose --sparse -b 20 --file - | sudo gzip -
>> 4; x=(${PIPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ]; do [ ${x[$i]} 
>> -eq 0 ] || exit ${x[$i]}; i=$(($i+1)); done
>>
>>
>> ERROR: exiting
>> |------------------------------------------------------------
>> | Backup start: Wed Feb 11 15:47:20 2004
>> | Backup end:   Wed Feb 11 15:47:21 2004
>> |------------------------------------------------------------
>> | Compressing log (bilbo.0.200402111547.gz)
>> | Linking bilbo.latest.gz -> bilbo.0.200402111547.gz
>> |------------------------------------------------------------
>>
>> Thanks in advance.
>>
>> Jeff.
>>
>>
>> -------------------------------------------------------
>> SF.Net is sponsored by: Speed Start Your Linux Apps Now.
>> Build and deploy apps & Web services for Linux with
>> a free DVD software kit from IBM. Click Now!
>> http://ads.osdn.com/?ad_id=1356&alloc_id=3438&op=click
>> _______________________________________________
>> flexbackup-help mailing list
>> fle...@li...
>> https://lists.sourceforge.net/lists/listinfo/flexbackup-help
> 
> 
> 
> -------------------------------------------------------
> SF.Net is sponsored by: Speed Start Your Linux Apps Now.
> Build and deploy apps & Web services for Linux with
> a free DVD software kit from IBM. Click Now!
> http://ads.osdn.com/?ad_id=1356&alloc_id=3438&op=click
> _______________________________________________
> flexbackup-help mailing list
> fle...@li...
> https://lists.sourceforge.net/lists/listinfo/flexbackup-help

Re: [flexbackup-help] good ole "ERROR: non-zero exit from"

[Jeff M. <in...@bi...>]

i think i found it. tar on freebsd does not support --no-recursion yet
it does support -norecurse

are these intended to be the same thing ?

Jeff MacDOnald wrote:

> HI,
> 
> Trying to backup remote machine, all machines in my scenerio are
> FreeBSD. I've read the list archives and saw the find -E mentioned a few 
> times. I checked and my 'find' supports this.
> 
> My log for this transaction does not mention -E, however it doesn't 
> really mention anything else. Wondering if someone can point me in the 
> right direction.
> 
> ===== log file with hostnames alterd to procect the innocent =====
> 
> 
> flexbackup version 1.2.1 (http://flexbackup.sourceforge.net)
> 
> |------------------------------------------------------------
> | Checking /bin/sh on this machine... unknown (probably Bourne Shell)
> | Checking shell on bilbo.mydomain.ca... bash2
> | Checking for required programs on host bilbo.mydomain.ca... Ok
> |------------------------------------------------------------
> | Doing level 0 backup of set bilbo using tar
> | Found directory index key 200402111356
> | Backup set "bilbo" (bilbo.mydomain.ca:/usr/home)
> |------------------------------------------------------------
> | Backup of: bilbo.mydomain.ca:/usr/home
> | Date of this level 0 backup: Wed Feb 11 15:47:20 2004
> | Date of last level 0 backup: the epoch
> |------------------------------------------------------------
> | /tmp/collectexit.40281.sh ssh -l backup bilbo.mydomain.ca 'cd
> |   "/usr/home" && sudo find -E . -depth ! -fstype nfs ! -fstype smbfs !
> |   -fstype bind ! -fstype proc ! -fstype devpts ! -fstype devfs ! -fstype
> |   tmpfs ! -type s -print0 | sudo tar --create --null --files-from=-
> |   --ignore-failed-read --same-permissions --no-recursion --totals --label
> |   "level 0 bilbo.mydomain.ca:/usr/home Wed Feb 11 15:47:20 2004
> |   tar+gzip from gollum.mydomain.ca" --verbose --sparse -b 20 --file -
> |   | sudo gzip -4; x=(${PIPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ];
> |   do [ ${x[$i]} -eq 0 ] || exit ${x[$i]}; i=$(($i+1)); done' |
> |   /tmp/collectexit.40281.sh dd ibs=10k obs=10k conv=noerror
> |   of="/dr/dr01/backup/data/bilbo.mydomain.ca-usr-home.0.200402111547.t
> |   ar.gz"
> | [ ! -e /tmp/exitstatus.40281 ]
> |------------------------------------------------------------
> find: level 0 bilbo.mydomain.ca:/usr/home Wed Feb 11 15:47:20 2004 
> tar+gzip from gollum.mydomain.ca
> nfs: unknown file type
> Total bytes written: 10240 (10kB, 3.1MB/s)
> 0+1 records in
> 0+1 records out
> 149 bytes transferred in 0.712470 secs (209 bytes/sec)
> 
> ERROR: non-zero exit from:
> ssh -l backup bilbo.mydomain.ca cd "/usr/home" && sudo find -E . -depth 
> ! -fstype nfs ! -fstype smbfs ! -fstype bi
> nd ! -fstype proc ! -fstype devpts ! -fstype devfs ! -fstype tmpfs ! 
> -type s -print0 | sudo tar --create --null --
> files-from=- --ignore-failed-read --same-permissions --no-recursion 
> --totals --label "level 0 bilbo.mydomain.ca:/u
> sr/home Wed Feb 11 15:47:20 2004 tar+gzip from gollum.mydomain.ca" 
> --verbose --sparse -b 20 --file - | sudo gzip -
> 4; x=(${PIPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ]; do [ ${x[$i]} 
> -eq 0 ] || exit ${x[$i]}; i=$(($i+1)); done
> 
> 
> ERROR: exiting
> |------------------------------------------------------------
> | Backup start: Wed Feb 11 15:47:20 2004
> | Backup end:   Wed Feb 11 15:47:21 2004
> |------------------------------------------------------------
> | Compressing log (bilbo.0.200402111547.gz)
> | Linking bilbo.latest.gz -> bilbo.0.200402111547.gz
> |------------------------------------------------------------
> 
> Thanks in advance.
> 
> Jeff.
> 
> 
> -------------------------------------------------------
> SF.Net is sponsored by: Speed Start Your Linux Apps Now.
> Build and deploy apps & Web services for Linux with
> a free DVD software kit from IBM. Click Now!
> http://ads.osdn.com/?ad_id=1356&alloc_id=3438&op=click
> _______________________________________________
> flexbackup-help mailing list
> fle...@li...
> https://lists.sourceforge.net/lists/listinfo/flexbackup-help

[flexbackup-help] good ole "ERROR: non-zero exit from"

[Jeff M. <in...@bi...>]

HI,

Trying to backup remote machine, all machines in my scenerio are
FreeBSD. I've read the list archives and saw the find -E mentioned a few 
times. I checked and my 'find' supports this.

My log for this transaction does not mention -E, however it doesn't 
really mention anything else. Wondering if someone can point me in the 
right direction.

===== log file with hostnames alterd to procect the innocent =====


flexbackup version 1.2.1 (http://flexbackup.sourceforge.net)

|------------------------------------------------------------
| Checking /bin/sh on this machine... unknown (probably Bourne Shell)
| Checking shell on bilbo.mydomain.ca... bash2
| Checking for required programs on host bilbo.mydomain.ca... Ok
|------------------------------------------------------------
| Doing level 0 backup of set bilbo using tar
| Found directory index key 200402111356
| Backup set "bilbo" (bilbo.mydomain.ca:/usr/home)
|------------------------------------------------------------
| Backup of: bilbo.mydomain.ca:/usr/home
| Date of this level 0 backup: Wed Feb 11 15:47:20 2004
| Date of last level 0 backup: the epoch
|------------------------------------------------------------
| /tmp/collectexit.40281.sh ssh -l backup bilbo.mydomain.ca 'cd
|   "/usr/home" && sudo find -E . -depth ! -fstype nfs ! -fstype smbfs !
|   -fstype bind ! -fstype proc ! -fstype devpts ! -fstype devfs ! -fstype
|   tmpfs ! -type s -print0 | sudo tar --create --null --files-from=-
|   --ignore-failed-read --same-permissions --no-recursion --totals --label
|   "level 0 bilbo.mydomain.ca:/usr/home Wed Feb 11 15:47:20 2004
|   tar+gzip from gollum.mydomain.ca" --verbose --sparse -b 20 --file -
|   | sudo gzip -4; x=(${PIPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ];
|   do [ ${x[$i]} -eq 0 ] || exit ${x[$i]}; i=$(($i+1)); done' |
|   /tmp/collectexit.40281.sh dd ibs=10k obs=10k conv=noerror
|   of="/dr/dr01/backup/data/bilbo.mydomain.ca-usr-home.0.200402111547.t
|   ar.gz"
| [ ! -e /tmp/exitstatus.40281 ]
|------------------------------------------------------------
find: level 0 bilbo.mydomain.ca:/usr/home Wed Feb 11 15:47:20 2004 
tar+gzip from gollum.mydomain.ca
nfs: unknown file type
Total bytes written: 10240 (10kB, 3.1MB/s)
0+1 records in
0+1 records out
149 bytes transferred in 0.712470 secs (209 bytes/sec)

ERROR: non-zero exit from:
ssh -l backup bilbo.mydomain.ca cd "/usr/home" && sudo find -E . -depth 
! -fstype nfs ! -fstype smbfs ! -fstype bi
nd ! -fstype proc ! -fstype devpts ! -fstype devfs ! -fstype tmpfs ! 
-type s -print0 | sudo tar --create --null --
files-from=- --ignore-failed-read --same-permissions --no-recursion 
--totals --label "level 0 bilbo.mydomain.ca:/u
sr/home Wed Feb 11 15:47:20 2004 tar+gzip from gollum.mydomain.ca" 
--verbose --sparse -b 20 --file - | sudo gzip -
4; x=(${PIPESTATUS[@]}); i=0; while [ $i -lt ${#x[@]} ]; do [ ${x[$i]} 
-eq 0 ] || exit ${x[$i]}; i=$(($i+1)); done


ERROR: exiting
|------------------------------------------------------------
| Backup start: Wed Feb 11 15:47:20 2004
| Backup end:   Wed Feb 11 15:47:21 2004
|------------------------------------------------------------
| Compressing log (bilbo.0.200402111547.gz)
| Linking bilbo.latest.gz -> bilbo.0.200402111547.gz
|------------------------------------------------------------

Thanks in advance.

Jeff.

[flexbackup-help] Help with IDE tape drive

[Toby D. <to...@so...>]

Hi all-

=20

I am a Linux newbie, so please forgive my ignorance.  I have an i586 box
running SuSE Linux 9.0 and it has a Seagate STT3401A IDE tape drive.  I
tried using tar, and I got I/O errors, and after fishing around on =
Google I
found out that the ide-tape module doesn't work, but the ide-scsi does.  =
Ok,
installed that (did rmmod and modprobe) and now I can tar to/from the =
tape
drive.  I can also run Taper, but I don't much like the interface, and =
for
some reason I can't get Taper to execute via cron.  I'd rather use
flexbackup anyway, because it seems cleaner/better.  However.

=20

Now that I have the ide-scsi module installed, flexbackup tries to do a =
mt
-f /dev/nst0 setblk and defblksize and gets an I/O error and fails.  =
This
happens even if I do flexbackup -test-tape-drive.  Presumably because my
tape drive isn't really a SCSI drive. ? =20

=20

I read the flexbackup FAQ and tried setting $mt{'setblk'} =3D '' or
$mt{'setblk'} =3D 'nop' but it doesn't make any difference, I still get =
the
error. I tried the -ignore-errors switch but it still failed.

=20

Has anyone out there been able to use and IDE tape drive with =
flexbackup?
I'd greatly appreciate any help.

=20

Next time, I'm buying a SCSI tape drive!

=20

Thanks,

Toby

[flexbackup-help] cron backup issue - script is only working manually?

[<sr...@pr...>]

It seems to be a recurring problem that with running flexback via command
line it runs fine, even manually running the cron script.

Though when I let the cron job run this is all I get:

|------------------------------------------------------------
| Doing level 0 backup of /home using cpio
| Rewinding & erasing tape...
| Creating index key 200401262000
|------------------------------------------------------------
At block 0.
|------------------------------------------------------------
| File number 1, tape index 200401262000
| Backup of: /home
| Date of this level 0 backup: Mon Jan 26 20:00:30 2004
| Date of last level 0 backup: the epoch
|------------------------------------------------------------
| touch "/home/level 0 -home Mon Jan 26 20:00:30 2004 cpio+hardware from \
|   redhat"
| cd "/home" && find . -depth -xdev ! -type s ! -regex ".*/[Cc]ache/.*" ! \
|   -regex ".*~"$ -print0 | cpio -o -0 -H newc -v -C 10240 | buffer -m 15m \
|   -p 75 -s 10k -t -u 100 -B -o "/dev/st0"
| rm -f "/home/level 0 -home Mon Jan 26 20:00:30 2004 cpio+hardware from \
|   redhat"
|------------------------------------------------------------


But of course there is no file listing indicating a complete backup as
there would be if the backup was successful or run manually in our case.

Is there any known issues that would cause this?

[flexbackup-help] patch to remove error in flexbackup with afio 2.4.8beta1

[Simon M. <sim...@ch...>]

Hi,

I'm using afio 2.4.8beta1 on one of my servers and flexbackup ends with a
non zero error because of warning from afio. The problem is the '-1 m'
option in flexbackup. This was the default in afio 2.4.7 but has changed
in 2.4.8. and was different in older versions too. Since the afio default=
s
seem to be sane I suggest removing the option from flexbackup to ensure
the afio builtin default is used. I added the following patch to my
flexbackup.

Simon

--- flexbackup-1.2.1.orig/flexbackup    Fri Oct 10 16:12:09 2003
+++ flexbackup-1.2.1/flexbackup Thu Feb  5 08:04:36 2004
@@ -1140,7 +1140,6 @@
     $cmd .=3D "$::path{afio} -o ";
     $cmd .=3D "$no_compress ";
     $cmd .=3D "-z ";
-    $cmd .=3D "-1 m ";
     $cmd .=3D "$::afio_z_flag ";
     $cmd .=3D "$::afio_verb_flag ";
     $cmd .=3D "$::afio_sparse_flag ";

[flexbackup-help] Error setting block size

[Steffen S. <s.s...@x-...>]

Hi everybody,
I'am a new in Flexbackup. I tried  to use a IDE tapedrive....but getting 
trouble with my settings.

Error-Message:

flexbackup version 1.0.5 (http://flexbackup.sourceforge.net)
/etc/flexbackup.conf syntax OK

|------------------------------------------------------------
| Checking 'buffer' on this machine... Ok
| Checking /bin/sh on this machine... bash2
|------------------------------------------------------------
| Trying "mt defblksize" instead of "mt setblk"
Error setting block size
Neither of these commands worked:
  mt -f /dev/nst0 setblk 0
  mt -f /dev/nst0 defblksize 0


flexbackup.conf:

# ----------------------------------------------------------------------
# General configuration section

# Archive type?  afio, dump, tar, cpio, star, pax, zip
$type = 'afio';

# List the directories you wish to dump when 'all' is given
# Just a simple space-separated list
# Remote filesystems should denoted as 'host:dir'
#
# Example:
#   $filesystems[0] = '/ /usr /home machine1:/usr machine2:/home';
#
# The array index is a tape number. If you want an 'all' level 0 backup to
# span multiple tapes, add more lines with different array indices. You will
# be prompted for tape change in between.
#
$filesystems[0] = '/home /etc /export';

# Compression
$compress = 'gzip'; # one of false/gzip/bzip2/zip/compress/hardware
$compr_level = '4'; # compression level (1-9) (for gzip/bzip2/zip)

# Buffering
$buffer = 'buffer';   # 'false' or 'buffer', to use buffer program to 
help streaming
$buffer_megs = '3';  # buffer memory size (in megabytes)
$pad_blocks = 'true';

# Device to backup to - non-rewinding version please!
#
# Examples:
#    Linux SCSI: /dev/nst0       Linux IDE: /dev/nht0
#    Linux ftape: /dev/nqft0     FreeBSD SCSI: /dev/nrsa0
#
# If a directory, will archive to files in that directory rather than a 
device
# If "host:/dev/tapedevice", will use remote tape drive via rsh/ssh
#
$device = '/dev/nst0';
#$device = '/root/backup';

# Block size (k) to use
# Default is 10 for most things.  Some tape drives need 32 or 64.
# Set to '0' to disable all blocking
$blksize = '0';

# True to use "variable" block size for the tape device (mt setblk 0)
# If false, will use the $blksize parameter above. All non-mt commands
# will still use $blksize regardless of this value
$mt_var_blksize = 'false';

# Padding.  True to pad blocks to blocksize (devices only, not used when
# archiving to files)
$pad_blocks = 'true';

Is there someone who can tell my how to solve this........ nice 
problem???  ;-))

Thanks
Steffen

[flexbackup-help] Archives disappeared!

[<bsa...@be...>]

I have been using Flexbackup for a few weeks. I made a full backup of
my computer and have followed that with daily differential backups
alternating two tapes on alternate days.

These backups are run as Cron jobs and yesterday I found the following
in  the log:

|------------------------------------------------------------
| Checking 'buffer' on this machine... Ok
| Checking /bin/sh on this machine... bash2
|------------------------------------------------------------
| Doing level 1 backup of set fulldataman1 using afio
| ERROR: Tape doesn't have an index! (use -newtape?)
| Making sure tape is at end of data...
| Backup set "fulldataman1" (/ /home /usr /usr/local /var /mnt/dos)
|------------------------------------------------------------
At block 0.

<Stuff cut here>

|------------------------------------------------------------
| Backup start: Mon Feb 02 05:16:49 2004
| Backup end:   Mon Feb 02 05:16:50 2004
|------------------------------------------------------------
At block 33201.
|------------------------------------------------------------
| Rewinding...
| Removing old level 1 log of fulldataman1 (dated 200401310500)
| Compressing log (fulldataman1.1.200402020500.gz)
| Linking fulldataman1.latest.gz -> fulldataman1.1.200402020500.gz
|------------------------------------------------------------
Key  not found in index

The tape did have an index on all previous runs but now appears to
contain 6 empty files.

Any ideas as to why this might happen? Could it be caused by a full
tape?


Barry Samuels
http://www.beenthere-donethat.org.uk
The Unofficial Guide to Great Britain

Re: [flexbackup-help] My backup system (details)

[Josh B. <jo...@ag...>]

Scott,

> Here is a more detailed description of my backup system, which uses
> flexbackup and is 'tape-less'.

All I can say is, wow!  You've turned flexbackup into a replacement for 
Amanda.!

-- 
-Josh Berkus
 Aglio Database Solutions
 San Francisco

[flexbackup-help] My backup system (details)

[Scott C. <sc...@bn...>]

Here is a more detailed description of my backup system, which uses
flexbackup and is 'tape-less'.

(My apologies in advance if the mail system hopelessly mungs
the tab formatted stuff below.  Viewing with a fixed-width font
may help fix some of the display problems.)

I backup six Linux computers and three MS Windows computers.  Each
of the six Linux computers runs flexbackup once per day, writing
the files that are backed-up to a compressed afio archive file,
which is saved on a separate disk drive in the computer.  These
drives store all of the backup images, with older images being deleted
manually as drive space dictates.

One of the six Linux computers is also a secondary storage location
for each of the five main Linux computers.  It also has the C drives
of the three MS Windows computers mounted in its filesystem, so that
these three computers are backed-up also.

This system gives me a 'tape-less' backup system (I don't have much
trust in tape drives) with all of the backup images on-line.  Each of
the five main Linux computers also has their backup images "backed-up"
to a central secondary Linux system, also with the images on disk.
This system is in a separate building from the other computers, and
is more secure.

Configuration of the five main Linux computers:

* Each of these computers has a primary disk and a "backup" disk.
  The primary disks hold the system and home filesystems, and are 20Gb each.
  The backup disks hold the flexbackup configuration and state files
  plus the compressed afio images.  These are 40Gb drives (except for
  one of the systems, which has a 40Gb home drive, and a 120Gb backup
  drive).

* The backup drive is mounted on '/backups'.  A typical directory listing
  of the '/backup' directory looks like this:
  
  zimtok5.root# l
  total 24
  drwxr-xr-x    2 root     root        16384 Jun  7  2003 lost+found
  drwxrwxrwt    2 root     root         4096 Jun  7  2003 tmp
  drwxr-x---    7 dad      dad          4096 Jan 12 15:10 zimtok5
  zimtok5.root#
  
  On each of the five computers there is a directory in the /backups
  directory which is named for that computer (zimtok5 in the example
  above).  The reason for this will be explained below.  This directory
  is owned by 'dad' (my local user name for "distribution administrator",
  you can use your own user name as needed) and is not accessible to
  the general public (for file security reasons).

* A directory listing of the directory 'zimtok5' looks like this:

  zimtok5.root# l
  total 32
  drwxr-xr-x    2 dad      dad          8192 Feb  1 23:13 archive
  -rw-r--r--    1 dad      dad          5937 Jun  7  2003 flexbackup.conf
  drwxr-xr-x    2 dad      dad          4096 Feb  2 01:39 images
  drwxr-xr-x    2 dad      dad          4096 Feb  2 01:41 log
  drwxr-xr-x    2 dad      dad          4096 Jan 27 01:39 state
  drwxr-xr-x    2 dad      dad          4096 Feb  2 01:41 tmp
  zimtok5.root#
  
  This directory contains the flexbackup.conf file, the 'images'
  directory (where the most current afio images are kept), an 'archive'
  directory (where older afio images are moved to), plus the 'log'
  and 'state' directories used by flexbackup.  This directory and
  subdirectories are the same on all six Linux computers.

* The root user has a cron entry which starts the backup process:

  # backups
  39 1 * * *      /home/dad/bin/runflex

  This starts a Perl script called 'runflex' which is in the bin
  directory of the user 'dad'.

* Each Linux computer has a user called 'dad' which I use for system
  maintenance tasks which I don't want root privileges attached to.
  It has log-in disabled so it can only be gotten to as root (su - dad).
  The home directory looks like this:
  
  zimtok5.root# l -R
  .:
  total 16
  drwxr-xr-x    2 dad      dad          4096 Apr 21  2003 bin
  drwxr-xr-x    2 dad      dad          4096 Jun  7  2003 etc
  drwxr-xr-x    2 dad      dad          4096 Feb  2 13:59 incoming
  drwxr-xr-x    2 dad      dad          4096 Aug 11 11:55 tmp

  ./bin:
  total 8
  -rwxr--r--    1 dad      dad          1975 Jan 12 14:32 purge-images
  -rwxr--r--    1 dad      dad          2183 Apr 21  2003 runflex

  ./etc:
  total 24
  -rw-r--r--    1 dad      dad           424 Jan 12 14:27 cron.dad
  -rw-r--r--    1 dad      dad           337 Jan 12 14:23 cron.root
  -rwxr-xr-x    1 dad      dad          1664 Mar 29  2003 newuser.pl
  -rw-r--r--    1 dad      dad          9167 Jan 30 15:03 user-list

  ./incoming:
  total 0

  ./tmp:
  total 0
  zimtok5.root#

  The 'bin' directory contains two Perl scripts: runflex, which does
  the backups; and 'purge-images' (which is a bit mis-named), which
  moves older afio images from the 'images' directory to the 'archives'
  directory.
  
  The 'incoming' directory is used for other purposes (as a destination
  for updated system files which get sent out from my central computer
  via 'scp'.)
  
* Here is a copy of the 'runflex' Perl script:

#!/usr/bin/perl

# runflex
#
# Run a flexbackup job for each of the directories in the /backups directory.
# Each flexbackup job has its own configuration file.
#
# Scott Coburn, April 2002

use strict;

#
# define a day offset into the month, unique to each job,
# so that, say, level 0 dumps will not be done on each
# job on the same night.  Then the network file
# transfers to the secondary storage computer (zartron9)
# will not clog the network with level 0 dumps
# from all of the individual computers. (The level 0
# dump transfers will be staggered...)
#

my %offset = (
	"zartron9"	=> 0,
	"gorzarg5"	=> 1,
	"x22a"		=> 2,
	"x22b"		=> 3,
	"x22c"		=> 4,
	"solids"	=> 5,
	"ahnooie4"	=> 6,
	"albh"		=> 7,
	"fred2"		=> 8,
	"zimtok5"	=> 9,
);

# thirty-one day cycle for backup dump levels 0 through 9.

my @sched = (
	1, 3, 2, 5, 4, 7, 6, 9, 8,
	1, 3, 2, 5, 4, 7, 6, 9, 8,
	1, 3, 2, 5, 4, 7, 6, 9, 8,
	0, 3, 2, 5);

my $budir = "/backups";
my $config = "flexbackup.conf";
my $cfile;				# constructed configuration file name
my $dname;				# directory name
my $job;				# job name
my $jobdir;				# job directory
my $host;				# host name (ie x22a, not x22a.nsls.bnl.gov)
my $dom;				# today's 'day of the month' (1-31)
my $level;				# job's dump level for today

my $retstat;				# system call return status

$dom = (localtime)[3];

opendir BUDIR, $budir or die "Backup directory $budir open error: $!\n";
while ($job = readdir BUDIR) {
    next if $job =~ /^\./;		# skip over .files
    next if $job =~ /lost\+found/;	# skip over lost+found directory
    next if $job =~ /tmp/;		# skip over tmp directory
    next if $job =~ /restore/;		# skip over restore directory

    $jobdir = "$budir/$job";
    $cfile = "$jobdir/$config";
    if (opendir IMDIR, $jobdir) {
	if ( -f $cfile and -r $cfile) {
	    $level = $sched[(($dom + $offset{$job} - 1) % 31)];
	    print "$job: flexbackup -fs all -level $level -c $cfile\n\n";
	    $retstat = system "flexbackup -fs all -level $level -c $cfile";
	} else {
	    print "Error reading configuration file $cfile: $!\n";
	}
	closedir IMDIR;
    } else {
	print "Skipping job directory $jobdir.  Open error: $!\n";
    }
}
closedir BUDIR;
  
  This script starts by getting the day-of-the-month (1 -> 31) to use
  as an index into the backup schedule array 'sched'.  It then goes into
  the directory '/backups' and loops through all of the directory entries,
  skipping over the 'lost+found', 'tmp', and 'restore' directories, plus
  any dot files that may be there.  For the case of running the script
  on the 'zimtok5' computer, it will find the 'zimtok5' directory.  It
  then constructs '/backups/zimtok5' and '/backups/zimtok5/flexbackup.conf',
  goes into '/backups/zimtok5', checks that the configuration file exists
  and is executable.  It then calculates the backup level given the day-of-
  the-month and this computers 'offset' (9 for zimtok5).  It then passes this
  level and the configuration file path and name to the actual flexbackup
  job.
  
  Since this script is run as a cron job the output of all of this is
  emailed to the root user when the backup completes.  Root's email is
  forwarded to 'dad' which is forwarded to 'dad' on the one of my other
  servers, which I collect each morning to see if all went well.

* The user 'dad' also has a cron job which runs once per day:

  # purge flexbackup image files
  13 23  * * *    /home/dad/bin/purge-images

  This runs a Perl script called 'purge-images'.  This script is not really
  needed, but I run it because I have not yet had the time to unwind it from
  my systems.  At one time it did some other useful things, but it has been
  deprecated slowly.  For what it is worth, here it is:

#!/usr/bin/perl

# Scott Coburn, March 2002

# purge-images
#
# Purge old level [0-9] afio image files from backup images directory.
# Purged files are moved to the archive directory.
# Old files should be deleted from the archive directory manually as
# needed to regain disk space.
#
# This program should be run on each host after flexbackup has finished.

use strict;

my $budir = "/backups";
my $imagedir = "images";
my $archivedir = "archive";
my $imtail = "afio-gz";
my $dname;		# directory name
my $fname;		# file name
my $dir;		# for constructed directory name
my @files;		# image file names
my $nfiles;		# number of file names to process
my $i;			# loop counter
my $thisfile;
my $nextfile;

my $retstat;		# system call return status

opendir BUDIR, $budir or die "Backup directory $budir open error: $!\n";
while ($dname = readdir BUDIR) {
    next if $dname =~ /^\./;		# skip over .files
    next if $dname =~ /lost\+found/;	# skip over lost+found directory
    next if $dname =~ /tmp/;		# skip over tmp directory
    next if $dname =~ /restore/;	# skip over restore directory

    $dir = "/$budir/$dname/$imagedir";
    if (opendir IMDIR, $dir) {
	&move_files;
	closedir IMDIR;
    } else {
	print "Skipping image directory $dir.  Open error: $!\n";
    }
}
closedir BUDIR;

sub move_files {
    @files = ();
    while ($fname = readdir IMDIR) {
	next if $fname =~ /^\./;		# skip over .files
	if ($fname =~ /^.*\.[0-9]\.\d*\.($imtail)$/) {
	    unshift @files, $fname;
	}
    }

    @files = sort @files;

    $nfiles = @files - 1;	# don't need to worry about last file on the list...

    $files[0] =~ /^(.*\.[1-9])/;
    $thisfile = $1;

    for ( $i = 0 ; $i < $nfiles ; $i++) {
	$files[$i+1] =~ /^(.*\.[1-9])/;
	$nextfile = $1;
	if ($thisfile eq $nextfile) {
#	    print "/bin/mv $dir/$files[$i] /$budir/$dname/$archivedir\n";
	    $retstat = system "/bin/mv $dir/$files[$i] /$budir/$dname/$archivedir";
	}
	$thisfile = $nextfile;
    }
}

# end purge-images

  This script loops through the /backups directory looking for sub-directories not
  named 'lost+found', 'tmp', or 'restore'.  When it finds one it goes into this directory's
  'image' subdirectory, makes a list of all of the files which end in 'afio-gz', sorts them,
  and then goes through moving (into the 'archive' directory) all those array entries whos
  next neighbor entry has the same beginning string (as this entry will be an image of a
  backup of a particular filesystem but with a "lower" backup date string in the name).
  
  Again, this is not really needed, you can just leave all of the images in the 'images'
  directory.  I am going to remove all of this stuff when I get the time.
  
So, to summarize: each of the five main computers runs a backup job each night, the
images are saved in the /backups tree;  root runs the backups via the 'runflex' script;
the /backups tree is owned by the user 'dad' who is accessible only by root; 'dad' keeps
all of the scripts in its home directory.

The sixth Linux system is my central administration computer.  This is the computer
where 'dad' lives.  This computer keeps the 'original copies' of all of the system
configuration files for my Linux systems.  Updated rpm files go out to each of the
computers from here.  It is also the secondary storage system for
the backup image files.  It also is a central location for system logs for the other
Linux systems.  It is located in a separate building and has only three accounts,
root, dad, and my account.  No logins are allowed for the user 'dad', so I have to
get to it through root.  The user 'dad' has ssh keys installed on the other five
Linux computers so that files can be securely copied back and forth from the central
system to the others via 'scp'.

The directory structure on this central computer (it is called zartron9) is very
similar to the one on the other five Linux computers.  Here are the differences:

* The '/backups' directory is a directory of symbolic links to directories on the
  drives which store the image files.  So, the '/backups' directory looks like this:
  
  zartron9.root# l
  total 4
  lrwxrwxrwx    1 dad      dad            18 Dec  9 16:45 ahnooie4 -> /backups0/ahnooie4
  lrwxrwxrwx    1 dad      dad            14 Dec  9 16:45 albh -> /backups0/albh
  lrwxrwxrwx    1 dad      dad            18 Feb 13  2003 gorzarg5 -> /backups0/gorzarg5
  lrwxrwxrwx    1 dad      dad            15 Dec  9 16:46 fred2 -> /backups0/fred2
  lrwxrwxrwx    1 dad      dad            16 Dec  9 17:05 solids -> /backups1/solids
  lrwxrwxrwx    1 dad      dad            14 Feb 13  2003 x22a -> /backups0/x22a
  lrwxrwxrwx    1 dad      dad            14 Feb 13  2003 x22b -> /backups0/x22b
  lrwxrwxrwx    1 dad      dad            14 Feb 13  2003 x22c -> /backups0/x22c
  lrwxrwxrwx    1 dad      dad            18 Feb 13  2003 zartron9 -> /backups0/zartron9
  lrwxrwxrwx    1 dad      dad            17 Jun 23  2003 zimtok5 -> /backups0/zimtok5
  zartron9.root#

  This directory contains a link for each of the computers which is backed-up in my
  system.
  
  There is a 250Gb drive which stores the backup images, it is mounted on '/backups0'.
  I have been through a couple of drive configurations, and having this directory full
  of links has worked very well in adapting to the changes.
  
  The link 'solids' is to a directory on another 250Gb drive which is mounted on
  '/backups1'.  This is for our server computer, which I have not yet gotten onto this
  backup system.
  
* There is a directory called '/desktops' which has three MS Windows computer's drive
  Cs mounted in it.  It looks like this:
  
  zartron9.root# l
  total 24
  drwx------    1 root     root         4096 Jan 30 18:01 ahnooie4.driveC
  drwx------    1 root     root         4096 Jan  9 10:42 albh.driveC
  drwx------    1 root     root         4096 Jan 22 08:31 fred2.driveC
  -rw-r--r--    1 root     root         1010 Feb 21  2003 shares
  -rwxr-xr-x    1 root     root         2328 Feb 14  2003 smount
  -rwxr-xr-x    1 root     root         1867 Feb 14  2003 sumount
  zartron9.root#
  
  The 'shares', 'smount', and 'sumount' are files related to mounting and unmounting
  the these Samba file systems.  So, these three disks are part of zartron9's file
  system, making them available for backups.
  
* Just as in the case of the five main Linux computers, each of the links in
  '/backups' points to a directory with 'images', 'archive', etc., and a flexbackup.conf
  file.  However, the directories for the five main Linux computers (gorzarg5, x22a,
  x22b, x22c, and zimtok5) have their flexbackup.conf files renamed to, say,
  flexbackup.conf.zimtok5.  This will prevent 'runflex' from trying to do a real
  backup from the configuration file (zartron9 is not the computer to do the backup on)
  and also provides a backup copy of the conf file from the computer it does run on.
  The /backups/zartron9 link points to zartron9's backup directory, with its flexbackup.conf.
  The other three (ahnooie4, albh, and fred2) have flexbackup.conf files which specify
  backups for the MS Windows filesystems mounted in /desktops.
  
  So, when 'runflex' runs on 'zartron9' the Perl script loops through the '/backups'
  directory, looking for 'flexbackup.conf' files and running a flexbackup job for each
  one it finds.  It will find one for each of zartron9 and the three MS Windows mounts.
  
  This is why the structure of the '/backups' directory is the way it is.  I only need
  one version of the 'runflex' script for all of my systems.  It just loops through the
  '/backups' directory and runs a flexbackup job for each 'flexbackup.conf' file it finds.
  On the main Linux computers it finds only one conf file, but on zartron9 it finds four.
  
* The computer zartron9 also runs a Perl script called 'get-images' which is run as a
  cron job once per day.  It copies the previous days backup images from each of the five
  main Linux computers.  Here it is:

#!/usr/bin/perl

# Scott Coburn, June 2003

# get-images
#
# Retrieve latest afio backup images from each host.  Filenames
# of images to retrieve are in the flexbackup log on each host.
#

use strict;

my $budir = "/backups";
my $flogdir = "log";
my $flogname = "all.latest";
my $imagedir = "images";
my $remote_flogname;
my $local_flogname;

my $fqhost;             # fully-qualified host name
my $host;               # host name
my $retstat;            # system call return status

my %hosts = (
    "gorzarg5"  => "gorzarg5.phy.bnl.gov",
    "x22a"      => "x22a.nsls.bnl.gov",
    "x22b"      => "x22b.nsls.bnl.gov",
    "x22c"      => "x22c.nsls.bnl.gov",
    "zimtok5"   => "zimtok5.phy.bnl.gov",
);

while (($host, $fqhost) = each %hosts) {
    $retstat = system "/bin/ping -q -c 2 -w 5 $fqhost > /dev/null";
    if ($retstat) {
        print "Host $fqhost could not be reached.  Skipping it.\n";
    } else {
        print "Host $fqhost seems to be alive today.\n";
        $local_flogname = "/$budir/$host/$flogname";
        $remote_flogname = "/$budir/$host/$flogdir/$flogname";
        $retstat = system "/usr/bin/scp $fqhost:$remote_flogname $local_flogname > /dev/null";
        &process_flog unless $retstat;
    }
}

sub process_flog {
    $retstat = open FLEXLOG, "<$local_flogname";
    if ($retstat) {
        while (<FLEXLOG>) {
            chomp;
            if (/of=(.*-gz)/) {
                print "Retrieving $host:$1\n";
                system "/usr/bin/scp $fqhost:$1 $budir/$host/$imagedir > /dev/null";
            }
        }
        close FLEXLOG;
    } else {
        print "Cannot open flexbackup log file $local_flogname: $!\n";
    }
}

  This script copies the backup image files for each of the hosts listed in the
  'hosts' array.  It pings the host to see if it is reachable.  If so, it constructs
  some filenames with paths, retrieves the previous days 'latest-all' log file, and
  calls the 'process_flog' procedure.  This procedure simply retrieves each file listed
  in the log file using 'scp'.  Each retrieved image file is put into its host's
  /backups/'host'/images directory, just where it appears on the host.

I plan to make some changes to this system when I have some time:

* update flexbackup and the Perl scripts to flexbackup version 1.? (whatever the
  latest version is.
  
* configure one of my other Linux systems to be the secondary backup system for
  storing the backup images created by zartron9.  With the system as it is now,
  the backup images created by zartron9 are only in one place (on zartron9).  This
  is a single point of failure for this computer and the three MS Windows computers.

* weed out the 'purge-images' scripts.

I have not included any of my 'flexbackup.conf' files here.  They are pretty much
standard, except I have changed the list of files type and directories to backup
and to skip.  I have also changed the filenames and paths to the 'state' and 'log'
directories, to point into the /backups/'host' directory.

As always, comments and criticisms are welcome.  Questions answered eventually.

Scott

-- 
* Scott Coburn
* Brookhaven National Laboratory
* sc...@bn... 631.344.7110
* This message brought to you by Linux.

Re: [flexbackup-help] Multiple level 0 sets to a single tape

[Edwin H. <ed...@co...>]

[ Gaute Lund wrote: ]
> I have just started using flexbackup. I have defined a handful of sets that 
> I which to back up on the same tape. I have $erase_tape_set_level_zero = 
> 'false';
> 
> When I do 'flexbackup -set all -level 0 -pkgdelta rpm', I am asked
> 
> ---> Insert tape [n, incrementing] (enter y to continue)
> 
> ...for each set.
> 
> I don't know perl, but inspecting the relevant section of the code, I can't 
> see any way to disable this prompt. Searching through the faq and the 
> mailing list reveals no information about this issue.
> 
> What am I missing here? Is this entirely by design?


Kind of. "-set all", >1 set, and level 0 all together are a special case
that trigger the tape change prompt.  I used to use it in that fashion when
it was originally designed.

You're right that it should be turn-off-able but isn't.  noted...

For now if you don't want to edit, you could either:

 - Put the directories you want on one tape together into just one set
   rather than multiple ones

 - Chain the sets like this:

    flexbackup -newtape ; \
    flexbackup -set <set1> -norewind -noerase ; \
    flexbackup -set <set2> -norewind -noerase ; \
    flexbackup -set <setn> -noerase


-- 
 Edwin Huffstutler 
 ed...@co...   GnuPG Key ID: AE782DC9

[flexbackup-help] Using -compare in unattended backups

[Gaute L. <ga...@id...>]

I find the -compare feature difficult to use. One must refer to a backup 
set with -num or 'mt fsf', while the "target" directory is the current. 
This is cumbersome.

When running unattended backups, it is all but impossible to use -compare. 
As far as I can see, one would have to parse the log file to find the file 
number on tape. Why can't there be an option -verify, which automatically 
runs compare for each set? And, is it possible to have the -compare/-verify 
ignore files which are changed since the backup run, and not generate 
errors over such files?

And for straight -compares, why can't flexbackup "find" the correct 
directory and file number automatically? If I issue 'flexbackup -compare 
-set bob', couldn't flexbackup just find the latest version of the set bob 
on tape, and compare it to the data on disk?

If I have missed something, please excuse me, and point me in the right 
direction.

For all my bitching: I really like flexbackup, it's features, it's use of 
standard tools, and the way it balances strength and features vs. 
simplicity. Good work!

Med vennleg helsing / Best regards
Gaute Lund
IT consultant (GL184P-NORID, GL597-RIPE)
iDrift AS
Phone: (+47) 53 47 02 90
Direct: (+47) 53 47 02 93
Fax: (+47) 53 47 02 91
Mobile: (+47) 97 00 82 00 

[flexbackup-help] Multiple level 0 sets to a single tape

[Gaute L. <ga...@id...>]

Hi,

I have just started using flexbackup. I have defined a handful of sets that 
I which to back up on the same tape. I have $erase_tape_set_level_zero = 
'false';

When I do 'flexbackup -set all -level 0 -pkgdelta rpm', I am asked

---> Insert tape [n, incrementing] (enter y to continue)

...for each set.

I don't know perl, but inspecting the relevant section of the code, I can't 
see any way to disable this prompt. Searching through the faq and the 
mailing list reveals no information about this issue.

What am I missing here? Is this entirely by design?

Med vennleg helsing / Best regards
Gaute Lund
IT consultant (GL184P-NORID, GL597-RIPE)
iDrift AS
Phone: (+47) 53 47 02 90
Direct: (+47) 53 47 02 93
Fax: (+47) 53 47 02 91
Mobile: (+47) 97 00 82 00 

[flexbackup-help] generalizing prune to any find arg; contributing a config file "compiler"

[<al...@ba...>]

Hi folks. I made some modifications to flexbackup 0.9.8, which Edwin was
kind enough to incorporate some of. I would like to see if I can contribute
some code to flexbackup to support all the things I have hacked together for
my use, so that I can then use the mainline version.

It seems to me that the idea of the "prune" hash is very clever: it allows
excluding directories on a filesystem by filesystem basis. Could that
concept be extended to any find argument? So something like

$findargs{'myserver:/'} = ' -regex "\./var/\(log\|named\|lib\).* -o -path
"./usr/local* -o -path "./etc*" ';

and then that arg would be appended to the find arguments (whether before or
after the -prune I am not sure, or with -a or -o or what) for that
filesystem.

As a separate contrib project, I could then write a "compiler", which would
take a config file that basically specifies find arguments, only with
greater readability and interspersed comments, and converts it into a
file that could be require'd in flexbackup.conf.

What I have now looks like this:

FILESYSTEM diego:/
# all we are keeping is a few things in /var and /usr/local
"("
   -regex "\./var/\(log\|named\|lib\).*"
   -o -path "./usr/local*"
   -o -path "./etc*"
")"

Let me know if this seems like a useful contribution, if so please add
alex_aminoff as a developer on sourceforge and I will submit my changes thru
CVS.

 - Alex

Re: [flexbackup-help] Exclude certain files

[Ajay S. <ss...@am...>]

On Thu, 2004-01-22 at 19:11, Edwin Huffstutler wrote:
> [ Stefan Nicolin wrote: ]
> > with flexbackup 1.2.0 is there a way to exclude certain files? So far I
> > understand it, pruning works only or directorys.
> 
> True; the prune is meant for whole subtrees.
> 
> You could craft an exclude regular expression to hit only certain files. 
> (the $exclude_expr array)

This might be a different problem altogether but it's kinda similar. 
I'm trying to backup windows share that I have mounted locally on the
backup server using samba.  And I'm just grabbing the main drives:  C$,
D$, F$, etc...  And it will always fail on pagefile.sys because it's
"busy".  Is there a way to tell flexbackup to ignore that file?  Here's
what I have in exclude_expr:

$exclude_expr[0] = '.*/[Cc]ache/.*';
$exclude_expr[1] = '.*~$';
$exclude_expr[2] = '.*pagefile\.sys.*';
$exclude_expr[3] = '.*PAGEFILE\.SYS.*';

And the output from a typical flexbackup session:

flexbackup version 1.2.0 (http://flexbackup.sourceforge.net)
/etc/flexbackup.conf syntax OK

|------------------------------------------------------------
| Checking 'buffer' on this machine... Ok
| Checking /bin/sh on this machine... bash2
|------------------------------------------------------------
| Doing level 1 backup of set server3 using tar
| Backup set server3 (/mnt/server3_c /mnt/server3_d /mnt/server3_f
/mnt/server3_i)
|------------------------------------------------------------
| Backup of: /mnt/server3_c
| Date of this level 1 backup: Fri Jan 23 03:37:57 2004
| Date of last level 0 backup: Sun Jan 18 06:56:00 2004
|------------------------------------------------------------
| cd "/mnt/server3_c" && sudo find . -regex "\./\(WINNT\)/.*" -prune -o
! \
|   -type s \( -newer "/backup/flex/lib/mnt-server3_c.0" -or -cnewer \
|   "/backup/flex/lib/mnt-server3_c.0" \) ! -regex ".*/[Cc]ache/.*" ! \
|   -regex ".*~"$ ! -regex ".*pagefile\.sys.*" ! -regex
".*PAGEFILE\.SYS.*" \
|   -print0 | sudo tar --create --null --files-from=-
--ignore-failed-read \
|   --same-permissions --no-recursion --totals --sparse --file - | gzip
-4 \
|   | buffer -m 20m -p 75 -t -o \
|   "/backup/flex/data/mnt-server3_c.1.200401230337.tar.gz"
|------------------------------------------------------------
find: ./pagefile.sys: Text file busy
Total bytes written: 40960 (40kB, 1.9kB/s)
Kilobytes Out 5

ERROR from backup, exiting
offending command(s):
cd "/mnt/server3_c" && sudo find . -regex "\./\(WINNT\)/.*" -prune -o !
-type s \( -newer "/backup/flex/lib/mnt-server3_c.0" -or -cnewer
"/backup/flex/lib/mnt-server3_c.0" \) ! -regex ".*/[Cc]ache/.*" ! -regex
".*~"$ ! -regex ".*pagefile\.sys.*" ! -regex ".*PAGEFILE\.SYS.*" -print0
| sudo tar --create --null --files-from=- --ignore-failed-read
--same-permissions --no-recursion --totals --sparse --file - | gzip -4 |
buffer -m 20m -p 75 -t -o
"/backup/flex/data/mnt-server3_c.1.200401230337.tar.gz"

Thanks!
Ajay

Re: [flexbackup-help] ejecting tape after backup

[Chris S. <sn...@ca...>]

Sorry...  what I mean't was where should the command go in the flexbackup
script?

Thanks,

Chris