Bacula

Internet is boring and uninteresting? But not this site!... http://dragonucleon.perso.sfr.fr/links.php?oSID=07ut0

Congratulations! I can help you!... http://obermaneken.ru/page.php?lecgoogleId=79d2

I have ~20 servers that i backup with bacula to file storage (mostly incrementally). Now i want to write some of backups to tape, but as full backups. How can i do this without performing extra jobs on the client and without extracting all data to some directory on server and writing it to the tape?

Is there a way to repack from bacula incremental archives to something less obscure like zip/tar on the fly?

I think you could use Migration Jobs for that, but since i've just started
trying out with that myself, I can't help you with details about
implementing... But there's a good documentation about that on:

http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html

And off course, there's lots of discussion on this subject on this list...


2011/4/4 Michael A Baikov <pacak@...>

>
> I have ~20 servers that i backup with bacula to file storage (mostly
> incrementally). Now i want to write some of backups to tape, but as full
> backups. How can i do this without performing extra jobs on the client and
> without extracting all data to some directory on server and writing it to
> the tape?
>
> Is there a way to repack from bacula incremental archives to something less
> obscure like zip/tar on the fly?
>
>
> ------------------------------------------------------------------------------
> Create and publish websites with WebMatrix
> Use the most popular FREE web apps or write code yourself;
> WebMatrix provides all the features you need to develop and
> publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@...
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>

Op 4/04/2011 13:58, Michael A Baikov schreef:
> I have ~20 servers that i backup with bacula to file storage (mostly incrementally). Now i want to write some of backups to tape, but as full backups. How can i do this without performing extra jobs on the client and without extracting all data to some directory on server and writing it to the tape?
>
> Is there a way to repack from bacula incremental archives to something less obscure like zip/tar on the fly?
>
You might want to look into Virtual Fulls.
http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_3_0_0.html#SECTION00870000000000000000

This is the only way I know of in bacula to "convert" a series of 
full-diff-incr backups into 1 new backup without contacting the client.

Kind regards,
Jeremy

 **** DISCLAIMER ****
http://www.schaubroeck.be/maildisclaimer.htm

Dawie Pretorius

Office:  +27 11 250 3000
Direct:  +27 11 250 3257
Email:   dawiep@...

http://supermobi.com.ua/friend.php?html120

Only for you! All secrets of satisfaction! Don’t miss it!. http://www.fundacionkipp.org.ar/com.page.php?vivhot=60oz7

http://dorsetcarwindowtinting.co.uk/wp-content/uploads/fgallery/work.php?ac

<a name="cxxavyjyed" title="" href="http://jupiter22.com/modules/mod_wdbanners/friends.php?test2.php">http://jupiter22.com/modules/mod_wdbanners/friends.php?test2.php</a>

Hello.

I am new to this list and I would like to introduce myself first. My name is Josué Alcalde and I work at a Spanish IT company. We have been using Bacula for backup for almost two years with a configuration about tuenty servers. Now, I am having some problems with a change in my configuration and I hope I could get some help here.

Our configuration is simple.
A LTO-4 device without auto-changer.
About twenty clients with one job and fileset by client
Five pools with one tape for week days from Monday to Friday (no need for back up on weekend)   
Four Schedules (before backukp, backup, backup catalog and after backup)

We use the Schedule before backup to mount the tape and the one after backup to eject it, so everything works automatically and the only job for the operator is get the ejected tape and put the correct tape in the device. The backup is scheduled to start about 4:00 am, so we really are doing backups from Tuesday to Saturday.

My problem comes with a change that will introduce another tape. The idea is take a tape far away from our office when it is possible, so we have a 'very big disaster' alternative tape. It usually happens once a week but not necessary, so I can't use a “15 days pool” because some times the tape won't be available. 

My idea was to convert the FridayPool into WeeklyPool with two tapes and let Bacula use one of them, the tape which is in the device when the job starts. The problem is that Bacula decides the tape it wants and it won't use the other one even if it is available and mounted. So, my Fridays backup are only taking place some times.

I would thank any help to configure this scenario in the right way.
Also, I am attaching my current configuration (a short version of it) in case of it is useful.

________________________________________
Josué Alcalde González
Jefe de Equipo Desarrollo en Entornos Abiertos
josue.alcalde@...

On Tuesday 17 April 2012 15.45:13 Christophe LARSONNEUR wrote:
> Bonjour,
> 
>  
> 
> Je rencontre un problème avec le FD sur différents serveurs Windows.
> 
> La sauvegarde s'effectue correctement mais la restauration ne s'effectue pas.
> 
> En effet lorsque je lance une restauration via la console et la commande restore j'obtiens deux erreurs sur mon FD.
> 
> Voir ci-dessous.
> 
>  
> 
> 17-avril 13:59 SRV-BACULA-dir JobId 163: Start Restore Job RestoreFiles.2012-04-17_13.59.31_09
> 
> 17-avril 13:59 SRV-BACULA-dir JobId 163: Using Device "DeviceFile"
> 
> 17-avril 13:59 SRV-BACULA-sd JobId 163: Ready to read from volume "Pool-Full-UC-46-2012-04-17i-12:12" on device "DeviceFile" (/var/data/catalogue).
> 
> 17-avril 13:59 SRV-BACULA-sd JobId 163: Forward spacing Volume "Pool-Full-UC-46-2012-04-17i-12:12" to file:block 0:230.
> 
> 17-avril 13:59 SRV-BACULA-dir JobId 163: Fatal error: Socket error on Store end command: ERR=Connexion ré-initialisée par le correspondant 17-avril 13:59 SRV-BACULA-sd JobId 163: Error: bsock.c:389 Write error sending 62283 bytes to client:192.168.30.142:36643: ERR=Erreur d'entrée/sortie 17-avril 13:59 SRV-BACULA-sd JobId 163: Fatal error: read.c:137 Error sending to File daemon. ERR=Erreur d'entrée/sortie 17-avril 13:59 SRV-BACULA-sd JobId 163: Error: bsock.c:335 Socket has errors=1 on call to client:192.168.30.142:36643 17-avril 13:59 SRV-BACULA-dir JobId 163: Error: Bacula SRV-BACULA-dir 5.2.6 (21Feb12):
> 
>   Build OS:               x86_64-unknown-linux-gnu debian 6.0.4
> 
>   JobId:                  163
> 
>   Job:                    RestoreFiles.2012-04-17_13.59.31_09
> 
>   Restore Client:         UC-46
> 
>   Start time:             17-avril-2012 13:59:33
> 
>   End time:               17-avril-2012 13:59:35
> 
>   Files Expected:         11
> 
>   Files Restored:         0
> 
>   Bytes Restored:         0
> 
>   Rate:                   0.0 KB/s
> 
>   FD Errors:              1
> 
>   FD termination status:  
> 
>   SD termination status:  Canceled
> 
>   Termination:            *** Restore Error ***
> 
>  
> 
> 17-avril 13:59 SRV-BACULA-dir JobId 163: Error: Bacula SRV-BACULA-dir 5.2.6 (21Feb12):
> 
>   Build OS:               x86_64-unknown-linux-gnu debian 6.0.4
> 
>   JobId:                  163
> 
>   Job:                    RestoreFiles.2012-04-17_13.59.31_09
> 
>   Restore Client:         UC-46
> 
>   Start time:             17-avril-2012 13:59:33
> 
>   End time:               17-avril-2012 13:59:35
> 
>   Files Expected:         11
> 
>   Files Restored:         0
> 
>   Bytes Restored:         0
> 
>   Rate:                   0.0 KB/s
> 
>   FD Errors:              2
> 
>   FD termination status:  
> 
>   SD termination status:  Canceled
> 
>   Termination:            *** Restore Error ***
> 
>  
> 
> La restauration me plante le service bacula-fd.
> 
> Si je test avec la commande suivante sous Windows j'ai ce message d'erreur :
> 
>  
> 
> C:\Program Files\Bacula> 17-Apr 15:41 bacula-fd: ERROR TERMINATION at /home/kern/bacula/k/bacula/src/lib/
> 
> parse_conf.c:918
> 
> Config error: Cannot open config file "C:\ProgramData\Bacula/bacula-fd.conf": No  such file or directory
> 
>  
> 
> Merci pour votre aide.
> 
> Cordialement.
> 
>  
> 
> Christophe

Christophe tout est dit dans le message d'erreur 
C:\ProgramData\Bacula/bacula-fd.conf": No  such file or directory

pour tester le service 
bacula-fd -t -d 200 -c emplacement-du-fichier-de-configuration tel que déclarer dans le service


-- 
Bruno Friedmann 
Ioda-Net Sàrl http://www.ioda-net.ch
 
openSUSE Member & Ambassador
GPG KEY : D5C9B751C4653227
irc: tigerfoot

Hi

I'm receiving que following message when trying to run a job:

 JobId Level   Name                       Status
======================================================================
  2498 Full    proxy.sysconf.2012-05-04_09.38.01_10 *is waiting for a mount
request*
====

The storage device was changed from a hard disk to an usb disk due to
problems in the original backup disk. Maybe some procedure i skipped?

-- 
Att.*
***

On Fri, May 04, 2012 at 09:51:51AM -0300, Luis H. Forchesatto wrote:
> Hi
> 
> I'm receiving que following message when trying to run a job:
> 
>  JobId Level   Name                       Status
> ======================================================================
>   2498 Full    proxy.sysconf.2012-05-04_09.38.01_10 *is waiting for a mount
> request*
> ====
> 
> The storage device was changed from a hard disk to an usb disk due to
> problems in the original backup disk. Maybe some procedure i skipped?
> 
> -- 

I guess we need some more config info here, specifically you should
have received a mount request email to the address configured in your
bacula config. It will contain the info about which volume / media
bacula wants mounted or hasn't found for some reason.

Cheers, Uwe 
-- 
NIONEX --- Ein Unternehmen der Bertelsmann AG

I apologize

The e-mail I'm receiving tells me the following:

********************************************************************
04-May 08:48 backup-dir JobId 2497: Start Backup JobId 2497,
Job=smbserver.sysconf.2012-05-04_08.48.46_05
04-May 08:48 backup-dir JobId 2497: Max configured use duration exceeded.
Marking Volume "smbserver.sysconf-802" as Used.
04-May 08:48 backup-dir JobId 2497: There are no more Jobs associated with
Volume "smbserver.sysconf-898". Marking it purged.
04-May 08:48 backup-dir JobId 2497: All records pruned from Volume
"smbserver.sysconf-898"; marking it "Purged"
04-May 08:48 backup-dir JobId 2497: Recycled volume "smbserver.sysconf-898"
04-May 08:48 backup-dir JobId 2497: Using Device "FileStorage"
04-May 08:48 backup-sd JobId 2497: Warning: label.c:331 Open device
"FileStorage" (/media/usb-backup/bacula/) Volume "smbserver.sysconf-898"
failed: ERR=dev.c:548 Could not open:
/media/usb-backup/bacula/smbserver.sysconf-898, ERR=Permission denied

04-May 08:48 backup-sd JobId 2497: Warning: label.c:331 Open device
"FileStorage" (/media/usb-backup/bacula/) Volume "smbserver.sysconf-898"
failed: ERR=dev.c:548 Could not open:
/media/usb-backup/bacula/smbserver.sysconf-898, ERR=Permission denied
********************************************************************
Other e-mail:
********************************************************************
04-May 08:48 backup-sd JobId 2497: Please mount Volume
"smbserver.sysconf-898" or label a new one for:
    Job:          smbserver.sysconf.2012-05-04_08.48.46_05
    Storage:      "FileStorage" (/media/usb-backup/bacula/)
    Pool:         smbserver.sysconf
    Media type:   File
********************************************************************

Server info:

# cat /etc/isue
Debian GNU/Linux 5.0 \n \l

# cat /etc/debian_version
5.0.2

And thanks for answering me.


2012/5/4 Uwe Schuerkamp <uwe.schuerkamp@...>

> On Fri, May 04, 2012 at 09:51:51AM -0300, Luis H. Forchesatto wrote:
> > Hi
> >
> > I'm receiving que following message when trying to run a job:
> >
> >  JobId Level   Name                       Status
> > ======================================================================
> >   2498 Full    proxy.sysconf.2012-05-04_09.38.01_10 *is waiting for a
> mount
> > request*
> > ====
> >
> > The storage device was changed from a hard disk to an usb disk due to
> > problems in the original backup disk. Maybe some procedure i skipped?
> >
> > --
>
> I guess we need some more config info here, specifically you should
> have received a mount request email to the address configured in your
> bacula config. It will contain the info about which volume / media
> bacula wants mounted or hasn't found for some reason.
>
> Cheers, Uwe
> --
> NIONEX --- Ein Unternehmen der Bertelsmann AG
>
>
>


-- 
Att.*
***

Hello Luis, 

looks like bacula has a permission problem and cannot read or write to
the new usb device, you might want to check permission settings on the
directory /media/usb-backup/bacula/ when the drive is mounted: 

On Fri, May 04, 2012 at 10:36:34AM -0300, Luis H. Forchesatto wrote:

> 04-May 08:48 backup-dir JobId 2497: Using Device "FileStorage"
> 04-May 08:48 backup-sd JobId 2497: Warning: label.c:331 Open device
> "FileStorage" (/media/usb-backup/bacula/) Volume "smbserver.sysconf-898"
> failed: ERR=dev.c:548 Could not open:
> /media/usb-backup/bacula/smbserver.sysconf-898, ERR=Permission denied
> 



All the best, Uwe 

-- 

NIONEX --- Ein Unternehmen der Bertelsmann AG

Sure, the drive needed to be mounted so bacula can save the backups.

This server belong to a client, and he simply forget do plug the usb drive
in the usb port, he plugged and everything worked perfectly. "It will be
surely plugged to the drive" he said.

Now I ask you, how people like him survive nowadays? ¬¬

Thanks for the help by the way.

2012/5/7 Uwe Schuerkamp <uwe.schuerkamp@...>

> Hello Luis,
>
> looks like bacula has a permission problem and cannot read or write to
> the new usb device, you might want to check permission settings on the
> directory /media/usb-backup/bacula/ when the drive is mounted:
>
> On Fri, May 04, 2012 at 10:36:34AM -0300, Luis H. Forchesatto wrote:
>
> > 04-May 08:48 backup-dir JobId 2497: Using Device "FileStorage"
> > 04-May 08:48 backup-sd JobId 2497: Warning: label.c:331 Open device
> > "FileStorage" (/media/usb-backup/bacula/) Volume "smbserver.sysconf-898"
> > failed: ERR=dev.c:548 Could not open:
> > /media/usb-backup/bacula/smbserver.sysconf-898, ERR=Permission denied
> >
>
>
>
> All the best, Uwe
>
> --
>
> NIONEX --- Ein Unternehmen der Bertelsmann AG
>
>
>


-- 
Att.*
***

Dear All,

        Is it right to work Director (release 5.0.2) co old client File
Daemon (v 2.4.2-1)?

Tnanks,
Kirill

Hi list,

Here's my setup :
DIR, SD and FD are on different virtual machines. They are debian squeeze
vservers (all of them). Until recently, we were running 2.4.4.1 (lenny) and
everything was fine. I had to update some servers in squeeze, so I also
created new virtual machines and configured them with bacula (DIR/SD),
version 5.0.2-2.2+b1 and configured my clients with the corresponding FD.

Now the problem :

When executing a backup for big servers (100 Gb +), I get this error :

Fatal error: sql_create.c:800 sql_create.c:800 insert -- followed by the
mysql query.

Then :

Fatal error: catreq.c:497 attribute create error. sql_find.c:376 Request
for Volume item 1 greater than max 0 or less than 1
13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error: Network
error with FD during Backup: ERR=Interrupted system call
13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error: No Job
status returned from FD.
13-Jun 18:01 unisson.private.tice.ac-orlea JobId 170: Fatal error:
sql_get.c:373 sql_get.c:373 query SELECT VolumeName,MAX(VolIndex) FROM
JobMedia,Media WHERE JobMedia.JobId=170 AND JobMedia.MediaId=Media.MediaId
GROUP BY VolumeName ORDER BY 2 ASC failed:
Got error 28 from storage engine

I *did* read the faq and added

wait_timeout=691200
interactive_timeout=691200

To my.cnf.

I also added HearbeatInterval = 1 min

to bacula-sd.conf and bacula-fd.conf (on the vserver that had problems).

But still no go. Backup runs for about 15 minutes and then hangs with this
error.

I have increased other my.cnf params :

key_buffer              = 64M
max_allowed_packet      = 16M
thread_stack            = 192K
thread_cache_size       = 8
# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
myisam-recover         = BACKUP
max_connections        = 100
table_cache            = 256
thread_concurrency     = 10

But still nothing.

Any idea would be very much appreciated since I've got no backup now for
most of my servers...

Thanks!

Greetings.

I'm running bacula and I got 3 jobs for a single server that backup the
entire filesystem. Searching how to enable multiple jobs at the same time i
found the "Maximum Concurrent Jobs" directive but also found this line:

"We recommend that you carefully test your multiple concurrent backup
including doing thorough restore testing before you put it into production."

Font:
http://www.bacula.org/fr/dev-manual/Tips_and_Suggestions.html#SECTION0081818000000000000000

Which problems may occur when running multiple jobs from the same server?

>From the 3 jobs there's 2 that I want to run simultaneously. Each one
backups different folders with different filesystems, but one saves about
200GB and the other one saves about (150GB, but about 2.000.000+ files).

-- 
Att.*
***

Zitat von "Luis H. Forchesatto" <luisforchesatto@...>:

> Greetings.
>
> I'm running bacula and I got 3 jobs for a single server that backup the
> entire filesystem. Searching how to enable multiple jobs at the same time i
> found the "Maximum Concurrent Jobs" directive but also found this line:
>
> "We recommend that you carefully test your multiple concurrent backup
> including doing thorough restore testing before you put it into production."
>
> Font:
> http://www.bacula.org/fr/dev-manual/Tips_and_Suggestions.html#SECTION0081818000000000000000
>
> Which problems may occur when running multiple jobs from the same server?

You need careful testing and understanding to not actually slow down  
your backups because of concurrency. If you do not use data encryption  
most of the time the I/O will be your bottleneck and it doesn't help  
to load the same I/O channel with more than one backup at once for  
example. If you want to do this with a Windows clients be aware that  
it doesn't work with neither VSS nor Data Encryption. If it is Unix  
with more than one I/O channel and a fast connection to your backup  
server you might get more speed with concurrent backups.

Regards

Andreas

Zitat von "Luis H. Forchesatto" <luisforchesatto@...>:

> Good morning Andreas.
>
> In my case both machines (client and storage/director) are linux OS. They
> are at the same network and the backup are transported via network. I think
> that way is better to keep one job per server, am I right?
>
> Thanks for answering me. :)

If you have more than one I/O channel (multiple disk(s)) and your  
network is not saturated from one job you can try if your Bacula  
server (SD) is able to handle another one concurrently with raising  
throughput. No problem with Unix (Linux) but not usefull in all cases.

Regards

Andreas

--