RE: [Bacula-users] performance question

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

Hello again,

Since you have a point about the servers not being the same I did =
another
test.

I compiled and installed Afbackup on the same server as Bacula. I =
stopped
Bacula and backed-up
a remote client again. The result are quite surprising.

With afbackup , no compression, new tape and same servers and backup =
drive
I can backup 2Gb in 10 minutes.
-------------------------------AFBACKUP
RESULT------------------------------------
[Afbackup]: Overall exit status: 0
Minimum restore information: @@@=3D=3D=3D--->>> dwsegsu1 backuphost =
2988 1 1
/tmp/afbsp_0S_HaN2_Ybpj01_HOu1
Backup statistics:
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

Client Identifier:             dwsegsu1

Exit Status:                   0

Start-Time:                    Mon Mar 15 08:45:16 2004
End-Time:                      Mon Mar 15 08:55:12 2004

Backup Server:                 backuphost
Backup Port:                   2988
First Cartridge used:          1
First Tapefile accessed:       1
Last Cartridge used:           1
Last Tapefile accessed:        42
Used Cartridges:               1

Stored filesystem entries:     69593
Bytes written to media:        2094829227
Sum of filesizes:              2089570475
Sum of compressed filesizes:   0
Sum of uncompressed filesizes: 2089570475
----------------------END of AFBACKUP
RESULT---------------------------------------

With Bacula no compression, new tape and same servers and backup drive =
I get
2Gb in 54 mins
----------------------BACULA
RESULT----------------------------------------------------
coredev-dir: Start Backup JobId 113,
Job=3Ddwsegsu1-Sol_root.2004-03-10_19.34.37
coredev-dir: Bacula 1.32f-5 (09Mar04): 10-Mar-2004 20:26
JobId: 113
Job: dwsegsu1-Sol_root.2004-03-10_19.34.37
Backup Level: Full
Client: dwsegsu1-fd
FileSet: "Sol_root" 2004-02-26 18:33:32
Start time: 10-Mar-2004 19:34
End time: 10-Mar-2004 20:26
FD Files Written: 68,991
SD Files Written: 68,991
FD Bytes Written: 2,081,565,715
SD Bytes Written: 2,089,239,862
Rate: 668.0 KB/s
Software Compression: None
Volume name(s): Coredev-Volume-1
Volume Session Id: 1
Volume Session Time: 1078965236
Last Volume Bytes: 123,457,485,157
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
coredev-dir: Begin pruning Jobs.
coredev-dir: No Jobs found to prune.
coredev-dir: Begin pruning Files.
coredev-dir: No Files found to prune.
coredev-dir: End auto prune.
----------------------END OF BACULA
RESULT------------------------------------------------

As you can see there is a huge difference between afbackup and Bacula.=20
I did investigate and found that the bottle neck when Bacula was =
running is
the disk .=20
I collected data with iostat and saw that the disk on the bacula
director/Storage is busy at 80%.
I suspect something with sqlite not being 100% optimised.=20

I tried running the backup with the option Spool Attributes =3D yes but =
it did
not change the results much.=20

Would someone point me in wich direction I should look to solve this.=20

Thank you,

-------------------------------------------
Andr=E9 Larose
BCE Emergis
Tel :(514) 868-2200 x3934
Fax:(514) 868-2235

-----Original Message-----
From: Kern Sibbald [ mailto:ke...@si... <mailto:ke...@si...> =
]
Sent: Monday, March 08, 2004 10:41 AM
To: Larose, Andre
Cc: 'bac...@li... '
Subject: Re: [Bacula-users] performance question

Hello,

I suspect that you are comparing apples and oranges. For example, did
you:
- Use exactly the same machine
- Use exactly the same tape drive
- Use exactly the same tape
- Ensure that the tape was empty when starting
- Ensure that no other processes of importance were running
- Have all components of both products installed on the same system
- Ensure that both programs were either doing or not doing software
  compression.

I suspect not. At least the answer to one question is no -- "Ensure =
that
the tape was empty when starting".

Some day, I'll do performance management on Bacula, and probably =
improve
the speed a bit. In the mean time, everyone who has made *careful*
performance comparisons tells me that Bacula is as fast or faster than
the other products.

Perhaps on your machine that is not the case, in which case, we would
all be very happy if you could find a way to speed it up ...

Regards, Kern

On Fri, 2004-03-05 at 23:37, Larose, Andre wrote:
> Hi everybody,
>=20
> I just installed Bacula ( 1.32f-4 ) on Solaris 8 ( Netra t 1120 , =
2Gig
> Ram, 4 ethernet 100mb,Generic_108528-18 ) with a Quantum ATL sdlt320
> superloader . I compiled with gcc 3.3.2 and had no errors.
>
>=20
> I got mtx to work fine with Bacula and the ATL superloader.
>=20
> I use SQlite (2.8.4 ) for my database .
>=20
> I use the latest client 1.33.4 for my W2K servers.
>=20
>  I also use afbackup on a smaller Sun  machine with an old SUN =
dtl4700
> .
>=20
> The thing is I get better throughput from afbackup, 2 or 3 times more
> on Solaris. On the W2k side I have no client with afbackup so I would
> not be able to tell you.
>
> Is there a way to compile to get more performance ? Should I use
> another compiler? Are there settings that can speed up Bacula? Should
> I change database ?
>
> Maybe my device driver for my tape is not optimized.
>
> I tought I should ask the experts before doing anything.
>
>
> Here is a result of a full backup from Bacula and afbackup on a
> network client.
>
> BACULA
> coredev-dir: Start Backup JobId 96,
> Job=3Ddwsegsu1-Sol_root.2004-03-01_17.30.09
> coredev-dir: Bacula 1.32f-4 (24Jan04): 03-Mar-2004 00:00
> JobId:                  96
> Job:                    dwsegsu1-Sol_root.2004-03-01_17.30.09
> Backup Level:           Full
> Client:                 dwsegsu1-fd
> FileSet:                "Sol_root" 2004-02-26 18:33:32
> Start time:             02-Mar-2004 23:04
> End time:               03-Mar-2004 00:00
> FD Files Written:       68,882
> SD Files Written:       68,882
> FD Bytes Written:       2,078,812,501
> SD Bytes Written:       2,086,419,742
> Rate:                   620.5 KB/s
> Software Compression:   None
> Volume name(s):         Coredev-Volume-1
> Volume Session Id:      21
> Volume Session Time:    1078172594
> Last Volume Bytes:      111,454,771,525
> Non-fatal FD errors:    0
> SD Errors:              0
> FD termination status:  OK
> SD termination status:  OK
> Termination:            Backup OK
>
> coredev-dir: Begin pruning Jobs.
> coredev-dir: No Jobs found to prune.
> coredev-dir: Begin pruning Files.
> coredev-dir: No Files found to prune.
> coredev-dir: End auto prune.
>
>
> AFBACKUP
> Backup statistics:
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>
> Client Identifier:             dwsegsu1
>
> Exit Status:                   0
>
> Start-Time:                    Sun Feb 29 04:13:27 2004
> End-Time:                      Sun Feb 29 04:39:30 2004
>
> Backup Server:                 backuphost
> Backup Port:                   2988
> First Cartridge used:          11
> First Tapefile accessed:       390
> Last Cartridge used:           12
> Last Tapefile accessed:        8
> Used Cartridges:               11-12
>
> Stored filesystem entries:     69504
> Bytes written to media:        1104584688
> Sum of filesizes:              2082746597
> Sum of compressed filesizes:   778566752
> Sum of uncompressed filesizes: 320859325
> Total compression factor:      1.89
> Real compression factor:       2.26
> ------
>
> As you can see it took 55 min to backup 2Gb with Bacula and only =
25min
> for the same amount with afbackup.
>
> I must have done something WRONG along the way.
>
> Thank you in advance,
>
>
> Andr=E9 Larose
> BCE Emergis
> Tel :(514) 868-2200 x3934
> Fax:(514) 868-2235 <?xml:namespace prefix =3D o ns =3D
> "urn:schemas-microsoft-com:office:office" />
>
> The information contained herein, including any attachments, is
> proprietary and confidential and is intended for the exclusive use of
> the addressee. It also may contain privileged information and/or
> personal information subject to privacy legislation. The authorized
> addressee of this information, by its retention and use, agrees to
> protect the information contained herein from loss, disclosure, theft
> or compromise with at least the same care it employs to protect its
> own confidential information. Any dissemination or use of this
> information by a person other than the intended recipient is
> unauthorized and may be illegal. If you have received this e-mail in
> error, please notify us immediately by reply e-mail and destroy all
> copies.
>
> L'information contenue dans ce message, y compris les fichiers =
joints,
> est de nature exclusive et confidentielle, et ne doit =EAtre =
utilis=E9e
> que par le destinataire. Ce message peut contenir des renseignements
> r=E9serv=E9s, sujets aux dispositions des lois sur la =
confidentialit=E9. En
> conservant et en utilisant les renseignements contenus dans ce
> message, le destinataire autoris=E9 s'engage =E0 prot=E9ger =
l'information
> qu'il contient contre la perte, la divulgation, le vol ou =
l'exposition
> =E0 tout risque, en appliquant des pr=E9cautions au moins =E9gales =
=E0 celles
> qu'il utilise pour la protection de ses propres renseignements
> personnels. Toute diffusion ou utilisation de l'information contenue
> dans ce message par une personne autre que son destinataire explicite
> constitue un acte non autoris=E9 et potentiellement illicite. Si vous
> avez re=E7u ce message par erreur, veuillez en aviser BCE Emergis en
> r=E9pondant =E0 l'exp=E9diteur et d=E9truire toutes les copies du =
message en
> votre possession.
>
>=20
>
>=20
>
>=20