automysqlbackup-users — Users discussion and support.

[Automysqlbackup-users] specifying arbitrary mysqldump parameters

[Shawn H. <sou...@el...>]

I've got an Ubuntu 22 server with mysql from the official mysql apt 
repository.

I had automysqlbackup installed from the ubuntu repositories, now I have 
a version from source control.  I can't remember whether it was 
sourceforge or one of the many github forks that I started with.

I have migrated my mysql install to InnoDB Cluster, which makes 
automyslqbackup spit out this warning a bunch of times:

Warning: A partial dump from a server that has GTIDs will by default 
include the GTIDs of all transactions, even those that changed 
suppressed parts of the database. If you don't want to restore GTIDs, 
pass --set-gtid-purged=OFF. To make a complete dump, pass 
--all-databases --triggers --routines --events.

I looked through the automysqlbackup code for some way in 
automysqlbackup.conf to pass arbitrary parameters to mysqldump, but 
there doesn't appear to be a mechanism for that.

I have added these lines to the end of the parse_configuration function, 
which got rid of the warnings.

     opt=( "${opt[@]}" "--set-gtid-purged=OFF" )
     opt_fullschema=( "${opt_fullschema[@]}" "--set-gtid-purged=OFF" )

I really hate to manually edit the script, though.  If I upgrade it, my 
manual edits are gone.

I looked over the sourceforge project for a little while and couldn't 
see any way to submit a code suggestion or pull request.  Am I just 
blind?  How would I do that?

Thanks,
Shawn

[Automysqlbackup-users] automysqlbackup from a remote server

[Ian D. <ian...@d4...>]

I am clearly missing something ...



mysql db host "A" - centos 7 - runs mysqld

server "B" - centos 7 - does not run mysqld



I wish to run automysqlbackup on server B to extract mysql dumps from server A.



I have my automysqlbackup.conf on B containing the line

CONFIG_mysql_dump_host='A"

and with correct grants set, server name resolves etc etc etc.



I can run mysqldump on B to dump from A (using -hA) no problems.



But when I try and run automysqlbackup on B the log shows



Parsed config file "/etc/automysqlbackup/automysqlbackup.conf"



# Checking for permissions to write to folders:

base folder /opt/mysql/backup ... exists ... ok.

backup folder /opt/mysql/backup/automysqlbackup ... exists ... writable? yes. Proceeding.

checking directory "/opt/mysql/backup/automysqlbackup/daily" ... exists.

checking directory "/opt/mysql/backup/automysqlbackup/weekly" ... exists.

checking directory "/opt/mysql/backup/automysqlbackup/monthly" ... exists.

checking directory "/opt/mysql/backup/automysqlbackup/latest" ... exists.

checking directory "/opt/mysql/backup/automysqlbackup/tmp" ... exists.



# Testing for installed programs

mysql ... found.

mysqldump ... found.

gzip ... found.



# Parsing databases ... Note: Parsed config file /etc/automysqlbackup/automysqlbackup.conf.

Error: The mysql server is empty, i.e. no databases found. Check if something is wrong. Exiting.



###### WARNING ######

Errors reported during AutoMySQLBackup execution.. Backup failed

Error log below..

mysql: [Warning] Using a password on the command line interface can be insecure.

ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (111)



mysqld doesn't run on B of course - but as I'm requesting a dump from a remote server it wouldn't need (?) a local mysqld service running



Or have I (likely!) totally misunderstood the usage of "CONFIG_mysql_dump_host='A"". can this even be done eg run automysqlbackup on B to dump schemas residing on A onto B'?



cheers



didds



Disclaimer: This message is intended for the addressee only. It may contain information of a confidential or legally privileged nature. If you have received this message in error please notify the sender and destroy the message immediately. All attachments have been scanned for viruses. However D4t4 Solutions Plc cannot accept liability for any loss or damage you may incur as a result of virus infection.

[Automysqlbackup-users] Undefined Variable?

[Tom <to...@co...>]

In the output below, the "Rotating 4 month backups for" line in both the
"Dump full schema." and "Dump status." sections is blank because the $(mdb)
variable is undefined.
That variable is on lines  1752, 1770, 1787, 1816, 1834 and 1851.
That's too many lines to just be typo.
How can I fix this? Any help would be appreciated. 

checking directory "/backups/mysql/daily" ... exists.
checking directory "/backups/mysql/weekly" ... exists.
checking directory "/backups/mysql/monthly" ... exists.
checking directory "/backups/mysql/latest" ... exists.
checking directory "/backups/mysql/tmp" ... exists.
checking directory "/backups/mysql/fullschema" ... exists.
checking directory "/backups/mysql/status" ... exists.

# Testing for installed programs
pigz ... found.
mysql ... found.
mysqldump ... found.
mail ... found.

# Parsing databases ... done.
======================================================================
AutoMySQLBackup version 3.0
http://sourceforge.net/projects/automysqlbackup/

Backup of Database Server - kahuna
Databases - ancestry,books,mysql,piwigo
Databases (monthly) - ancestry,books,mysql,piwigo
======================================================================
======================================================================
Dump full schema.

Rotating 4 month backups for 

======================================================================

======================================================================
Dump status.

Rotating 4 month backups for 

======================================================================

Backup Start Time Mon Jan  9 12:02:34 EST 2017
======================================================================
Daily Backup ...

Daily Backup of Database ( ancestry )
Rotating 6 day backups for ancestry
----------------------------------------------------------------------
Daily Backup of Database ( books )
Rotating 6 day backups for books
----------------------------------------------------------------------
Daily Backup of Database ( mysql )
Rotating 6 day backups for mysql
----------------------------------------------------------------------
Daily Backup of Database ( piwigo )
Rotating 6 day backups for piwigo
----------------------------------------------------------------------

Backup End Time Mon Jan  9 12:02:34 EST 2017
======================================================================
Total disk space used for backup storage...
Size - Location
4.2M /backups/mysql

======================================================================

[Automysqlbackup-users] Old backups not rotating.

[Jeroen de N. <jer...@gm...>]

Hello,

In the automysqlbackup configuration file I set a parameter to this:
CONFIG_rotation_daily=6
Daily backups older than 6 days aren't getting deleted when automysqlbackup
runs.

Is there something I forgot?

Kind regards,

Jeroen

[Automysqlbackup-users] help with error automysqlbackup.sh: line 1058: /dev/fd/62: No such file or directory

[Sol <sol...@gm...>]

Hi guys

If you have time could you please help me with this error ;

ERRORS REPORTED: MySQL Backup error - automysqlbackup.sh: line 1058:
/dev/fd/62: No such file or directory


https://sourceforge.net/p/automysqlbackup/discussion/350022/thread/57bfe7e6/?limit=50#2ab7

Thanks in advance.

Solace

Re: [Automysqlbackup-users] diff 2.5 to 3.0 rc2

[Marko W. | 8. <we...@zb...>]

hi alejandro,

the mailing is not the part of automysqlbackup. you have to do this on 
your system
with the MTA you use.

if you use "nullmailer" on your system, you can configure "from who" the 
mail is send.

if you postfix (i prefer), you can configure more things.

in all cases, automysqlbackup is hand out the message to the MTA of the 
system.
its then part of the MTA to sign all correct.

did this help you?

try "postfix" or "nullmailer" or "ssmtp" or any other....

+from cloudy rainy germany

marko





Am , schrieb Alejandro G Sánchez Martínez:
> I have a lot of time using version 2.5 and it seems cleaner than
> today. You need both the backups directory? tmp and all those in the
> 2.5 not created
> 
> In version 3.0 rc 2 have the problem that sends the mail header
> localhost not the server name as well in the 2.5 one could change that
> since arriving from multiple servers do not know which is which until
> you open the mail ..
> 
> --
> -------------------------------------------------------------
> www.e-compugraf.com [1]
> 
> 55514072 México DF
> --------------------------------------------------------------
> 
> 
> 
> Links:
> ------
> [1] http://www.e-compugraf.com
> 
> ------------------------------------------------------------------------------
> Managing the Performance of Cloud-Based Applications
> Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
> Read the Whitepaper.
> http://pubads.g.doubleclick.net/gampad/clk?id=121054471&iu=/4140/ostg.clktrk
> 
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users

[Automysqlbackup-users] diff 2.5 to 3.0 rc2

[Alejandro G S. M. <lu...@gm...>]

I have a lot of time using version 2.5 and it seems cleaner than today. You
need both the backups directory? tmp and all those in the 2.5 not created

In version 3.0 rc 2 have the problem that sends the mail header localhost not
the server name as well in the 2.5 one could change that since arriving from
multiple servers do not know which is which until you open the mail ..

-- 
-------------------------------------------------------------
www.e-compugraf.com

55514072 México DF
--------------------------------------------------------------

[Automysqlbackup-users] (no subject)

[Casper S. <ca...@ca...>]

[Automysqlbackup-users] Incorrect "du" command for RHEL6

[Jonathan B. <jb...@ba...>]

I'm using automysqlbackup on Redhat 6 and CentOS 6 systems.

the script returns the following warning.  It still works, but should be 
fixed:

du: WARNING: use --si, not -H; the meaning of the -H option will soon
change to be the same as that of --dereference-args (-D)


This is at line: 1972
Changing it to the following fixes the problem:

      echo `du -hs --si "${CONFIG_backup_dir}"`

Also, on another note, since this script should only be run by root, I 
think it should go into /usr/local/sbin rather than /usr/local/bin.


Overall, a great program.  Thanks


JBB

[Automysqlbackup-users] AUTO_INCREMENT values not dumped

[Stefan K. <s.k...@dr...>]

Hi,

does anybody know how to set up automysqlbackup with the option to keep 
the AUTO_INCREMENT information.

using mysqldump it's done my leaving out the --compatoble flag, but I 
can't find it in the automysqlbackup script or configuration file...

help would be great!

  Stefan

[Automysqlbackup-users] wierd compression issue

[skull <sk...@gm...>]

Hello folks

I've noticed that on some servers the compressed backup is bigger than it 
would be uncompressed:

Heres what the notification mail says:

.
Daily Backup of Database ( zarafa )

Rotating last weeks Backup...

Backup Information for 
/inetpub/data/mysqldumps//daily/zarafa/zarafa_2012-01-11_01h05m.Wednesday.sql
         compressed        uncompressed  ratio uncompressed_name
         1165055188           118841025 -880.3% 
/inetpub/data/mysqldumps//daily/zarafa/zarafa_2012-01-11_01h05m.Wednesday.sql
.

I am running the backup with the following OPT line:

OPT="--quote-names --single-transaction"

I am using this OPT String on all my servers and only 2 of them have the 
issue i mentioned above.





---
CalandaComp GmbH
Bahnhofstrasse 1
CH-7302 Landquart

Fon: +41 - 81 330 85 25
Fax: +41 - 81 330 85 35
http://www.calandacomp.ch 

Re: [Automysqlbackup-users] Backup times

[JoeSox <jo...@gm...>]

Thanks, I'll try that and see how it works tonight.
--
Thanks, Joe



On Tue, Nov 15, 2011 at 9:11 AM, Wipe_Out
<wip...@us...> wrote:
> On 15 November 2011 16:58, JoeSox <jo...@gm...> wrote:
>>
>> Hi,
>> I am using Ubuntu 10.04 and Automysqlbackup 2.5
>>
>> Probably a noob question but,
>> How do I change the time of my Daily backups?
>>
>> It is running too early in the morning.
>> I have also placed a job in Scheduled tasks but I am not sure that works
>>
> If you are running it in cron.daily its pretty much set..
> Easiest fix is to pull the script out of cron.daily and put it onto your
> home directory then create a cron job to run at the time you want..
> ------------------------------------------------------------------------------
> RSA(R) Conference 2012
> Save $700 by Nov 18
> Register now
> http://p.sf.net/sfu/rsa-sfdev2dev1
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>
>

Re: [Automysqlbackup-users] Backup times

[Wipe_Out <wip...@us...>]

On 15 November 2011 16:58, JoeSox <jo...@gm...> wrote:

> Hi,
> I am using Ubuntu 10.04 and Automysqlbackup 2.5
>
> Probably a noob question but,
> How do I change the time of my Daily backups?
>
> It is running too early in the morning.
> I have also placed a job in Scheduled tasks but I am not sure that works
>
> If you are running it in cron.daily its pretty much set..

Easiest fix is to pull the script out of cron.daily and put it onto your
home directory then create a cron job to run at the time you want..

[Automysqlbackup-users] Backup times

[JoeSox <jo...@gm...>]

Hi,
I am using Ubuntu 10.04 and Automysqlbackup 2.5

Probably a noob question but,
How do I change the time of my Daily backups?

It is running too early in the morning.
I have also placed a job in Scheduled tasks but I am not sure that works

--
Thanks, Joe

[Automysqlbackup-users] Automysqlbackup 3.0 Beta2 is out.

[Wipe_Out <wip...@us...>]

Just a couple of bug fixes..

Give it a try and submit and bug reports through sourceforge..

Re: [Automysqlbackup-users] AutoMySQLBackup 3.0 Beta1 is out!!

[Wipe_Out <wip...@us...>]

On 25 August 2011 17:30, Mark Grennan <ma...@gr...> wrote:

> I've been working with 3 Beta for a week now and I'm really liking it.
>
> The code is much cleaner. I've only found one small bug.
>
> I like the Pre and Post backup scripts. After backup I copy my backup files
> to either another file system or to a off site computer.  This is why I
> hacked in an encryption system I see you have added. (nice) I use the Post
> script to do the copying now.
>
>
Hi Mark,

Glad you like the new version..

So whats the bug?

Re: [Automysqlbackup-users] AutoMySQLBackup 3.0 Beta1 is out!!

[Mark G. <ma...@gr...>]

I've been working with 3 Beta for a week now and I'm really liking it.

The code is much cleaner. I've only found one small bug.

I like the Pre and Post backup scripts. After backup I copy my backup files to either another file system or to a off site computer.  This is why I hacked in an encryption system I see you have added. (nice) I use the Post script to do the copying now.


----- Original Message -----
From: "Wipe_Out" <wip...@us...>
To: aut...@li...
Sent: Friday, August 19, 2011 11:00:31 AM
Subject: [Automysqlbackup-users] AutoMySQLBackup 3.0 Beta1 is out!!


Hi All, 


Though lots of hard work and testing, mostly my PittaGurneyi, we are happy to announce the release of ver 3.0 Beta1.. 


Please test it out and give us any feedback.. 
------------------------------------------------------------------------------
Get a FREE DOWNLOAD! and learn more about uberSVN rich system, 
user administration capabilities and model configuration. Take 
the hassle out of deploying and managing Subversion and the 
tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
_______________________________________________
Automysqlbackup-users mailing list
Aut...@li...
https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users

[Automysqlbackup-users] AutoMySQLBackup 3.0 Beta1 is out!!

[Wipe_Out <wip...@us...>]

Hi All,

Though lots of hard work and testing, mostly my PittaGurneyi, we are happy
to announce the release of ver 3.0 Beta1..

Please test it out and give us any feedback..

Re: [Automysqlbackup-users] Mysqlbackup fails an brings the server down

[Wipe_Out <wip...@us...>]

Try the "nice" command to change the priority when you start the script..
Although I'm not sure this will solve it, its worth a try..

On 8 June 2011 07:31, Ward Loockx <wa...@lo...> wrote:

> I added the max-allowed-packet line, but looks like it fails again (not
> sure,because I didn't receive the log mail yet). My server blocks because it
> has a load of 13,94 during the backup. Is there a way to do the backup in
> low-priority to minimize the load?
>
> 2011/6/6 Wipe_Out <wip...@us...>
>
>> Try adding something like --max_allowed_packet=100M to the OPT= line in
>> the backup script and see if that helps things along..
>>
>> Also is there anything being reported in the logs?
>>
>>
>>
>> On 6 June 2011 10:41, Ward Loockx <wa...@lo...> wrote:
>>
>>> It contains VARCHARS, INT, timestamp, DATETIME.
>>>
>>> This is the size info about the table
>>> Data 815,0 MB  Index 226,0 MB  Total 1,041,0 MB
>>> The individual size of a row = 815.000Kb / 777263 records = 1.05kb /
>>> record
>>>
>>>
>>> 2011/6/6 Wipe_Out <wip...@us...>
>>>
>>>> What data is in the table thats failing?
>>>> --Just alphanumeric text fields?
>>>> --or something else?
>>>>
>>>> How big is the table? (MB)
>>>> How big are the individual rows of data?
>>>>
>>>>
>>>>
>>>> On 6 June 2011 07:32, Ward Loockx <wa...@lo...> wrote:
>>>>
>>>>> I see that mysqlhotcopy is only available for myIsam and currently we
>>>>> use innoDB tables..
>>>>>
>>>>> Do you have another solution?
>>>>>
>>>>>
>>>>> 2011/6/2 Ward Loockx <wa...@lo...>
>>>>>
>>>>>> Hello,
>>>>>>
>>>>>> Thanks for the reply. I have control over the mysql settings. I'll
>>>>>> also take a look at mysqlhotcopy.
>>>>>>
>>>>>>
>>>>>> 2011/6/2 Wipe_Out <wip...@us...>
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> It could be an issue with the server running out of memory while
>>>>>>> dumping that large table.. The --opt switch is used which should disable
>>>>>>> memory buffering when its dumping the database but perhaps its something
>>>>>>> else.. It could also be that the table is being locked for a long time which
>>>>>>> is causing a problem for your website..
>>>>>>>
>>>>>>> Are you able to change the MySQL server settings? eg buffers etc..
>>>>>>>
>>>>>>> An alternative would be to not use the script to backup that database
>>>>>>> and instead use the mysqlhotcopy command which may work better for a larger
>>>>>>> database thats always active..
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Does seem strange because
>>>>>>>
>>>>>>> On 2 June 2011 08:44, Ward Loockx <wa...@lo...> wrote:
>>>>>>>
>>>>>>>> Hello,
>>>>>>>>
>>>>>>>> I currently use automysqlbackup to backup 10databases. There is one
>>>>>>>> big database that contains a table with +- 780.000records. When mysqlbackup
>>>>>>>> executes it fails (on that table) and brings my websites down (maybe the
>>>>>>>> load is so high that apache processes can't answer in time). Looks like
>>>>>>>> there are a lot of query's executed at the moment of backup and maybe the
>>>>>>>> query's are locking each other.
>>>>>>>>
>>>>>>>> I also get the following by email:
>>>>>>>>
>>>>>>>> mysqldump: Error 2013: Lost connection to MySQL server during query
>>>>>>>> when dumping table `video` at row: 745740
>>>>>>>>
>>>>>>>> I think this are 2seperate problems:
>>>>>>>>
>>>>>>>>    - Mysql backup script failing
>>>>>>>>    - Website's are down (because the use of too many resources?)
>>>>>>>>
>>>>>>>>
>>>>>>>> Do you guys have any ideas how to fix this? Can you let the script
>>>>>>>> run in low priority mode, so that it doesn't eat the resources and does not
>>>>>>>> lock any tables ?
>>>>>>>>
>>>>>>>> Thanks!
>>>>>>>> Ward
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>> Simplify data backup and recovery for your virtual environment with
>>>>>>>> vRanger.
>>>>>>>> Installation's a snap, and flexible recovery options mean your data
>>>>>>>> is safe,
>>>>>>>> secure and there when you need it. Data protection magic?
>>>>>>>> Nope - It's vRanger. Get your free trial download today.
>>>>>>>> http://p.sf.net/sfu/quest-sfdev2dev
>>>>>>>> _______________________________________________
>>>>>>>> Automysqlbackup-users mailing list
>>>>>>>> Aut...@li...
>>>>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> Simplify data backup and recovery for your virtual environment with
>>>>>>> vRanger.
>>>>>>> Installation's a snap, and flexible recovery options mean your data
>>>>>>> is safe,
>>>>>>> secure and there when you need it. Discover what all the cheering's
>>>>>>> about.
>>>>>>>
>>>>>>> Get your free trial download today.
>>>>>>> http://p.sf.net/sfu/quest-dev2dev2
>>>>>>> _______________________________________________
>>>>>>> Automysqlbackup-users mailing list
>>>>>>> Aut...@li...
>>>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> Simplify data backup and recovery for your virtual environment with
>>>>> vRanger.
>>>>> Installation's a snap, and flexible recovery options mean your data is
>>>>> safe,
>>>>> secure and there when you need it. Discover what all the cheering's
>>>>> about.
>>>>> Get your free trial download today.
>>>>> http://p.sf.net/sfu/quest-dev2dev2
>>>>> _______________________________________________
>>>>> Automysqlbackup-users mailing list
>>>>> Aut...@li...
>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>
>>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Simplify data backup and recovery for your virtual environment with
>>>> vRanger.
>>>> Installation's a snap, and flexible recovery options mean your data is
>>>> safe,
>>>> secure and there when you need it. Discover what all the cheering's
>>>> about.
>>>> Get your free trial download today.
>>>> http://p.sf.net/sfu/quest-dev2dev2
>>>> _______________________________________________
>>>> Automysqlbackup-users mailing list
>>>> Aut...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>
>>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Simplify data backup and recovery for your virtual environment with
>>> vRanger.
>>> Installation's a snap, and flexible recovery options mean your data is
>>> safe,
>>> secure and there when you need it. Discover what all the cheering's
>>> about.
>>> Get your free trial download today.
>>> http://p.sf.net/sfu/quest-dev2dev2
>>> _______________________________________________
>>> Automysqlbackup-users mailing list
>>> Aut...@li...
>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Simplify data backup and recovery for your virtual environment with
>> vRanger.
>> Installation's a snap, and flexible recovery options mean your data is
>> safe,
>> secure and there when you need it. Discover what all the cheering's about.
>> Get your free trial download today.
>> http://p.sf.net/sfu/quest-dev2dev2
>> _______________________________________________
>> Automysqlbackup-users mailing list
>> Aut...@li...
>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>
>>
>
>
> ------------------------------------------------------------------------------
> EditLive Enterprise is the world's most technically advanced content
> authoring tool. Experience the power of Track Changes, Inline Image
> Editing and ensure content is compliant with Accessibility Checking.
> http://p.sf.net/sfu/ephox-dev2dev
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>
>

Re: [Automysqlbackup-users] Mysqlbackup fails an brings the server down

[Ward L. <wa...@lo...>]

I added the max-allowed-packet line, but looks like it fails again (not
sure,because I didn't receive the log mail yet). My server blocks because it
has a load of 13,94 during the backup. Is there a way to do the backup in
low-priority to minimize the load?

2011/6/6 Wipe_Out <wip...@us...>

> Try adding something like --max_allowed_packet=100M to the OPT= line in
> the backup script and see if that helps things along..
>
> Also is there anything being reported in the logs?
>
>
>
> On 6 June 2011 10:41, Ward Loockx <wa...@lo...> wrote:
>
>> It contains VARCHARS, INT, timestamp, DATETIME.
>>
>> This is the size info about the table
>> Data 815,0 MB  Index 226,0 MB  Total 1,041,0 MB
>> The individual size of a row = 815.000Kb / 777263 records = 1.05kb /
>> record
>>
>>
>> 2011/6/6 Wipe_Out <wip...@us...>
>>
>>> What data is in the table thats failing?
>>> --Just alphanumeric text fields?
>>> --or something else?
>>>
>>> How big is the table? (MB)
>>> How big are the individual rows of data?
>>>
>>>
>>>
>>> On 6 June 2011 07:32, Ward Loockx <wa...@lo...> wrote:
>>>
>>>> I see that mysqlhotcopy is only available for myIsam and currently we
>>>> use innoDB tables..
>>>>
>>>> Do you have another solution?
>>>>
>>>>
>>>> 2011/6/2 Ward Loockx <wa...@lo...>
>>>>
>>>>> Hello,
>>>>>
>>>>> Thanks for the reply. I have control over the mysql settings. I'll also
>>>>> take a look at mysqlhotcopy.
>>>>>
>>>>>
>>>>> 2011/6/2 Wipe_Out <wip...@us...>
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> It could be an issue with the server running out of memory while
>>>>>> dumping that large table.. The --opt switch is used which should disable
>>>>>> memory buffering when its dumping the database but perhaps its something
>>>>>> else.. It could also be that the table is being locked for a long time which
>>>>>> is causing a problem for your website..
>>>>>>
>>>>>> Are you able to change the MySQL server settings? eg buffers etc..
>>>>>>
>>>>>> An alternative would be to not use the script to backup that database
>>>>>> and instead use the mysqlhotcopy command which may work better for a larger
>>>>>> database thats always active..
>>>>>>
>>>>>>
>>>>>>
>>>>>> Does seem strange because
>>>>>>
>>>>>> On 2 June 2011 08:44, Ward Loockx <wa...@lo...> wrote:
>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> I currently use automysqlbackup to backup 10databases. There is one
>>>>>>> big database that contains a table with +- 780.000records. When mysqlbackup
>>>>>>> executes it fails (on that table) and brings my websites down (maybe the
>>>>>>> load is so high that apache processes can't answer in time). Looks like
>>>>>>> there are a lot of query's executed at the moment of backup and maybe the
>>>>>>> query's are locking each other.
>>>>>>>
>>>>>>> I also get the following by email:
>>>>>>>
>>>>>>> mysqldump: Error 2013: Lost connection to MySQL server during query
>>>>>>> when dumping table `video` at row: 745740
>>>>>>>
>>>>>>> I think this are 2seperate problems:
>>>>>>>
>>>>>>>    - Mysql backup script failing
>>>>>>>    - Website's are down (because the use of too many resources?)
>>>>>>>
>>>>>>>
>>>>>>> Do you guys have any ideas how to fix this? Can you let the script
>>>>>>> run in low priority mode, so that it doesn't eat the resources and does not
>>>>>>> lock any tables ?
>>>>>>>
>>>>>>> Thanks!
>>>>>>> Ward
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> Simplify data backup and recovery for your virtual environment with
>>>>>>> vRanger.
>>>>>>> Installation's a snap, and flexible recovery options mean your data
>>>>>>> is safe,
>>>>>>> secure and there when you need it. Data protection magic?
>>>>>>> Nope - It's vRanger. Get your free trial download today.
>>>>>>> http://p.sf.net/sfu/quest-sfdev2dev
>>>>>>> _______________________________________________
>>>>>>> Automysqlbackup-users mailing list
>>>>>>> Aut...@li...
>>>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> Simplify data backup and recovery for your virtual environment with
>>>>>> vRanger.
>>>>>> Installation's a snap, and flexible recovery options mean your data is
>>>>>> safe,
>>>>>> secure and there when you need it. Discover what all the cheering's
>>>>>> about.
>>>>>>
>>>>>> Get your free trial download today.
>>>>>> http://p.sf.net/sfu/quest-dev2dev2
>>>>>> _______________________________________________
>>>>>> Automysqlbackup-users mailing list
>>>>>> Aut...@li...
>>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Simplify data backup and recovery for your virtual environment with
>>>> vRanger.
>>>> Installation's a snap, and flexible recovery options mean your data is
>>>> safe,
>>>> secure and there when you need it. Discover what all the cheering's
>>>> about.
>>>> Get your free trial download today.
>>>> http://p.sf.net/sfu/quest-dev2dev2
>>>> _______________________________________________
>>>> Automysqlbackup-users mailing list
>>>> Aut...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>
>>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Simplify data backup and recovery for your virtual environment with
>>> vRanger.
>>> Installation's a snap, and flexible recovery options mean your data is
>>> safe,
>>> secure and there when you need it. Discover what all the cheering's
>>> about.
>>> Get your free trial download today.
>>> http://p.sf.net/sfu/quest-dev2dev2
>>> _______________________________________________
>>> Automysqlbackup-users mailing list
>>> Aut...@li...
>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Simplify data backup and recovery for your virtual environment with
>> vRanger.
>> Installation's a snap, and flexible recovery options mean your data is
>> safe,
>> secure and there when you need it. Discover what all the cheering's about.
>> Get your free trial download today.
>> http://p.sf.net/sfu/quest-dev2dev2
>> _______________________________________________
>> Automysqlbackup-users mailing list
>> Aut...@li...
>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>
>>
>
>
> ------------------------------------------------------------------------------
> Simplify data backup and recovery for your virtual environment with
> vRanger.
> Installation's a snap, and flexible recovery options mean your data is
> safe,
> secure and there when you need it. Discover what all the cheering's about.
> Get your free trial download today.
> http://p.sf.net/sfu/quest-dev2dev2
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>
>

Re: [Automysqlbackup-users] REMOVE

[Russell J. <rj...@eg...>]

That is not how you remove yourself from a mailing list. Please read the 
very bottom of the email for the removal URL.

On 6/6/2011 12:12 PM, Bill wrote:
>
> Please remove me from the mailing list.
>
> Regards,
>
> *Bill McDonald //*
>
>
> ------------------------------------------------------------------------------
> Simplify data backup and recovery for your virtual environment with vRanger.
> Installation's a snap, and flexible recovery options mean your data is safe,
> secure and there when you need it. Discover what all the cheering's about.
> Get your free trial download today.
> http://p.sf.net/sfu/quest-dev2dev2
>
>
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users

[Automysqlbackup-users] REMOVE

[Bill <bi...@fo...>]

Please remove me from the mailing list.

Regards,

Bill McDonald

Re: [Automysqlbackup-users] Mysqlbackup fails an brings the server down

[Wipe_Out <wip...@us...>]

Try adding something like --max_allowed_packet=100M to the OPT= line in the
backup script and see if that helps things along..

Also is there anything being reported in the logs?



On 6 June 2011 10:41, Ward Loockx <wa...@lo...> wrote:

> It contains VARCHARS, INT, timestamp, DATETIME.
>
> This is the size info about the table
> Data 815,0 MB  Index 226,0 MB  Total 1,041,0 MB
> The individual size of a row = 815.000Kb / 777263 records = 1.05kb / record
>
>
> 2011/6/6 Wipe_Out <wip...@us...>
>
>> What data is in the table thats failing?
>> --Just alphanumeric text fields?
>> --or something else?
>>
>> How big is the table? (MB)
>> How big are the individual rows of data?
>>
>>
>>
>> On 6 June 2011 07:32, Ward Loockx <wa...@lo...> wrote:
>>
>>> I see that mysqlhotcopy is only available for myIsam and currently we use
>>> innoDB tables..
>>>
>>> Do you have another solution?
>>>
>>>
>>> 2011/6/2 Ward Loockx <wa...@lo...>
>>>
>>>> Hello,
>>>>
>>>> Thanks for the reply. I have control over the mysql settings. I'll also
>>>> take a look at mysqlhotcopy.
>>>>
>>>>
>>>> 2011/6/2 Wipe_Out <wip...@us...>
>>>>
>>>>> Hi,
>>>>>
>>>>> It could be an issue with the server running out of memory while
>>>>> dumping that large table.. The --opt switch is used which should disable
>>>>> memory buffering when its dumping the database but perhaps its something
>>>>> else.. It could also be that the table is being locked for a long time which
>>>>> is causing a problem for your website..
>>>>>
>>>>> Are you able to change the MySQL server settings? eg buffers etc..
>>>>>
>>>>> An alternative would be to not use the script to backup that database
>>>>> and instead use the mysqlhotcopy command which may work better for a larger
>>>>> database thats always active..
>>>>>
>>>>>
>>>>>
>>>>> Does seem strange because
>>>>>
>>>>> On 2 June 2011 08:44, Ward Loockx <wa...@lo...> wrote:
>>>>>
>>>>>> Hello,
>>>>>>
>>>>>> I currently use automysqlbackup to backup 10databases. There is one
>>>>>> big database that contains a table with +- 780.000records. When mysqlbackup
>>>>>> executes it fails (on that table) and brings my websites down (maybe the
>>>>>> load is so high that apache processes can't answer in time). Looks like
>>>>>> there are a lot of query's executed at the moment of backup and maybe the
>>>>>> query's are locking each other.
>>>>>>
>>>>>> I also get the following by email:
>>>>>>
>>>>>> mysqldump: Error 2013: Lost connection to MySQL server during query
>>>>>> when dumping table `video` at row: 745740
>>>>>>
>>>>>> I think this are 2seperate problems:
>>>>>>
>>>>>>    - Mysql backup script failing
>>>>>>    - Website's are down (because the use of too many resources?)
>>>>>>
>>>>>>
>>>>>> Do you guys have any ideas how to fix this? Can you let the script run
>>>>>> in low priority mode, so that it doesn't eat the resources and does not lock
>>>>>> any tables ?
>>>>>>
>>>>>> Thanks!
>>>>>> Ward
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> Simplify data backup and recovery for your virtual environment with
>>>>>> vRanger.
>>>>>> Installation's a snap, and flexible recovery options mean your data is
>>>>>> safe,
>>>>>> secure and there when you need it. Data protection magic?
>>>>>> Nope - It's vRanger. Get your free trial download today.
>>>>>> http://p.sf.net/sfu/quest-sfdev2dev
>>>>>> _______________________________________________
>>>>>> Automysqlbackup-users mailing list
>>>>>> Aut...@li...
>>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> Simplify data backup and recovery for your virtual environment with
>>>>> vRanger.
>>>>> Installation's a snap, and flexible recovery options mean your data is
>>>>> safe,
>>>>> secure and there when you need it. Discover what all the cheering's
>>>>> about.
>>>>>
>>>>> Get your free trial download today.
>>>>> http://p.sf.net/sfu/quest-dev2dev2
>>>>> _______________________________________________
>>>>> Automysqlbackup-users mailing list
>>>>> Aut...@li...
>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>
>>>>>
>>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Simplify data backup and recovery for your virtual environment with
>>> vRanger.
>>> Installation's a snap, and flexible recovery options mean your data is
>>> safe,
>>> secure and there when you need it. Discover what all the cheering's
>>> about.
>>> Get your free trial download today.
>>> http://p.sf.net/sfu/quest-dev2dev2
>>> _______________________________________________
>>> Automysqlbackup-users mailing list
>>> Aut...@li...
>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Simplify data backup and recovery for your virtual environment with
>> vRanger.
>> Installation's a snap, and flexible recovery options mean your data is
>> safe,
>> secure and there when you need it. Discover what all the cheering's about.
>> Get your free trial download today.
>> http://p.sf.net/sfu/quest-dev2dev2
>> _______________________________________________
>> Automysqlbackup-users mailing list
>> Aut...@li...
>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>
>>
>
>
> ------------------------------------------------------------------------------
> Simplify data backup and recovery for your virtual environment with
> vRanger.
> Installation's a snap, and flexible recovery options mean your data is
> safe,
> secure and there when you need it. Discover what all the cheering's about.
> Get your free trial download today.
> http://p.sf.net/sfu/quest-dev2dev2
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>
>

Re: [Automysqlbackup-users] Mysqlbackup fails an brings the server down

[Ward L. <wa...@lo...>]

It contains VARCHARS, INT, timestamp, DATETIME.

This is the size info about the table
Data 815,0 MB  Index 226,0 MB  Total 1,041,0 MB
The individual size of a row = 815.000Kb / 777263 records = 1.05kb / record

2011/6/6 Wipe_Out <wip...@us...>

> What data is in the table thats failing?
> --Just alphanumeric text fields?
> --or something else?
>
> How big is the table? (MB)
> How big are the individual rows of data?
>
>
>
> On 6 June 2011 07:32, Ward Loockx <wa...@lo...> wrote:
>
>> I see that mysqlhotcopy is only available for myIsam and currently we use
>> innoDB tables..
>>
>> Do you have another solution?
>>
>>
>> 2011/6/2 Ward Loockx <wa...@lo...>
>>
>>> Hello,
>>>
>>> Thanks for the reply. I have control over the mysql settings. I'll also
>>> take a look at mysqlhotcopy.
>>>
>>>
>>> 2011/6/2 Wipe_Out <wip...@us...>
>>>
>>>> Hi,
>>>>
>>>> It could be an issue with the server running out of memory while dumping
>>>> that large table.. The --opt switch is used which should disable memory
>>>> buffering when its dumping the database but perhaps its something else.. It
>>>> could also be that the table is being locked for a long time which is
>>>> causing a problem for your website..
>>>>
>>>> Are you able to change the MySQL server settings? eg buffers etc..
>>>>
>>>> An alternative would be to not use the script to backup that database
>>>> and instead use the mysqlhotcopy command which may work better for a larger
>>>> database thats always active..
>>>>
>>>>
>>>>
>>>> Does seem strange because
>>>>
>>>> On 2 June 2011 08:44, Ward Loockx <wa...@lo...> wrote:
>>>>
>>>>> Hello,
>>>>>
>>>>> I currently use automysqlbackup to backup 10databases. There is one big
>>>>> database that contains a table with +- 780.000records. When mysqlbackup
>>>>> executes it fails (on that table) and brings my websites down (maybe the
>>>>> load is so high that apache processes can't answer in time). Looks like
>>>>> there are a lot of query's executed at the moment of backup and maybe the
>>>>> query's are locking each other.
>>>>>
>>>>> I also get the following by email:
>>>>>
>>>>> mysqldump: Error 2013: Lost connection to MySQL server during query
>>>>> when dumping table `video` at row: 745740
>>>>>
>>>>> I think this are 2seperate problems:
>>>>>
>>>>>    - Mysql backup script failing
>>>>>    - Website's are down (because the use of too many resources?)
>>>>>
>>>>>
>>>>> Do you guys have any ideas how to fix this? Can you let the script run
>>>>> in low priority mode, so that it doesn't eat the resources and does not lock
>>>>> any tables ?
>>>>>
>>>>> Thanks!
>>>>> Ward
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> Simplify data backup and recovery for your virtual environment with
>>>>> vRanger.
>>>>> Installation's a snap, and flexible recovery options mean your data is
>>>>> safe,
>>>>> secure and there when you need it. Data protection magic?
>>>>> Nope - It's vRanger. Get your free trial download today.
>>>>> http://p.sf.net/sfu/quest-sfdev2dev
>>>>> _______________________________________________
>>>>> Automysqlbackup-users mailing list
>>>>> Aut...@li...
>>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>>
>>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Simplify data backup and recovery for your virtual environment with
>>>> vRanger.
>>>> Installation's a snap, and flexible recovery options mean your data is
>>>> safe,
>>>> secure and there when you need it. Discover what all the cheering's
>>>> about.
>>>>
>>>> Get your free trial download today.
>>>> http://p.sf.net/sfu/quest-dev2dev2
>>>> _______________________________________________
>>>> Automysqlbackup-users mailing list
>>>> Aut...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>
>>>>
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Simplify data backup and recovery for your virtual environment with
>> vRanger.
>> Installation's a snap, and flexible recovery options mean your data is
>> safe,
>> secure and there when you need it. Discover what all the cheering's about.
>> Get your free trial download today.
>> http://p.sf.net/sfu/quest-dev2dev2
>> _______________________________________________
>> Automysqlbackup-users mailing list
>> Aut...@li...
>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>
>>
>
>
> ------------------------------------------------------------------------------
> Simplify data backup and recovery for your virtual environment with
> vRanger.
> Installation's a snap, and flexible recovery options mean your data is
> safe,
> secure and there when you need it. Discover what all the cheering's about.
> Get your free trial download today.
> http://p.sf.net/sfu/quest-dev2dev2
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>
>

Re: [Automysqlbackup-users] Mysqlbackup fails an brings the server down

[Wipe_Out <wip...@us...>]

What data is in the table thats failing?
--Just alphanumeric text fields?
--or something else?

How big is the table? (MB)
How big are the individual rows of data?



On 6 June 2011 07:32, Ward Loockx <wa...@lo...> wrote:

> I see that mysqlhotcopy is only available for myIsam and currently we use
> innoDB tables..
>
> Do you have another solution?
>
>
> 2011/6/2 Ward Loockx <wa...@lo...>
>
>> Hello,
>>
>> Thanks for the reply. I have control over the mysql settings. I'll also
>> take a look at mysqlhotcopy.
>>
>>
>> 2011/6/2 Wipe_Out <wip...@us...>
>>
>>> Hi,
>>>
>>> It could be an issue with the server running out of memory while dumping
>>> that large table.. The --opt switch is used which should disable memory
>>> buffering when its dumping the database but perhaps its something else.. It
>>> could also be that the table is being locked for a long time which is
>>> causing a problem for your website..
>>>
>>> Are you able to change the MySQL server settings? eg buffers etc..
>>>
>>> An alternative would be to not use the script to backup that database and
>>> instead use the mysqlhotcopy command which may work better for a larger
>>> database thats always active..
>>>
>>>
>>>
>>> Does seem strange because
>>>
>>> On 2 June 2011 08:44, Ward Loockx <wa...@lo...> wrote:
>>>
>>>> Hello,
>>>>
>>>> I currently use automysqlbackup to backup 10databases. There is one big
>>>> database that contains a table with +- 780.000records. When mysqlbackup
>>>> executes it fails (on that table) and brings my websites down (maybe the
>>>> load is so high that apache processes can't answer in time). Looks like
>>>> there are a lot of query's executed at the moment of backup and maybe the
>>>> query's are locking each other.
>>>>
>>>> I also get the following by email:
>>>>
>>>> mysqldump: Error 2013: Lost connection to MySQL server during query when
>>>> dumping table `video` at row: 745740
>>>>
>>>> I think this are 2seperate problems:
>>>>
>>>>    - Mysql backup script failing
>>>>    - Website's are down (because the use of too many resources?)
>>>>
>>>>
>>>> Do you guys have any ideas how to fix this? Can you let the script run
>>>> in low priority mode, so that it doesn't eat the resources and does not lock
>>>> any tables ?
>>>>
>>>> Thanks!
>>>> Ward
>>>>
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Simplify data backup and recovery for your virtual environment with
>>>> vRanger.
>>>> Installation's a snap, and flexible recovery options mean your data is
>>>> safe,
>>>> secure and there when you need it. Data protection magic?
>>>> Nope - It's vRanger. Get your free trial download today.
>>>> http://p.sf.net/sfu/quest-sfdev2dev
>>>> _______________________________________________
>>>> Automysqlbackup-users mailing list
>>>> Aut...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>>
>>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Simplify data backup and recovery for your virtual environment with
>>> vRanger.
>>> Installation's a snap, and flexible recovery options mean your data is
>>> safe,
>>> secure and there when you need it. Discover what all the cheering's
>>> about.
>>>
>>> Get your free trial download today.
>>> http://p.sf.net/sfu/quest-dev2dev2
>>> _______________________________________________
>>> Automysqlbackup-users mailing list
>>> Aut...@li...
>>> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>>>
>>>
>>
>
>
> ------------------------------------------------------------------------------
> Simplify data backup and recovery for your virtual environment with
> vRanger.
> Installation's a snap, and flexible recovery options mean your data is
> safe,
> secure and there when you need it. Discover what all the cheering's about.
> Get your free trial download today.
> http://p.sf.net/sfu/quest-dev2dev2
> _______________________________________________
> Automysqlbackup-users mailing list
> Aut...@li...
> https://lists.sourceforge.net/lists/listinfo/automysqlbackup-users
>
>