← Back to team overview

holland-discuss team mailing list archive

Re: mysqldump and --single-transaction

 

Thanks!

On Tue, Jan 25, 2011 at 9:01 AM, Brandon Metcalf <bwmetcalf@xxxxxxxxx> wrote:
> Running _faster_mysql51_metadata() in
> plugins/holland.lib.mysql/holland/lib/mysql/schema/base.py, as
> expected, shows a mixture of tables and therefore '1' in the
> is_transactional column for those that are InnoDB and '0' for those
> that are MyISAM.  I haven't followed the code any further at this
> point.
>
> It seems like the code might be seeing one transactional table and
> deciding to use --single-transaction based on this.
>
>
> On Tue, Jan 25, 2011 at 8:36 AM, Brandon Metcalf <bwmetcalf@xxxxxxxxx> wrote:
>> Below are /etc/holland/holland.conf,
>> /etc/holland/providers/mysqldump.conf, and
>> /etc/holland/backupsets/daily.conf.  First, I show the session where
>> --single-transaction is going to be used along with the count of
>> MyISAM tables in one of the DBs:
>>
>> root@foo:/etc/holland# mysql -e 'show table status' flow|grep -c MyISAM
>> 48
>> root@foo:/etc/holland# holland bk --dry-run daily
>> Holland 1.0.6 started with pid 15797
>> --- Starting dry run ---
>> Creating backup path /archive/dump/holland/daily/20110125_063352
>> Estimating size of mysqldump backup
>> Estimated Backup Size: 50.00GB
>> Starting backup[daily/20110125_063352] via plugin mysqldump
>> Running in dry-run mode.
>> Initiating connection to MySQL
>> Stopped slave
>> MySQL Replication has been stopped.
>> Using mysqldump executable:
>> /usr/local/mysql-5.1.37-linux-x86_64-glibc23/bin/mysqldump
>> mysqldump version 5.1.37
>> Using mysqldump option --flush-privileges
>> Using mysqldump option --max-allowed-packet=128M
>> Using mysqldump option --master-data=2
>> Using /bin/gzip compression level 5
>> Wrote backup manifest
>> /archive/dump/holland/daily/20110125_063352/backup_data/MANIFEST.txt
>> Executing: /usr/local/mysql-5.1.37-linux-x86_64-glibc23/bin/mysqldump
>> --defaults-file=/archive/dump/holland/daily/20110125_063352/my.cnf
>> --flush-privileges --max-allowed-packet=128M --master-data=2
>> --single-transaction bigflow
>> Executing: /usr/local/mysql-5.1.37-linux-x86_64-glibc23/bin/mysqldump
>> --defaults-file=/archive/dump/holland/daily/20110125_063352/my.cnf
>> --flush-privileges --max-allowed-packet=128M --master-data=2
>> --single-transaction flow
>> Executing: /usr/local/mysql-5.1.37-linux-x86_64-glibc23/bin/mysqldump
>> --defaults-file=/archive/dump/holland/daily/20110125_063352/my.cnf
>> --flush-privileges --max-allowed-packet=128M --master-data=2
>> --single-transaction mysql
>> Executing: /usr/local/mysql-5.1.37-linux-x86_64-glibc23/bin/mysqldump
>> --defaults-file=/archive/dump/holland/daily/20110125_063352/my.cnf
>> --flush-privileges --max-allowed-packet=128M --master-data=2
>> --single-transaction newflow
>> Restarted slave
>> Backup completed in 0.04 seconds
>> --- Ending dry run ---
>>
>> root@foo:/etc/holland# cat /etc/holland/holland.conf
>> [holland]
>> backup_directory=/archive/dump/holland
>>
>> [logging]
>> filename=/var/log/holland/holland.log
>> level=info
>> root@foo:/etc/holland# cat /etc/holland/providers/mysqldump.conf
>> [holland:backup]
>> plugin = mysqldump
>> backups-to-keep = 1
>> auto-purge-failures = yes
>> purge-policy = after-backup
>>
>> [mysqldump]
>> extra-defaults = no
>> mysql-binpath = /usr/local/mysql/bin
>>
>> lock-method = auto-detect
>>
>> databases = ,
>> exclude-databases = ,
>>
>> tables = *,
>> exclude-tables = ,
>>
>> engines = *,
>> exclude-engines = ,
>>
>> flush-logs = no
>> flush-privileges = yes
>> dump-routines = no
>> dump-events = no
>> stop-slave = yes
>> max-allowed-packet = 128M
>> bin-log-position = yes
>>
>> file-per-database = yes
>>
>> additional-options = ,
>>
>> estimate-method = plugin
>>
>> [compression]
>> method = gzip
>> inline = yes
>> level = 5
>>
>> [mysql:client]
>> defaults-extra-file = /usr/local/mysql/data/my.cnf,
>> # user = "" # no default
>> # password = "" # no default
>> # socket = "" # no default
>> # host = "" # no default
>> # port = "" # no default
>> root@foo:/etc/holland# cat /etc/holland/backupsets/daily.conf
>> [holland:backup]
>> plugin = mysqldump
>> backups-to-keep = 7
>>
>> [mysqldump]
>> databases = bigflow, flow, newflow, mysql
>> estimate-method = const:50G
>>
>> On Tue, Jan 25, 2011 at 8:21 AM, Andrew Garner <muzazzi@xxxxxxxxx> wrote:
>>> I haven't seen that behavior.  If you have an example mysql
>>> schema+holland config that can reproduce this I would be very
>>> interested to see it.
>>>
>>> ~Andy
>>>
>>> On Tue, Jan 25, 2011 at 8:11 AM, Brandon Metcalf <bwmetcalf@xxxxxxxxx> wrote:
>>>> I'm finding that using auto-detect with the mysqldump provider
>>>> --single-transaction is being used against a DB with MyISAM tables.
>>>> Anyone else seeing this?
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~holland-discuss
>>>> Post to     : holland-discuss@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~holland-discuss
>>>> More help   : https://help.launchpad.net/ListHelp
>>>>
>>>
>>
>



References