Mydumper - Vinoth kanna @ MySQL meetup Mumbai
Download as ODP, PDF9 likes2,414 views
This document summarizes information about logical database backups using mysqldump and mydumper. It discusses that logical backups create plain text files and can be done remotely, but are slower for large datasets. Mydumper is generally faster than mysqldump since it is multithreaded and uses less locking. The document provides examples of using mydumper for full and partial database backups and restores, and discusses backup locks and tips for testing and documenting the backup process. It also introduces the Percona Backup Service for managed database backups.
Mydumper - Vinoth kanna @ MySQL meetup Mumbai
- 1. Backup - Mydumper Vinoth Kanna RS Remote DBA 2014-07-13
- 2. www.percona.com Agenda ● Logical Backups ● Backups Locks ● Examples ● Tips
- 3. www.percona.com Logical Backups ● Logical ● Plain text files ● Can be Remote ● Slower on large data-sets ● Sometimes the only option
- 4. www.percona.com Logical Backups ● Tools ● mysqldump ● Mydumper
- 5. www.percona.com Logical Backups ● mysqldump ● General use ● Simple to use ● By default lock tables ● One big output file ● Can be piped to mysql client
- 6. www.percona.com Logical Backups ● mysqldump ● --opt = --add-drop-table --add-locks --create-options --quick --extended-insert --lock-tables --set-charset --disable-keys (default) ● --single-transaction (innodb) ● --master-data (FTWRL) for binlog coordinates ● --dump-slave ● --innodb-optimize-keys (PS only feature) ● --triggers (ON) --routines (OFF)
- 7. www.percona.com Logical Backups ● Mydumper ● Faster logical backups as is multithread ● Almost no locking with innodb tables ● Compress on the fly ● Doesn't handle Views, Triggers and Procedures ● Separate files per table, one row per line
- 8. www.percona.com Logical Backups ● Mydumper ● --threads ● --outputdir ● --rows, --chunk-filesize ● --compress ● --less-locking ● --kill-long-queries ● --use-savepoints
- 9. www.percona.com Logical Backups ● Without chunks Thread 1 Thread 2 Thread 3 Thread 4 0 10 20 30 40 50 60 Table D Table C Table B Table A Time
- 10. www.percona.com Logical Backups ● With chunks (--rows) Thread 1 Thread 2 Thread 3 Thread 4 0 5 10 15 20 25 Table D Table C Table B Table A Time
- 11. www.percona.com Logical Backups ● Mydumper output files ● metadata Started dump at: 2014-04-18 22:01:30 SHOW MASTER STATUS: Log: mysql-bin.017436 Pos: 890402821 SHOW SLAVE STATUS: Host: 192.168.56.101 Log: mysql-bin.017057 Pos: 968001054 Finished dump at: 2014-04-19 03:10:05
- 12. www.percona.com Logical Backups ● Mydumper output files ● database.table.sql /*!40101 SET NAMES binary*/; /*!40014 SET FOREIGN_KEY_CHECKS=0*/; /*!40103 SET TIME_ZONE='+00:00' */; INSERT INTO `t1` VALUES (1,"abc"), (2,"def"), (4,"abc"), (5,"abc"), (6,"abc"), (7,"abc"), (8,"abc");
- 13. Backup Locks
- 14. www.percona.com Backup Locks ● LOCK TABLE ... READ LOCAL ● Other sessions can read the table but can't write ● LOCAL allows non conflicting INSERTs to MyISAM ● FLUSH TABLES WITH READ LOCK ● Global read lock ● Big issue on busy servers and long running selects ● Requires tables be reopened which can be another bottleneck on busy servers ● metadata locking since 5.5 ● No DDLs to tables used in a transaction
- 15. www.percona.com Backup Locks ● mysqldump ● --lock-tables (default) – LOCK TABLES READ LOCAL ● --lock-all-tables --master-data and --dump-slave – FLUSH TABLES WITH READ LOCK ● --single-transaction (innodb only) – START TRANSACTION /*!40100 WITH CONSISTENT SNAPSHOT */ ● --skip-lock-tables – No locks
- 16. www.percona.com Backup Locks ● Mydumper ● Always needs FTWRL to coordinate threads but for a small time if all tables are innodb ● --less-locking – LOCK TABLES READ LOCAL for non-innodb – CONSISTENT SNAPSHOT for innodb ● --use-savepoints – Reduce metadata locking issues ● --no-locks – Not ensure a consistent backup
- 17. www.percona.com Backup Locks ● Percona Server 5.6 new locks for backups ● Percona XtraBackup 2.2 ● Mysqldump --lock-for-backup --single-transaction ● Mydumper 0.6.2 ● LOCK TABLES FOR BACKUP ● Block updates to non-transactional tables ● Block DDL to all tables
- 18. Examples
- 19. www.percona.com Using Mydumper ● Full Backup: ● pre mydumper mysqldump -h x.x.x.x -P -d –single-transaction -R –skip-triggers --ignore-create- error ● mydumper -h x.x.x.x -–less-locking –-compress -o /backup/dir post_mydumper ● mysqldump -h x.x.x.x -P xxxx -d –single-transaction -t --ignore-create-error ● Full Restore: myloader -h x.x.x.x -d /backup/dir -o
- 20. www.percona.com Using Mydumper ● Partial Restore: cd /backup/dir mkdir restore cp -l db.* ./restore/ cp -l metadata ./restore/ myloader -h x.x.x.x -d /backup/dir/restore/ -o
- 21. Tips
- 22. www.percona.com Tips ● Use the three types of backups ● Binary for full restores, new slaves ● Logical for partial restores ● Binlog for point in time recovery ● Store on more than one server and off-site ● Test your backups!!!! ● Document restore procedures, script them and test them!!!
- 24. www.percona.com Percona Backup Service ● Managed MySQL backup and recovery combining our best practices and software tools with your backup servers ● Percona ensures your backups run smoothly and reliably ● Backup data sets are always available ● Percona manages production recovery ● Lower TCO than managing in-house ● Any combination of MySQL server and backup locations ● Flexible backup configurations per customer ● More information at www.percona.com