【MySQL】MySQL备份和恢复
一、为什么要备份数据
在生产环境中我们数据库可能会遭遇各种各样的不测从而导致数据丢失, 大概分为以下几种.
硬件故障
软件故障
自然灾害
黑客攻击
误操作 (占比最大)
所以, 为了在数据丢失之后能够恢复数据, 我们就需要定期的备份数据, 备份数据的策略要根据不同的应用场景进行定制, 大致有几个参考数值, 我们可以根据这些数值从而定制符合特定环境中的数据备份策略
能够容忍丢失多少数据
恢复数据需要多长时间
需要恢复哪一些数据
二、数据的备份类型
数据的备份类型根据其自身的特性主要分为以下几组
完全备份
部分备份
完全备份指的是备份整个数据集( 即整个数据库 )、部分备份指的是备份部分数据集(例如: 只备份一个表)
而部分备份又分为以下两种
增量备份
差异备份
增量备份指的是备份自上一次备份以来(增量或完全)以来变化的数据; 特点: 节约空间、还原麻烦
差异备份指的是备份自上一次完全备份以来变化的数据 特点: 浪费空间、还原比增量备份简单
示意图如下:
三、MySQL备份数据的方式
在MySQl
中我们备份数据一般有几种方式
热备份
温备份
冷备份
热备份指的是当数据库进行备份时, 数据库的读写操作均不是受影响
温备份指的是当数据库进行备份时, 数据库的读操作可以执行, 但是不能执行写操作
冷备份指的是当数据库进行备份时, 数据库不能进行读写操作, 即数据库要下线
MySQL
中进行不同方式的备份还要考虑存储引擎是否支持
MyISAM
热备 ×
温备 √
冷备 √
InnoDB
热备 √
温备 √
冷备 √
我们在考虑完数据在备份时, 数据库的运行状态之后还需要考虑对于
MySQL
数据库中数据的备份方式物理备份一般就是通过
tar
,cp
等命令直接打包复制数据库的数据文件达到备份的效果
逻辑备份一般就是通过特定工具从数据库中导出数据并另存备份(逻辑备份会丢失数据精度)物理备份
逻辑备份
四、备份需要考虑的问题
定制备份策略前, 我们还需要考虑一些问题
我们要备份什么?
一般情况下, 我们需要备份的数据分为以下几种
数据
二进制日志, InnoDB事务日志
代码(存储过程、存储函数、触发器、事件调度器)
服务器配置文件
备份工具
这里我们列举出常用的几种备份工具 mysqldump
: 逻辑备份工具, 适用于所有的存储引擎, 支持温备、完全备份、部分备份、对于InnoDB存储引擎支持热备 cp, tar 等归档复制工具
: 物理备份工具, 适用于所有的存储引擎, 冷备、完全备份、部分备份 lvm2 snapshot
: 几乎热备, 借助文件系统管理工具进行备份 mysqlhotcopy
: 名不副实的的一个工具, 几乎冷备, 仅支持MyISAM存储引擎 xtrabackup
: 一款非常强大的InnoDB/XtraDB热备工具, 支持完全备份、增量备份, 由percona
提供
五、设计合适的备份策略
针对不同的场景下, 我们应该制定不同的备份策略对数据库进行备份, 一般情况下, 备份策略一般为以下三种
直接cp,tar复制数据库文件
mysqldump+复制BIN LOGS
lvm2快照+复制BIN LOGS
xtrabackup
以上的几种解决方案分别针对于不同的场景
如果数据量较小, 可以使用第一种方式, 直接复制数据库文件
如果数据量还行, 可以使用第二种方式, 先使用mysqldump对数据库进行完全备份, 然后定期备份BINARY LOG达到增量备份的效果
如果数据量一般, 而又不过分影响业务运行, 可以使用第三种方式, 使用
lvm2
的快照对数据文件进行备份, 而后定期备份BINARY LOG达到增量备份的效果如果数据量很大, 而又不过分影响业务运行, 可以使用第四种方式, 使用
xtrabackup
进行完全备份后, 定期使用xtrabackup
进行增量备份或差异备份
六、实战演练
1.使用cp进行备份
#查看数据库信息
mysql> SHOW DATABASES; #查看当前的数据库, 我们的数据库为employees
+--------------------+
| Database |
+--------------------+
| information_schema |
| monkey |
| mysql |
| test |
+--------------------+
rows in set (0.00 sec)
mysql> use monkey
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> show tables
-> ;
+------------------+
| Tables_in_monkey |
+------------------+
| locations |
| pseudohash |
| t1 |
| t2 |
| unsent_emails |
+------------------+
5 rows in set (0.00 sec)
mysql> select * from t1;
+----+-------+-----+
| id | name | age |
+----+-------+-----+
| 1 | Jelly | 28 |
| 2 | Jerry | 30 |
+----+-------+-----+
2 rows in set (0.00 sec)
mysql>
#向数据库施加读锁
mysql> FLUSH TABLES WITH READ LOCK; #向所有表施加读锁
Query OK, rows affected (0.00 sec)
#备份数据文件
[root@A04-Test- ~]# mkdir /root/backup #创建文件夹存放备份数据库文件
[root@A04-Test- ~]# cp -a /usr/local/mysql/* /root/backup/ #保留权限的拷贝源数据文件
[root@A04-Test-172 ~]# ls /root/backup #查看目录下的文件
total 122916
-rw-r----- 1 mysql mysql 56 Jan 5 17:03 auto.cnf
-rw-r----- 1 mysql mysql 373 Jan 24 14:15 ib_buffer_pool
-rw-r----- 1 mysql mysql 12582912 Feb 5 11:08 ibdata1
-rw-r----- 1 mysql mysql 50331648 Feb 5 11:08 ib_logfile0
-rw-r----- 1 mysql mysql 50331648 Jan 5 17:03 ib_logfile1
-rw-r----- 1 mysql mysql 12582912 Feb 5 11:08 ibtmp1
drwxr-x--- 2 mysql mysql 4096 Feb 5 11:08 monkey
drwxr-x--- 2 mysql mysql 4096 Jan 5 17:03 mysql
-rw-r----- 1 mysql mysql 6 Jan 24 14:15 mysqld.pid
drwxr-x--- 2 mysql mysql 4096 Jan 5 17:03 performance_schema
drwxr-x--- 2 mysql mysql 12288 Jan 5 17:03 sys
#模拟数据丢失并恢复
[root@A04-Test- ~]# rm -rf /usr/local/mysql/data/* #删除数据库的所有文件
[root@A04-Test-172 ~]# service mysqld restart #重启MySQL, 如果是编译安装的应该不能启动, 如果rpm安装则会重新初始化数据库
mysql> show databases; #发现数据丢失了
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| performance_schema |
| sys |
+--------------------+
6 rows in set (0.00 sec)
[root@A04-Test-172 backup]# cp -a /root/mysqldumpbackup/backup.sql /usr/local/mysql/data/ #将备份数据拷贝回去
[root@A04-Test-172 ~]# service mysqld restart #重启MySQL,
mysql> show databases; #查看数据是否恢复
+--------------------+
| Database |
+--------------------+
| information_schema |
| TEST1 |
| monkey |
| mysql |
| performance_schema |
| sys |
+--------------------+
6 rows in set (0.00 sec) mysql> use monkey
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A Database changed
mysql> show tables
-> ;
+------------------+
| Tables_in_monkey |
+------------------+
| locations |
| pseudohash |
| t1 |
| t2 |
| unsent_emails |
+------------------+
5 rows in set (0.00 sec) mysql> select * from t1;
+----+-------+-----+
| id | name | age |
+----+-------+-----+
| 1 | Jelly | 28 |
| 2 | Jerry | 30 |
+----+-------+-----+
2 rows in set (0.00 sec) mysql>
2.使用mysqldump+复制BINARY LOG备份
我们通过mysqldump进行一次完全备份, 再修改表中的数据, 然后再通过binary log进行恢复。
二进制日志需要在mysql配置文件中添加 log_bin=on 开启。
[root@A04-Test- backup]# more /etc/my.cnf
[client]
port =
socket = /tmp/mysql.sock [mysqld]
user=mysql
port =
server_id =
socket=/tmp/mysql.sock
basedir =/usr/local/mysql
datadir =/usr/local/mysql/data
pid-file=/usr/local/mysql/data/mysqld.pid
log-error=/usr/local/mysql/log/mysql-error.log
log-bin=on #开启二进制日志
mysqldump
命令介绍
mysqldump
是一个客户端的逻辑备份工具, 可以生成一个重现创建原始数据库和表的SQL语句, 可以支持所有的存储引擎, 对于InnoDB支持热备。
#基本语法格式 shell> mysqldump [options] db_name [tbl_name ...] 恢复需要手动CRATE DATABASES
shell> mysqldump [options] --databases db_name ... 恢复不需要手动创建数据库
shell> mysqldump [options] --all-databases 恢复不需要手动创建数据库 其他选项:
-E, --events: 备份事件调度器
-R, --routines: 备份存储过程和存储函数
--triggers: 备份表的触发器; --skip-triggers
--master-date[=value]
: 记录为CHANGE MASTER TO 语句、语句不被注释
: 记录为注释的CHANGE MASTER TO语句
基于二进制还原只能全库还原 --flush-logs: 日志滚动
锁定表完成后执行日志滚动
查看数据库信息
mysql> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| information_schema |
| monkey |
| mysql |
| performance_schema |
| sys |
+--------------------+
rows in set (0.00 sec)
mysql> use monkey;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A Database changed
mysql> SHOW TABLES;
+------------------+
| Tables_in_monkey |
+------------------+
| locations |
| pseudohash |
| t1 |
| t2 |
| unsent_emails |
+------------------+
rows in set (0.00 sec) mysql> SELECT COUNT(*) FROM t1;
+----------+
| COUNT(*) |
+----------+
| |
+----------+
row in set (0.00 sec)
使用mysqldump备份数据库
[root@A04-Test- data]# mysql -uroot -p -e 'SHOW MASTER STATUS' #查看二进制文件的状态,并记录Position中的数字
Enter password:
+-----------+----------+--------------+------------------+-------------------+
| File | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+-----------+----------+--------------+------------------+-------------------+
| on. | | | | |
+-----------+----------+--------------+------------------+-------------------+
[root@A04-Test- mysqldumpbackup]# mysqldump -uroot -p --all-databases --lock-all-tables > backup.sql #备份数据库到backup.sql文件中
[root@A04-Test- mysqldumpbackup]# ll
total
-rw-r--r-- root root Mar : backup.sql
[root@A04-Test- mysqldumpbackup]# mysql -uroot -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is
Server version: 5.7.-log MySQL Community Server (GPL) Copyright (c) , , Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> CREATE DATABASE TEST1; #创建一个数据库
Query OK, row affected (0.02 sec) mysql> SHOW MASTER STATUS; #记录下现在的Position
+-----------+----------+--------------+------------------+-------------------+
| File | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+-----------+----------+--------------+------------------+-------------------+
| on. | 45 | | | |
+-----------+----------+--------------+------------------+-------------------+
row in set (0.00 sec) mysql>
[root@A04-Test-172 mysql-bin]# cp -a /usr/local/mysql/log/mysql-bin. /root/mysqldumpbackup/mysql-bin #复制二进制日志文件到备份目录下
[root@A04-Test-172]# service mysql.server stop #停止MySQL
[root@A04-Test-172 data]# rm -rf /usr/local/mysql/data/* #删除所有数据文件
#启动MySQL, 如果是编译安装的应该不能启动(需重新初始化), 如果rpm安装则会重新初始化数据库
#再次清除/usr/local/mysql/data目录下的文件,执行数据库初始化,初始化的密码在日志文件中(/usr/local/mysql/log/mysql-error.log)
[root@A04-Test-172 mysql]# bin/mysqld --initialize --user=mysql #初始化MySQL #启动mysql
[root@A04-Test-172 tmp]# service mysql.server start
#登录MySQL
[root@A04-Test-172 tmp]# mysql -uroot -p #重置MySQL密码
mysql> set password for root@localhost = password('mysql');
Query OK, 0 rows affected, 1 warning (0.02 sec)
mysql> flush privileges;
Query OK, 0 rows affected (0.03 sec)
mysql> SHOW DATABASES; #查看数据是否丢失
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| performance_schema |
| sys |
+--------------------+
rows in set (0.00 sec)
mysql> SET sql_log_bin=OFF; #暂时关闭二进制
Query OK, 0 rows affected (0.00 sec)
mysql>source /root/mysqldumpbackup/backup.sql
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
mysql>
mysql> SET sql_log_bin=ON; #开启二进制日志
Query OK, 0 rows affected (0.00 sec)
mysql> SHOW DATABASES; #查看数据是否恢复,可以看到mysql已经恢复了,但缺少TEST1
+--------------------+
| Database |
+--------------------+
| information_schema |
| monkey |
| mysql |
| performance_schema |
| sys |
+--------------------+
5 rows in set (0.00 sec)
#通过二进制日志增量恢复数据
[root@A04-Test- mysqldumpbackup]# mysqlbinlog -uroot -p --start-position=154 --stop-position=456 mysql-bin.000009
Enter password:
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=1*/;
/*!50003 SET @OLD_COMPLETION_TYPE=@@COMPLETION_TYPE,COMPLETION_TYPE=0*/;
DELIMITER /*!*/;
# at
# :: server id end_log_pos CRC32 0x7bbbba85 Start: binlog v , server v 5.7.-log created :: at startup
# Warning: this binlog is either in use or was not closed properly.
ROLLBACK/*!*/;
BINLOG '
e2unWg8BAAAAdwAAAHsAAAABAAQANS43LjE4LWxvZwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAAAAAAAAAAAAB7a6daEzgNAAgAEgAEBAQEEgAAXwAEGggAAAAICAgCAAAACgoKKioAEjQA
AYW6u3s=
'/*!*/;
# at
# :: server id end_log_pos CRC32 0xb59c4546 Anonymous_GTID last_committed= sequence_number=
SET @@SESSION.GTID_NEXT= 'ANONYMOUS'/*!*/;
# at
# :: server id end_log_pos CRC32 0xe7b92856 Query thread_id= exec_time= error_code=
SET TIMESTAMP=/*!*/;
SET @@session.pseudo_thread_id=/*!*/;
SET @@session.foreign_key_checks=, @@session.sql_auto_is_null=, @@session.unique_checks=, @@session.autocommit=/*!*/;
SET @@session.sql_mode=/*!*/;
SET @@session.auto_increment_increment=, @@session.auto_increment_offset=/*!*/;
/*!\C utf8 *//*!*/;
SET @@session.character_set_client=,@@session.collation_connection=,@@session.collation_server=/*!*/;
SET @@session.lc_time_names=/*!*/;
SET @@session.collation_database=DEFAULT/*!*/;
FLUSH TABLES
/*!*/;
# at
# :: server id end_log_pos CRC32 0xa7afc716 Anonymous_GTID last_committed= sequence_number=
SET @@SESSION.GTID_NEXT= 'ANONYMOUS'/*!*/;
# at
# :: server id end_log_pos CRC32 0x6a6a4762 Query thread_id= exec_time= error_code=
SET TIMESTAMP=/*!*/;
SET @@session.sql_mode=/*!*/;
CREATE DATABASE TEST1
/*!*/;
SET @@SESSION.GTID_NEXT= 'AUTOMATIC' /* added by mysqlbinlog */ /*!*/;
DELIMITER ;
# End of log file
/*!50003 SET COMPLETION_TYPE=@OLD_COMPLETION_TYPE*/;
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=0*/; 另一种方法,将解析后的二进制日志文件保存到一个txt文件中,然后进行导入操作!
[root@A04-Test-172 mysqldumpbackup]# mysqlbinlog --start-position=154 --stop-position=456 mysql-bin.000009 > mysqlbinlog.txt
[root@A04-Test-172 mysqldumpbackup]# mysql -uroot -pmysql
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 10
Server version: 5.7.18-log MySQL Community Server (GPL)
Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> source /root/mysqldumpbackup/mysqlbinlog.txt
Query OK, 0 rows affected (0.00 sec)
#查看是否恢复
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| TEST1 |
| monkey |
| mysql |
| performance_schema |
| sys |
+--------------------+
6 rows in set (0.00 sec)
mysql>
3.使用lvm2快照备份数据
LVM
快照简单来说就是将所快照源分区一个时间点所有文件的元数据进行保存,如果源文件没有改变,那么访问快照卷的相应文件则直接指向源分区的源文件,如果源文件发生改变,则快照卷中与之对应的文件不会发生改变。快照卷主要用于辅助备份文件。 这里只简单介绍。
具体可参见:http://www.360doc.com/content/13/0522/16/11801283_287305129.shtml
4. Xtrabackup
使用xtrabackup
使用InnoDB能够发挥其最大功效, 并且InnoDB的每一张表必须使用单独的表空间, 我们需要在配置文件中添加 innodb_file_per_table = ON
来开启.
(1)安装Xtrabackup
yum -y install perl-DBD-MySQL
rpm -ivh libev-4.03-.el6.x86_64.rpm
rpm -ivh percona-xtrabackup-24-2.4.9-1.el6.x86_64.rpm
依赖包下载地址:https://pan.baidu.com/s/1HF_FyrZAv4PZio8mJiOXpQ
Xtrabackup
是由percona
提供的mysql
数据库备份工具,据官方介绍,这也是世界上惟一一款开源的能够对innodb和xtradb数据库进行热备的工具。特点:
备份过程快速、可靠;
备份过程不会打断正在执行的事务;
能够基于压缩等功能节约磁盘空间和流量;
自动实现备份检验;
还原速度快;
我们这里使用xtrabackup
的前端配置工具innobackupex
来实现对数据库的完全备份
使用innobackupex
备份时, 会调用xtrabackup
备份所有的InnoDB表, 复制所有关于表结构定义的相关文件(.frm)、以及MyISAM、MERGE、CSV和ARCHIVE表的相关文件, 同时还会备份触发器和数据库配置文件信息相关的文件, 这些文件会被保存至一个以时间命名的目录.。
mkdir /root/xtrabackup #新建备份目录
innobackupex --user=root --password=mysql xtrabackup/ #开始备份
#备份时显示的信息
180319 :: Executing FLUSH NO_WRITE_TO_BINLOG ENGINE LOGS...
xtrabackup: The latest check point (for incremental): ''
xtrabackup: Stopping log copying thread.
. :: >> log scanned up to () :: Executing UNLOCK TABLES
:: All tables unlocked
:: [] Copying ib_buffer_pool to /root/xtrabackup/--19_11--/ib_buffer_pool
:: [] ...done
:: Backup created in directory '/root/xtrabackup/2018-03-19_11-18-43/'
MySQL binlog position: filename 'mysql-bin.000014', position ''
:: [] Writing /root/xtrabackup/--19_11--/backup-my.cnf
:: [] ...done
:: [] Writing /root/xtrabackup/--19_11--/xtrabackup_info
:: [] ...done
xtrabackup: Transaction log of lsn () to () was copied.
:: completed OK!
[root@A04-Test-172 xtrabackup]# ll
total 4
drwxr-x--- 7 root root 4096 Mar 19 11:18 2018-03-19_11-18-43
[root@A04-Test-172 xtrabackup]# pwd
/root/xtrabackup
一般情况, 备份完成后, 数据不能用于恢复操作, 因为备份的数据中可能会包含尚未提交的事务或已经提交但尚未同步至数据文件中的事务。因此, 此时的数据文件仍不一致, 所以我们需要”准备”一个完全备份。
#开始完全备份
[root@A04-Test- ~]# innobackupex --apply-log --user=root --password=mysql /root/xtrabackup/--19_11--/
xtrabackup: starting shutdown with innodb_fast_shutdown =
InnoDB: FTS optimize thread exiting.
InnoDB: Starting shutdown...
InnoDB: Shutdown completed; log sequence number
InnoDB: Number of pools:
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup: innodb_data_home_dir = .
xtrabackup: innodb_data_file_path = ibdata1:12M:autoextend
xtrabackup: innodb_log_group_home_dir = .
xtrabackup: innodb_log_files_in_group =
xtrabackup: innodb_log_file_size =
InnoDB: PUNCH HOLE support available
InnoDB: Mutexes and rw_locks use GCC atomic builtins
InnoDB: Uses event mutexes
InnoDB: GCC builtin __sync_synchronize() is used for memory barrier
InnoDB: Compressed tables use zlib 1.2.
InnoDB: Number of pools:
InnoDB: Using CPU crc32 instructions
InnoDB: Initializing buffer pool, total size = 100M, instances = , chunk size = 100M
InnoDB: Completed initialization of buffer pool
InnoDB: page_cleaner coordinator priority: -
InnoDB: Setting log file ./ib_logfile101 size to MB
InnoDB: Setting log file ./ib_logfile1 size to MB
InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0
InnoDB: New log files created, LSN=
InnoDB: Highest supported file format is Barracuda.
InnoDB: Log scan progressed past the checkpoint lsn
InnoDB: Doing recovery: scanned up to log sequence number (%)
InnoDB: Doing recovery: scanned up to log sequence number (%)
InnoDB: Database was not shutdown normally!
InnoDB: Starting crash recovery.
InnoDB: Removed temporary tablespace data file: "ibtmp1"
InnoDB: Creating shared tablespace for temporary tables
InnoDB: Setting file './ibtmp1' size to MB. Physically writing the file full; Please wait ...
InnoDB: File './ibtmp1' size is now MB.
InnoDB: redo rollback segment(s) found. redo rollback segment(s) are active.
InnoDB: non-redo rollback segment(s) are active.
InnoDB: 5.7. started; log sequence number
xtrabackup: starting shutdown with innodb_fast_shutdown =
InnoDB: FTS optimize thread exiting.
InnoDB: Starting shutdown...
InnoDB: Shutdown completed; log sequence number
:: completed OK!
[root@A04-Test- --19_11--]# ll #查看备份文件
total
-rw-r----- root root Mar : backup-my.cnf
-rw-r----- root root Mar : ib_buffer_pool
-rw-r----- root root Mar : ibdata1
-rw-r----- root root Mar : ib_logfile0
-rw-r----- root root Mar : ib_logfile1
-rw-r----- root root Mar : ibtmp1
drwxr-x--- root root Mar : monkey
drwxr-x--- root root Mar : mysql
drwxr-x--- root root Mar : performance_schema
drwxr-x--- root root Mar : sys
drwxr-x--- root root Mar : TEST1
-rw-r----- root root Mar : xtrabackup_binlog_info
-rw-r----- root root Mar : xtrabackup_checkpoints
-rw-r----- root root Mar : xtrabackup_info
-rw-r----- root root Mar : xtrabackup_logfile
恢复数据:
#删除MySQL数据目录下的文件
[root@A04-Test- --19_11--]# rm -rf /usr/local/mysql/data/*
#开始恢复数据,不用启动该数据库也可以还原
[root@A04-Test- --19_11--]# innobackupex --copy-back --user=root --password=mysql /root/xtrabackup/--19_11--/
:: [] ...done
:: [] Copying ./performance_schema/global_status.frm to /usr/local/mysql/data/performance_schema/global_status.frm
:: [] ...done
:: [] Copying ./performance_schema/replication_applier_configuration.frm to /usr/local/mysql/data/performance_schema/replication_applier_configuration.frm
:: [] ...done
:: [] Copying ./performance_schema/events_transactions_summary_by_thread_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_transactions_summary_by_thread_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/events_waits_summary_by_user_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_waits_summary_by_user_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/events_transactions_history.frm to /usr/local/mysql/data/performance_schema/events_transactions_history.frm
:: [] ...done
:: [] Copying ./performance_schema/events_stages_current.frm to /usr/local/mysql/data/performance_schema/events_stages_current.frm
:: [] ...done
:: [] Copying ./performance_schema/events_statements_summary_by_user_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_statements_summary_by_user_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/memory_summary_by_host_by_event_name.frm to /usr/local/mysql/data/performance_schema/memory_summary_by_host_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/events_waits_history.frm to /usr/local/mysql/data/performance_schema/events_waits_history.frm
:: [] ...done
:: [] Copying ./performance_schema/socket_summary_by_event_name.frm to /usr/local/mysql/data/performance_schema/socket_summary_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/session_variables.frm to /usr/local/mysql/data/performance_schema/session_variables.frm
:: [] ...done
:: [] Copying ./performance_schema/events_statements_summary_by_thread_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_statements_summary_by_thread_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/events_transactions_summary_by_host_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_transactions_summary_by_host_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/events_statements_history_long.frm to /usr/local/mysql/data/performance_schema/events_statements_history_long.frm
:: [] ...done
:: [] Copying ./performance_schema/events_statements_summary_global_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_statements_summary_global_by_event_name.frm
:: [] ...done
:: [] Copying ./TEST1/db.opt to /usr/local/mysql/data/TEST1/db.opt
:: [] ...done
:: completed OK!
[root@A04-Test- data]# ll #查看MySQL数据目录下是否数据已恢复
total
-rw-r----- root root Mar : ib_buffer_pool
-rw-r----- root root Mar : ibdata1
-rw-r----- root root Mar : ib_logfile0
-rw-r----- root root Mar : ib_logfile1
-rw-r----- root root Mar : ibtmp1
drwxr-x--- root root Mar : monkey
drwxr-x--- root root Mar : mysql
drwxr-x--- root root Mar : performance_schema
drwxr-x--- root root Mar : sys
drwxr-x--- root root Mar : TEST1
-rw-r----- root root Mar : xtrabackup_info
[root@A04-Test- data]# pwd
/usr/local/mysql/data #修改data目录所属用户和组
[root@A04-Test- data]# chown -R mysql:mysql /usr/local/mysql/data
[root@A04-Test- data]# mysql -uroot -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is
Server version: 5.7.-log MySQL Community Server (GPL) Copyright (c) , , Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> show databases; #查看数据是否恢复
+--------------------+
| Database |
+--------------------+
| information_schema |
| TEST1 |
| monkey |
| mysql |
| performance_schema |
| sys |
+--------------------+
rows in set (0.00 sec)
增量备份
#新建两个数据库TEST1和TEST2 mysql> CREATE DATABASE TEST2;
Query OK, row affected (0.02 sec) mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| TEST1 |
| TEST2 |
| monkey |
| mysql |
| performance_schema |
| sys |
+--------------------+
rows in set (0.00 sec) mysql>
#开始增量备份
[root@A04-Test- ~]# innobackupex --user=root --password=mysql --incremental /root/xtrabackup/ --incremental-basedir=/root/xtrabackup/2018-03-19_11-18-43/
:: [] ...done
:: [] Copying ./performance_schema/session_variables.frm to /root/xtrabackup/--19_13--/performance_schema/session_variables.frm
:: [] ...done
:: [] Copying ./performance_schema/events_statements_summary_by_thread_by_event_name.frm to /root/xtrabackup/--19_13--/performance_schema/events_statements_summary_by_thread_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/events_transactions_summary_by_host_by_event_name.frm to /root/xtrabackup/--19_13--/performance_schema/events_transactions_summary_by_host_by_event_name.frm
:: [] ...done
:: [] Copying ./performance_schema/events_statements_history_long.frm to /root/xtrabackup/--19_13--/performance_schema/events_statements_history_long.frm
:: [] ...done
:: [] Copying ./performance_schema/events_statements_summary_global_by_event_name.frm to /root/xtrabackup/--19_13--/performance_schema/events_statements_summary_global_by_event_name.frm
:: [] ...done
:: [] Copying ./TEST1/db.opt to /root/xtrabackup/--19_13--/TEST1/db.opt
:: [] ...done
:: Finished backing up non-InnoDB tables and files
:: [] Writing /root/xtrabackup/--19_13--/xtrabackup_binlog_info
:: [] ...done
:: Executing FLUSH NO_WRITE_TO_BINLOG ENGINE LOGS...
xtrabackup: The latest check point (for incremental): ''
xtrabackup: Stopping log copying thread.
. :: >> log scanned up to () :: Executing UNLOCK TABLES
:: All tables unlocked
:: [] Copying ib_buffer_pool to /root/xtrabackup/--19_13--/ib_buffer_pool
:: [] ...done
:: Backup created in directory '/root/xtrabackup/2018-03-19_13-29-21/'
MySQL binlog position: filename 'mysql-bin.000015', position ''
:: [] Writing /root/xtrabackup/--19_13--/backup-my.cnf
:: [] ...done
:: [] Writing /root/xtrabackup/--19_13--/xtrabackup_info
:: [] ...done
xtrabackup: Transaction log of lsn () to () was copied.
:: completed OK!
#查看备份文件
[root@A04-Test-172 xtrabackup]# ll
total 8
drwxr-x--- 8 root root 4096 Mar 19 13:03 2018-03-19_11-18-43 #全量备份
drwxr-x--- 8 root root 4096 Mar 19 13:29 2018-03-19_13-29-21 #第一次增量备份
[root@A04-Test- --19_13--]# ll
total
-rw-r----- root root Mar : backup-my.cnf
-rw-r----- root root Mar : ib_buffer_pool
-rw-r----- root root Mar : ibdata1.delta
-rw-r----- root root Mar : ibdata1.meta
drwxr-x--- root root Mar : monkey
drwxr-x--- root root Mar : mysql
drwxr-x--- root root Mar : performance_schema
drwxr-x--- root root Mar : sys
drwxr-x--- root root Mar : TEST1
drwxr-x--- root root Mar : TEST2
-rw-r----- root root Mar : xtrabackup_binlog_info
-rw-r----- root root Mar : xtrabackup_checkpoints
-rw-r----- root root Mar : xtrabackup_info
-rw-r----- root root Mar : xtrabackup_logfile
BASEDIR指的是完全备份所在的目录,此命令执行结束后,innobackupex
命令会在/root/xtrabackup
目录中创建一个新的以时间命名的目录以存放所有的增量备份数据。
另外,在执行过增量备份之后再一次进行增量备份时,其--incremental-basedir
应该指向上一次的增量备份所在的目录。
需要注意的是,增量备份仅能应用于InnoDB或XtraDB表,对于MyISAM表而言,执行增量备份时其实进行的是完全备份。
整理增量备份:
# 2018-03-19_11-18-43为全量备份目录
[root@A04-Test- ~]# innobackupex --user=root --password=mysql --apply-log --redo-only /root/xtrabackup/--19_11--43
xtrabackup: Using bytes for buffer pool (set by --use-memory parameter)
InnoDB: PUNCH HOLE support available
InnoDB: Mutexes and rw_locks use GCC atomic builtins
InnoDB: Uses event mutexes
InnoDB: GCC builtin __sync_synchronize() is used for memory barrier
InnoDB: Compressed tables use zlib 1.2.
InnoDB: Number of pools:
InnoDB: Using CPU crc32 instructions
InnoDB: Initializing buffer pool, total size = 100M, instances = , chunk size = 100M
InnoDB: Completed initialization of buffer pool
InnoDB: page_cleaner coordinator priority: -
InnoDB: Highest supported file format is Barracuda. xtrabackup: starting shutdown with innodb_fast_shutdown =
InnoDB: Starting shutdown...
InnoDB: Shutdown completed; log sequence number
InnoDB: Number of pools:
:: completed OK!
# 2018-03-19_13-29-21为增量备份目录
[root@A04-Test- ~]# innobackupex --user=root --password=mysql --apply-log --redo-only /root/xtrabackup/--19_11-- --incremental-dir=/root/xtrabackup/--19_13-- :: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_transactions_history.frm to ./performance_schema/events_transactions_history.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_stages_current.frm to ./performance_schema/events_stages_current.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_statements_summary_by_user_by_event_name.frm to ./performance_schema/events_statements_summary_by_user_by_event_name.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/memory_summary_by_host_by_event_name.frm to ./performance_schema/memory_summary_by_host_by_event_name.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_waits_history.frm to ./performance_schema/events_waits_history.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/socket_summary_by_event_name.frm to ./performance_schema/socket_summary_by_event_name.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/session_variables.frm to ./performance_schema/session_variables.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_statements_summary_by_thread_by_event_name.frm to ./performance_schema/events_statements_summary_by_thread_by_event_name.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_transactions_summary_by_host_by_event_name.frm to ./performance_schema/events_transactions_summary_by_host_by_event_name.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_statements_history_long.frm to ./performance_schema/events_statements_history_long.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/performance_schema/events_statements_summary_global_by_event_name.frm to ./performance_schema/events_statements_summary_global_by_event_name.frm
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--/TEST1/db.opt to ./TEST1/db.opt
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--//xtrabackup_binlog_info to ./xtrabackup_binlog_info
:: [] ...done
:: [] Copying /root/xtrabackup/--19_13--//xtrabackup_info to ./xtrabackup_info
:: [] ...done
:: completed OK
[root@A04-Test- ~]# rm -rf /usr/local/mysql/data/* #删除数据目录下文件 #开始恢复
#2018-03-19_11-18-43为全量备份目录
[root@A04-Test-172 ~]# innobackupex --copy-back /root/xtrabackup/2018-03-19_11-18-43
name.frm
180319 15:00:30 [01] ...done
180319 15:00:30 [01] Copying ./performance_schema/events_waits_history.frm to /usr/local/mysql/data/performance_schema/events_waits_history.frm
180319 15:00:30 [01] ...done 180319 15:00:30 [01] Copying ./performance_schema/socket_summary_by_event_name.frm to /usr/local/mysql/data/performance_schema/socket_summary_by_event_name.frm
180319 15:00:30 [01] ...done 180319 15:00:30 [01] Copying ./performance_schema/session_variables.frm to /usr/local/mysql/data/performance_schema/session_variables.frm
180319 15:00:30 [01] ...done 180319 15:00:30 [01] Copying ./performance_schema/events_statements_summary_by_thread_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_statements_summary_by_thread_by_event_name.frm
180319 15:00:30 [01] ...done 180319 15:00:30 [01] Copying ./performance_schema/events_transactions_summary_by_host_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_transactions_summary_by_host_by_event_name.frm
180319 15:00:30 [01] ...done 180319 15:00:30 [01] Copying ./performance_schema/events_statements_history_long.frm to /usr/local/mysql/data/performance_schema/events_statements_history_long.frm
180319 15:00:30 [01] ...done
180319 15:00:30 [01] Copying ./performance_schema/events_statements_summary_global_by_event_name.frm to /usr/local/mysql/data/performance_schema/events_statements_summary_global_by_event_name.frm
180319 15:00:30 [01] ...done
180319 15:00:30 [01] Copying ./TEST1/db.opt to /usr/local/mysql/data/TEST1/db.opt 180319 15:00:30 [01] ...done
180319 15:00:30 completed OK! #修改data数据目录所属用户和组
[root@A04-Test-172 mysql]# chown -R mysql:mysql /usr/local/mysql/data
#杀掉僵尸进程
[root@A04-Test- data]# ps -ef|grep mysql
root : pts/ :: tail -f /usr/local/mysql/log/mysql-error.log
root : pts/ :: /bin/sh /usr/local/mysql/bin/mysqld_safe --datadir=/usr/local/mysql/data --pid-file=/usr/local/mysql/data/mysqld.pid
mysql : pts/ :: /usr/local/mysql/bin/mysqld --basedir=/usr/local/mysql --datadir=/usr/local/mysql/data --plugin-dir=/usr/local/mysql/lib/plugin --user=mysql --log-error=/usr/local/mysql/log/mysql-error.log --pid-file=/usr/local/mysql/data/mysqld.pid --socket=/tmp/mysql.sock --port=
root : pts/ :: tail -f mysql-error.log
root : pts/ :: grep mysql
[root@A04-Test- data]# kill -
[root@A04-Test- data]# ps -ef|grep mysql
root : pts/ :: tail -f /usr/local/mysql/log/mysql-error.log
root : pts/ :: tail -f mysql-error.log
root : pts/ :: grep mysql #启动数据库
[root@A04-Test- data]# service mysql.server start
Starting MySQL.[ OK ]
#查看数据是否已恢复
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| TEST1 |
| TEST2 |
| monkey |
| mysql |
| performance_schema |
| sys |
+--------------------+
rows in set (0.00 sec) mysql> exit
七、总结
备份方法 | 备份速度 | 恢复速度 | 便捷性 | 功能 | 一般用于 |
---|---|---|---|---|---|
cp | 快 | 快 | 一般、灵活性低 | 很弱 | 少量数据备份 |
mysqldump | 慢 | 慢 | 一般、可无视存储引擎的差异 | 一般 | 中小型数据量的备份 |
lvm2快照 | 快 | 快 | 一般、支持几乎热备、速度快 | 一般 | 中小型数据量的备份 |
xtrabackup | 较快 | 较快 | 实现innodb热备、对存储引擎有要求 | 强大 | 较大规模的备份 |
八、常见问题解答
1.启动mysql时报错:
[root@A04-Test- ~]# service mysql.server start
Starting MySQL..The server quit without updating PID file (/usr/local/mysql/data/mysqld.pid).[FAILED]
【解决方法】
(1)查看MySQL日志,报错如下:
.
2018-03-19T05:12:30.839470Z 0 [ERROR] InnoDB: The innodb_system data file 'ibdata1' must be writable
2018-03-19T05:12:30.839551Z 0 [ERROR] InnoDB: The innodb_system data file 'ibdata1' must be writable
2018-03-19T05:12:30.839569Z 0 [ERROR] InnoDB: Plugin initialization aborted with error Generic error
2018-03-19T05:12:31.440444Z 0 [ERROR] Plugin 'InnoDB' init function returned error.
2018-03-19T05:12:31.440568Z 0 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
2018-03-19T05:12:31.440587Z 0 [ERROR] Failed to initialize plugins.
2018-03-19T05:12:31.440596Z 0 [ERROR] Aborting --19T05::.440618Z [Note] Binlog end
--19T05::.440745Z [Note] Shutting down plugin 'CSV'
--19T05::.441182Z [Note] /usr/local/mysql/bin/mysqld: Shutdown complete
(2)根据上述错误信息,加上百度之。判断是/usr/local/mysql/data目录没有写权限。经核查,/usr/local/mysql/data目录的所属用户和组均为root.故授权之。
chown -R mysql:mysql /usr/local/mysql/data
(3)查看是否有僵尸进程,有则kill -9
ps -ef|grep mysql
(4)重新启动数据库,完美启动
[root@A04-Test- backup]# service mysql.server start
Starting MySQL..[ OK ]
【MySQL】MySQL备份和恢复的更多相关文章
- mysql 数据库备份,恢复。。。。
mysql 数据备份,恢复,恢复没写,这里只写了备份... 先暂作记录吧! 备份:表结构和数据完全分开,默认有一个文件会记录所有表的结构,然后表中数据的备份 如果超过分卷的大小则会分成多个文件,不然则 ...
- MySQL的备份和恢复
MySQL的备份和恢复 备份数据:mysqldump –uroot –p123456 dbname table [option] > dbname.sql mysqldump常用参数option ...
- MySQL的备份和恢复-基于LVM快照的备份(lvm-snapshot)
MySQL的备份和恢复-基于LVM快照的备份(lvm-snapshot) 作者:尹正杰 版权声明:原创作品,谢绝转载!否则将追究法律责任. 一.什么是快照卷 如上图所示,原卷和快照卷可以不一样大,因为 ...
- MySQL的备份和恢复-mysqldump
MySQL的备份和恢复-mysqldump 作者:尹正杰 版权声明:原创作品,谢绝转载!否则将追究法律责任. 一.为什么需要备份 1>.做灾难恢复 天有不测风云嘛,如果你的服务器被黑客攻击了(比 ...
- mysql 完整备份和恢复
mysql 完整备份和恢复 一.MySQL完整备份操作 1.直接打包数据库文件夹 创建数据库auth: MariaDB [(none)]> create database auth;Quer ...
- JSP 实现 之 调用java方法实现MySQL数据库备份和恢复
package cn.qm.db; import java.io.BufferedReader; import java.io.DataInputStream; import java.io.IOEx ...
- MySQL没有备份怎么恢复被drop的表(利用undrop-for-innodb)
介绍: 也许大家都难以理解,这么重要的数据为啥不备份(或者备份不可用)?而且还任性的drop table了.显然有备份是最好的,但是它们并不总是可用的.这种情况令人恐惧,但并非毫无希望.在许多 ...
- innobackupex做MySQL增量备份及恢复【转】
创建备份用户 mysql> grant process,reload,lock tables,replication client on *.* to 'backup'@'localhost' ...
- mysql 数据库备份和恢复
物理备份对比逻辑备份 物理备份是指直接复制包含数据的文件夹和文件.这种类型的备份适用于大数据量且非常重要,遇到问题需要快速回复的数据库. 逻辑备份保存能够代表数据库信息的逻辑结构(CREATE DAT ...
- Linux下mysql定时备份及恢复
备份 1.数据库定时备份工作脚本:(日期时间作为名称的压缩文件,解压开是sql脚本) /root/backup/script/backup_mysql.sh 2.备份输出路径: /root/backu ...
随机推荐
- mongodb的投影
mongodb 投影意思是只选择必要的数据而不是选择一个文件的数据的整个.如果一个文档有5个字段,需要显示只有3个,然后选择其中只有3个字段. find() 方法 MongoDB 的find()方法, ...
- ABAP自定义功能函数
1.实现计算器中阶乘函数 FUNCTION zfun_mm_001. *"---------------------------------------------------------- ...
- SQL查找TCar表中同一辆车前后两条记录的CarId,两条记录中有多个字段值一样
查询同一个表中某一字段值相同的记录 select * from 表名 where 字段 in(select 字段 from 表名 group by 字段 having count(1)>1) s ...
- pt-table-checksum和pt-table-sync
环境:系统bsd,标准安装,ports安装的mysql. 主172.16.21.126 从172.16.21.128vi /etc/rc.conf 添加 mysql_enable="YES& ...
- PHP的加解密:如何安装ioncube扩展?
一.下载loader-wizard.php(支持php5.3.php5.4.php5.5.php5.6版本) ioncube提供了一个安装的向导程序,可以非常方便的帮助检测php的运行环境,自动给出提 ...
- SharePoint Server 2016 WEB 网站浏览器支持
SharePoint Server 2016支持多种常用的Web浏览器,如Internet Explorer,Google Chrome,Mozilla Firefox,Apple Safari和Mi ...
- Python3+Selenium3+webdriver学习笔记8(单选、复选框、弹窗处理)
#!/usr/bin/env python# -*- coding:utf-8 -*-'''Selenium3+webdriver学习笔记8(单选.复选框.弹窗处理)''' from selenium ...
- Python+selenium之带unittest的脚本分析
from selenium import webdriver from selenium.webdriver.common.by import By from selenium.webdriver.c ...
- asterisk-java ami2 事件监听
asteriskServer文章1提到啦怎么获取,就不解释 asteriskServer.addChainListener(new AsteriskeventListenerInit());//整个服 ...
- 新建博客第一天,随意来一发Win8运行命令大全
1.calc:启动计算器 2.appwiz.cpl:程序和功能 3.certmgr.msc:证书管理实用程序 4.charmap:启动字符映射表 5.chkdsk.exe:Chkdsk磁盘检查(管 ...