KeepAlived+HaProxy+MyCat+Percona双机热备PXC集群

一、搭建PXC集群

1、环境：centos7+PXC5.7.21+mycat1.6.5

2、卸载mariadb

rpm -qa | grep mariadb*

yum -y remove mariadb*

3、禁用防火墙或者开放端口

禁用防火墙：
systemctl stop firewalld
systemctl disable firewalld

或者启用防火墙，开放相关端口（3306，4444，4567，4568）
firewall-cmd --zone=public --add-port=3306/tcp --permanent
firewall-cmd --zone=public --add-port=4444/tcp --permanent
firewall-cmd --zone=public --add-port=4567/tcp --permanent
firewall-cmd --zone=public --add-port=4568/tcp --permanent

查看端口
firewall-cmd --list-ports

关闭SELinux
vi /etc/selinux/config
修改值为disabled

最后重启 reboot

4、安装pxc集群

yum lcoalinstall *.rpm

需要完整安装包的可以下方留言

5、设置mysql初始密码与账户

1、此时保证当前节点的mysql服务是启动状态，使用：cat/var/log/mysqld.log | grep "password" 查到初始密码

2、如mysqld.log 为空，则使用 service mysqld restart 重启一下服务再次查看

3、可以使用service mysqld status 查看当前节点服务状态

4、找到初始密码后，使用 mysql_secure_installation 修改密码 

5、mysql -u root -p 登录成功后建立账户及分配权限

create user 'admin'@'%' identified '123456';

grant all privileges on *.* to 'admin'@'%';

flush privileges;

6、取消mysql开机自启动（否则会自动同步集群数据，同步期间，整个集群无法对外提供服务）

chkconfig mysqld off

7、停止各节点mysql服务，配置集群各节点my.cnf 文件

随便贴一份：

[client]
socket=/var/lib/mysql/mysql.sock

[mysqld]
server-id=1
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
log-bin
log_slave_updates
expire_logs_days=7

# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0

character_set_server=utf8

bind-address=0.0.0.0

skip-name-resolve

# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0

wsrep_provider=/usr/lib64/galera3/libgalera_smm.so
wsrep_cluster_name=pxc-weitian
wsrep_cluster_address=gcomm://161.8.0.120,161.8.0.121,161.8.0.122
wsrep_node_name=dn1
wsrep_node_address=161.8.0.120
wsrep_sst_method=xtrabackup-v2
wsrep_sst_auth=admin:123456
pxc_strict_mode=ENFORCING
binlog_format=ROW
default_storage_engine=InnoDB
innodb_autoinc_lock_mode=2

8、启动PXC集群

主：
systemctl start mysql@bootstrap.service

从:
service mysql start 

注意关闭时使用对应的命令：
主：
systemctl stop mysql@bootstrap.service

从:
service mysql stop 

同时注意/var/lib/mysql/grastate.dat 文件，下次集群的主节点。 

二、搭建MyCat集群

1、安装jdk1.8 并配置环境变量

2、下载mycat1.6.5 并tar解压

3、开放端口，关闭SELinux

8066 数据服务  9066 mycat管理端口

4、修改mycat配置信息

server.xml:

<?xml version="1.0" encoding="UTF-8"?>

<!DOCTYPE mycat:server SYSTEM "server.dtd">
<mycat:server xmlns:mycat="http://io.mycat/">

    <!-- 配置mycat帐号及使用的数据库 -->
    <user name="admin" defaultAccount="true">
        <property name="password">Abc_123456</property>
        <property name="schemas">test</property>
    </user>

    <!-- 根据需要配置只读帐号 -->
    <user name="user">
        <property name="password">user</property>
        <property name="schemas">test</property>
        <property name="readOnly">true</property>
    </user>

</mycat:server>

schema.xml:

<?xml version="1.0"?>
<!DOCTYPE mycat:schema SYSTEM "schema.dtd">
<mycat:schema xmlns:mycat="http://io.mycat/">

    <!--配置数据表 -->
    <schema name="test" checkSQLschema="false" sqlMaxLimit="100">
        <!-- auto sharding by id (long) -->
        <table name="t_user" dataNode="dn1,dn2" rule="mod-long" />
    </schema>

    <!--配置分片信息 -->

    <dataNode name="dn1" dataHost="cluster1" database="test" />
    <dataNode name="dn2" dataHost="cluster2" database="test" />

    <!--balance:
        0:不开启读写分离
        1：只保留一个写节点，其余全是读节点
        2：所有的写节点都可以额外承担读请求
        3：写节点只负责写，读节点只负责读

        writeType：
        0：所有的写操作都由第一个写节点负责完成，只有该节点宕机后，其余写节点才会被启用
        1：所有的写操作由所有的写节点一起承担

        switchType:切换节点的依据
        1：使用mycat本身的心跳检测判断
        2：使用集群的状态信息判断

    -->

    <!--配置连接信息 -->
    <dataHost name="cluster1" maxCon="1000" minCon="10" balance="2"
              writeType="1" dbType="mysql" dbDriver="native" switchType="1"  slaveThreshold="100">
        <heartbeat>select user()</heartbeat>
        <!-- can have multi write hosts -->
        <writeHost host="w1" url="161.8.0.120:3306" user="admin"
                   password="Abc_123456">
            <!-- can have multi read hosts -->
            <readHost host="w1r1" url="161.8.0.121:3306" user="admin" password="Abc_123456" />
            <readHost host="w1r2" url="161.8.0.122:3306" user="admin" password="Abc_123456" />
        </writeHost>

        <writeHost host="w2" url="161.8.0.121:3306" user="admin"
                   password="Abc_123456">
            <!-- can have multi read hosts -->
            <readHost host="w2r1" url="161.8.0.120:3306" user="admin" password="Abc_123456" />
            <readHost host="w2r2" url="161.8.0.122:3306" user="admin" password="Abc_123456" />
        </writeHost>

    </dataHost>

    <dataHost name="cluster2" maxCon="1000" minCon="10" balance="2"
              writeType="1" dbType="mysql" dbDriver="native" switchType="1"  slaveThreshold="100">
        <heartbeat>select user()</heartbeat>
        <!-- can have multi write hosts -->
        <writeHost host="w1" url="161.9.0.200:3306" user="admin"
                   password="Abc_123456">
            <!-- can have multi read hosts -->
            <readHost host="w1r1" url="161.9.0.201:3306" user="admin" password="Abc_123456" />
            <readHost host="w1r2" url="161.9.0.202:3306" user="admin" password="Abc_123456" />
        </writeHost>

        <writeHost host="w2" url="161.9.0.201:3306" user="admin"
                   password="Abc_123456">
            <!-- can have multi read hosts -->
            <readHost host="w2r1" url="161.9.0.200:3306" user="admin" password="Abc_123456" />
            <readHost host="w2r2" url="161.9.0.202:3306" user="admin" password="Abc_123456" />
        </writeHost>

    </dataHost>

</mycat:schema>

rule.xml:

<?xml version="1.0" encoding="UTF-8"?>
<!-- - - Licensed under the Apache License, Version 2.0 (the "License");
    - you may not use this file except in compliance with the License. - You
    may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0
    - - Unless required by applicable law or agreed to in writing, software -
    distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT
    WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the
    License for the specific language governing permissions and - limitations
    under the License. -->
<!DOCTYPE mycat:rule SYSTEM "rule.dtd">
<mycat:rule xmlns:mycat="http://io.mycat/">
    <tableRule name="rule1">
        <rule>
            <columns>id</columns>
            <algorithm>func1</algorithm>
        </rule>
    </tableRule>

    <tableRule name="rule2">
        <rule>
            <columns>user_id</columns>
            <algorithm>func1</algorithm>
        </rule>
    </tableRule>

    <tableRule name="sharding-by-intfile">
        <rule>
            <columns>sharding_id</columns>
            <algorithm>hash-int</algorithm>
        </rule>
    </tableRule>
    <tableRule name="sharding-customer">
        <rule>
            <columns>sharding_id</columns>
            <algorithm>hash-int-customer</algorithm>
        </rule>
    </tableRule>
    <tableRule name="auto-sharding-long">
        <rule>
            <columns>id</columns>
            <algorithm>rang-long</algorithm>
        </rule>
    </tableRule>
    <tableRule name="mod-long">
        <rule>
            <columns>id</columns>
            <algorithm>mod-long</algorithm>
        </rule>
    </tableRule>
    <tableRule name="sharding-by-murmur">
        <rule>
            <columns>id</columns>
            <algorithm>murmur</algorithm>
        </rule>
    </tableRule>
    <tableRule name="crc32slot">
        <rule>
            <columns>id</columns>
            <algorithm>crc32slot</algorithm>
        </rule>
    </tableRule>
    <tableRule name="sharding-by-month">
        <rule>
            <columns>create_time</columns>
            <algorithm>partbymonth</algorithm>
        </rule>
    </tableRule>
    <tableRule name="latest-month-calldate">
        <rule>
            <columns>calldate</columns>
            <algorithm>latestMonth</algorithm>
        </rule>
    </tableRule>

    <tableRule name="auto-sharding-rang-mod">
        <rule>
            <columns>id</columns>
            <algorithm>rang-mod</algorithm>
        </rule>
    </tableRule>

    <tableRule name="jch">
        <rule>
            <columns>id</columns>
            <algorithm>jump-consistent-hash</algorithm>
        </rule>
    </tableRule>

    <function name="murmur"
        class="io.mycat.route.function.PartitionByMurmurHash">
        <property name="seed">0</property><!-- 默认是0 -->
        <property name="count">2</property><!-- 要分片的数据库节点数量，必须指定，否则没法分片 -->
        <property name="virtualBucketTimes">160</property><!-- 一个实际的数据库节点被映射为这么多虚拟节点，默认是160倍，也就是虚拟节点数是物理节点数的160倍 -->
        <!-- <property name="weightMapFile">weightMapFile</property> 节点的权重，没有指定权重的节点默认是1。以properties文件的格式填写，以从0开始到count-1的整数值也就是节点索引为key，以节点权重值为值。所有权重值必须是正整数，否则以1代替 -->
        <!-- <property name="bucketMapPath">/etc/mycat/bucketMapPath</property>
            用于测试时观察各物理节点与虚拟节点的分布情况，如果指定了这个属性，会把虚拟节点的murmur hash值与物理节点的映射按行输出到这个文件，没有默认值，如果不指定，就不会输出任何东西 -->
    </function>

    <function name="crc32slot"
              class="io.mycat.route.function.PartitionByCRC32PreSlot">
        <property name="count">2</property><!-- 要分片的数据库节点数量，必须指定，否则没法分片 -->
    </function>
    <function name="hash-int"
        class="io.mycat.route.function.PartitionByFileMap">
        <property name="mapFile">partition-hash-int.txt</property>
    </function>
    <function name="hash-int-customer"
        class="io.mycat.route.function.PartitionByFileMap">
        <property name="mapFile">customer-hash-int.txt</property>
    </function>
    <function name="rang-long"
        class="io.mycat.route.function.AutoPartitionByLong">
        <property name="mapFile">autopartition-long.txt</property>
    </function>
    <function name="mod-long" class="io.mycat.route.function.PartitionByMod">
        <!-- how many data nodes -->
        <property name="count">2</property><!--根据集群切片数量设置 -->
    </function>

    <function name="func1" class="io.mycat.route.function.PartitionByLong">
        <property name="partitionCount">8</property>
        <property name="partitionLength">128</property>
    </function>
    <function name="latestMonth"
        class="io.mycat.route.function.LatestMonthPartion">
        <property name="splitOneDay">24</property>
    </function>
    <function name="partbymonth"
        class="io.mycat.route.function.PartitionByMonth">
        <property name="dateFormat">yyyy-MM-dd</property>
        <property name="sBeginDate">2015-01-01</property>
    </function>

    <function name="rang-mod" class="io.mycat.route.function.PartitionByRangeMod">
            <property name="mapFile">partition-range-mod.txt</property>
    </function>

    <function name="jump-consistent-hash" class="io.mycat.route.function.PartitionByJumpConsistentHash">
        <property name="totalBuckets">3</property>
    </function>
</mycat:rule>

5、分配mycat权限

chmod -R 777 ./*.sh

6、启动mycat

./startup-nowrap.sh

关闭:
ps -aux 找到PId，kill -9 pid

7、常用命令

查看mycat状态
./mycat status  //通常显示都是未启动，不用管

./mycat console  控制台信息 

mycat启动成功后，可以使用mysql客户端工具连接验证读写分片信息是否正确。

三、搭建HaProxy集群

HaProxy一主一备，实现高可用

1、开放端口，关闭selinux

3306 tpc/ip转发端口  4001 监控界面端口

2、安装haproxy

yum -y install haproxy
默认安装位置:/etc/haproxy/

3、修改配置文件

vi /etc/haproxy/haproxy.cfg

#---------------------------------------------------------------------
# Global settings
#---------------------------------------------------------------------
global
  log 127.0.0.1 local2 ##记日志的功能
  maxconn 4000       ##最大连接数，默认4000
  #chroot /usr/local/haproxy
  user root       #所属用户
  group root      #所属组
  daemon             ###创建1个进程进入deamon模式运行。此参数要求将运行模式设置为"daemon"

defaults
  log global         ###采用全局定义的日志
  option dontlognull    ###不记录健康检查的日志信息
  retries 3          ###3次连接失败就认为服务不可用，也可以通过后面设置
  option redispatch   ###serverId对应的服务器挂掉后,强制定向到其他健康的服务器
  maxconn 2000       ###最大连接数
  timeout connect 5000ms                   ##contimeout 5000    连接超时
  timeout client  50000ms                  ##clitimeout 50000   客户端连接超时
  timeout server  50000ms                  ##srvtimeout 50000   服务器连接超时
  ##listen admin_status 192.168.9.165:48800 ##VIP
  ##stats uri/admin-status #统计页面
  ##stats auth admin:admin
  mode http          ###默认的模式，tcp是4层，http是7层，health只会返回OK 若是混合模式则 mode 不需要设置
  option httplog     ###日志类别http日志格式 混合模式 此处还需要加上 tcplog 

  ## HAProxy的状态信息统计页面
listen admin_stats
  bind  0.0.0.0:4001  ## 绑定端口
  stats uri /dbs     ##统计页面
  stats auth admin:admin ## 设置统计页面认证的用户和密码，如果要设置多个，另起一行写入即可
  mode  http
  option     httplog    ## 启用日志记录HTTP请求

listen proxy_mysql
  bind 0.0.0.0:3306
  mode tcp
  option tcplog
  balance roundrobin
  server mycat_1 161.8.0.123:8066 check port 8066 weight 1 maxconn 2000
  server mycat_2 161.9.0.203:8066 check port 8066 weight 1 maxconn 2000
  option tcpka

4、常用命令

启动，关闭，重启,状态
service haproxy start /stop/restart /status

ps -ef | grep haproxy

启动成功后，使用mysql客户端工具连接进行验证

四、安装配置KeepAlived一主一备

1、开放协议及关闭selinux

firewall-cmd --direct --permanent --add-rule ipv4 filter INPUT 0 --protocol vrrp -j ACCEPT

firewall-cmd --reload

2、安装

安装
yum install -y keepalived

配置
vi /etc/keepalived/keepalievd.conf

启动
service keepalived start/stop/restart/status

3、配置文件

keepalived.conf:

vrrp_instance VI_1 {
    state MASTER
    interface ens33
    virtual_router_id 51
    priority 100
    advert_int 1
    authentication {
    auth_type PASS
    auth_pass 123456
    }
    virtual_ipaddress {
    161.9.0.205  #本网段地址
    }
}

启动成功后测试验证