MHA+ProxySQL实现读写分离高可用
Posted Atlas
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了MHA+ProxySQL实现读写分离高可用相关的知识，希望对你有一定的参考价值。
最近在研究ProxySQL，觉得还挺不错的，所以就简单的折腾了一下，ProxySQL目前也是Percona在推荐的一个读写分离的中间件。关于详细的介绍可以参考官方文档。https://github.com/sysown/proxysql/wiki
本文主要介绍的是MHA+ProxySQL读写分离以及高可用，ProxySQL的细节请参考文档，目前已经有人写的非常详细了，文章最后会给出链接。当然和Group Replication，PXC搭配那是更完美的。关于MHA的配置参考我前面的文章，本文就不再介绍。下面来看看
MHA和ProxySQL搭配使用的架构图：
测试环境（1主2从）：
M-> 192.168.0.20 S1-> 192.168.0.30 S2-> 192.168.0.40 proxysql -> 192.168.0.10
1. 检查主从复制是否正常：
[root@db_server_yayun_04 ~]# masterha_check_repl --conf=/data/mha/3306/mha.cnf Thu Jun 15 17:45:32 2017 - [warning] Global configuration file /etc/masterha_default.cnf not found. Skipping. Thu Jun 15 17:45:32 2017 - [info] Reading application default configuration from /data/mha/3306/mha.cnf.. Thu Jun 15 17:45:32 2017 - [info] Updating application default configuration from /usr/local/bin/load_cnf.. Thu Jun 15 17:45:32 2017 - [info] Reading server configuration from /data/mha/3306/mha.cnf.. Thu Jun 15 17:45:32 2017 - [info] Setting max_ping_errors to 10, ping_interval to 3. Thu Jun 15 17:45:32 2017 - [info] MHA::MasterMonitor version 0.57. Thu Jun 15 17:45:32 2017 - [info] GTID failover mode = 1 Thu Jun 15 17:45:32 2017 - [info] Dead Servers: Thu Jun 15 17:45:32 2017 - [info] Alive Servers: Thu Jun 15 17:45:32 2017 - [info] 192.168.0.20(192.168.0.20:3306) Thu Jun 15 17:45:32 2017 - [info] 192.168.0.30(192.168.0.30:3306) Thu Jun 15 17:45:32 2017 - [info] 192.168.0.40(192.168.0.40:3306) Thu Jun 15 17:45:32 2017 - [info] Alive Slaves: Thu Jun 15 17:45:32 2017 - [info] 192.168.0.30(192.168.0.30:3306) Version=5.7.17-log (oldest major version between slaves) log-bin:enabled Thu Jun 15 17:45:32 2017 - [info] GTID ON Thu Jun 15 17:45:32 2017 - [info] Replicating from 192.168.0.20(192.168.0.20:3306) Thu Jun 15 17:45:32 2017 - [info] Primary candidate for the new Master (candidate_master is set) Thu Jun 15 17:45:32 2017 - [info] 192.168.0.40(192.168.0.40:3306) Version=5.7.17-log (oldest major version between slaves) log-bin:enabled Thu Jun 15 17:45:32 2017 - [info] GTID ON Thu Jun 15 17:45:32 2017 - [info] Replicating from 192.168.0.20(192.168.0.20:3306) Thu Jun 15 17:45:32 2017 - [info] Primary candidate for the new Master (candidate_master is set) Thu Jun 15 17:45:32 2017 - [info] Current Alive Master: 192.168.0.20(192.168.0.20:3306) Thu Jun 15 17:45:32 2017 - [info] Checking slave configurations.. Thu Jun 15 17:45:32 2017 - [info] Checking replication filtering settings.. Thu Jun 15 17:45:32 2017 - [info] binlog_do_db= , binlog_ignore_db= Thu Jun 15 17:45:32 2017 - [info] Replication filtering check ok. Thu Jun 15 17:45:32 2017 - [info] GTID (with auto-pos) is supported. Skipping all SSH and Node package checking. Thu Jun 15 17:45:32 2017 - [info] Checking SSH publickey authentication settings on the current master.. Thu Jun 15 17:45:33 2017 - [info] HealthCheck: SSH to 192.168.0.20 is reachable. Thu Jun 15 17:45:33 2017 - [info] 192.168.0.20(192.168.0.20:3306) (current master) +--192.168.0.30(192.168.0.30:3306) +--192.168.0.40(192.168.0.40:3306) Thu Jun 15 17:45:33 2017 - [info] Checking replication health on 192.168.0.30.. Thu Jun 15 17:45:33 2017 - [info] ok. Thu Jun 15 17:45:33 2017 - [info] Checking replication health on 192.168.0.40.. Thu Jun 15 17:45:33 2017 - [info] ok. Thu Jun 15 17:45:33 2017 - [warning] master_ip_failover_script is not defined. Thu Jun 15 17:45:33 2017 - [warning] shutdown_script is not defined. Thu Jun 15 17:45:33 2017 - [info] Got exit code 0 (Not master dead). mysql Replication Health is OK. [root@db_server_yayun_04 ~]#
2. 配置后端MySQL。登入ProxySQL，把MySQL主从的信息添加进去。将主库master也就是做写入的节点放到HG 100中，salve节点做读放到HG 1000。在proxysql输入命令：
mysql -uadmin -padmin -h127.0.0.1 -P6032
[admin@127.0.0.1][(none)]> insert into mysql_servers(hostgroup_id,hostname,port,weight,max_connections,max_replication_lag,comment) values(100,\'192.168.0.20\',3306,1,1000,10,\'test my proxysql\'); Query OK, 1 row affected (0.00 sec) [admin@127.0.0.1][(none)]> insert into mysql_servers(hostgroup_id,hostname,port,weight,max_connections,max_replication_lag,comment) values(1000,\'192.168.0.30\',3306,1,1000,10,\'test my proxysql\'); Query OK, 1 row affected (0.00 sec) [admin@127.0.0.1][(none)]> insert into mysql_servers(hostgroup_id,hostname,port,weight,max_connections,max_replication_lag,comment) values(1000,\'192.168.0.40\',3306,1,1000,10,\'test my proxysql\'); Query OK, 1 row affected (0.00 sec) [admin@127.0.0.1][(none)]> select * from mysql_servers; +--------------+--------------+------+--------+--------+-------------+-----------------+---------------------+---------+----------------+------------------+ | hostgroup_id | hostname | port | status | weight | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment | +--------------+--------------+------+--------+--------+-------------+-----------------+---------------------+---------+----------------+------------------+ | 100 | 192.168.0.20 | 3306 | ONLINE | 1 | 0 | 1000 | 10 | 0 | 0 | test my proxysql | | 1000 | 192.168.0.30 | 3306 | ONLINE | 1 | 0 | 1000 | 10 | 0 | 0 | test my proxysql | | 1000 | 192.168.0.40 | 3306 | ONLINE | 1 | 0 | 1000 | 10 | 0 | 0 | test my proxysql | +--------------+--------------+------+--------+--------+-------------+-----------------+---------------------+---------+----------------+------------------+ 3 rows in set (0.00 sec)
3. 配置后端MySQL用户。这个用户需要先在后端MySQL(20,30,40)里真实存在，一个是监控账号、一个是程序账号。
(1) 监控账号（用来监控后端mysql是否存活以及read_only变量）：
GRANT SUPER, REPLICATION CLIENT ON *.* TO \'proxysql\'@\'192.168.0.10\' IDENTIFIED BY \'proxysql\';
(2) 程序账号（这里为了后面测试方便给了all权限）：
GRANT all ON *.* TO \'yayun\'@\'192.168.0.10\' identified by \'yayun\';
4. 在后端MySQL里添加完之后再配置ProxySQL：这里需要注意，default_hostgroup需要和上面的对应。（proxysql）
[admin@127.0.0.1][(none)]> insert into mysql_users(username,password,active,default_hostgroup,transaction_persistent) values(\'yayun\',\'yayun\',1,100,1); Query OK, 1 row affected (0.00 sec) [admin@127.0.0.1][(none)]> select * from mysql_users; +----------+----------+--------+---------+-------------------+----------------+---------------+------------------------+--------------+---------+----------+-----------------+ | username | password | active | use_ssl | default_hostgroup | default_schema | schema_locked | transaction_persistent | fast_forward | backend | frontend | max_connections | +----------+----------+--------+---------+-------------------+----------------+---------------+------------------------+--------------+---------+----------+-----------------+ | yayun | yayun | 1 | 0 | 100 | NULL | 0 | 1 | 0 | 1 | 1 | 10000 | +----------+----------+--------+---------+-------------------+----------------+---------------+------------------------+--------------+---------+----------+-----------------+ 1 row in set (0.00 sec) [admin@127.0.0.1][(none)]>
5. 设置健康监测账号（proxysql）：
[admin@127.0.0.1][(none)]> set mysql-monitor_username=\'proxysql\'; Query OK, 1 row affected (0.00 sec) [admin@127.0.0.1][(none)]> set mysql-monitor_password=\'proxysql\'; Query OK, 1 row affected (0.00 sec) [admin@127.0.0.1][(none)]>
6. 加载配置和变量：因为修改了servers、users和variables，所以加载的时候要执行：
[admin@127.0.0.1][(none)]> load mysql servers to runtime; Query OK, 0 rows affected (0.01 sec) [admin@127.0.0.1][(none)]> load mysql users to runtime; Query OK, 0 rows affected (0.00 sec) [admin@127.0.0.1][(none)]> load mysql variables to runtime; Query OK, 0 rows affected (0.00 sec) [admin@127.0.0.1][(none)]> save mysql servers to disk; Query OK, 0 rows affected (0.05 sec) [admin@127.0.0.1][(none)]> save mysql users to disk; Query OK, 0 rows affected (0.02 sec) [admin@127.0.0.1][(none)]> save mysql variables to disk; Query OK, 74 rows affected (0.01 sec) [admin@127.0.0.1][(none)]>
7. 连接数据库，通过proxysql的客户端接口访问(6033)：(我这里从40从库上面发起连接)
mysql -uyayun -pyayun -h192.168.0.10 -P6033
[root@db_server_yayun_04 ~]# mysql -uyayun -pyayun -h192.168.0.10 -P6033 mysql: [Warning] Using a password on the command line interface can be insecure. Welcome to the MySQL monitor. Commands end with ; or \\g. Your MySQL connection id is 4 Server version: 5.5.30 (ProxySQL) Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type \'help;\' or \'\\h\' for help. Type \'\\c\' to clear the current input statement. [yayun@192.168.0.10][(none)]> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | performance_schema | | sys | | yayun | +--------------------+ 5 rows in set (0.01 sec) [yayun@192.168.0.10][(none)]>
8. 创建表并且写入数据进行查询：
[yayun@192.168.0.10][(none)]> use yayun Database changed, 2 warnings [yayun@192.168.0.10][yayun]> create table t1 ( id int); Query OK, 0 rows affected (0.08 sec) [yayun@192.168.0.10][yayun]> insert into t1 select 1; Query OK, 1 row affected (0.05 sec) Records: 1 Duplicates: 0 Warnings: 0 [yayun@192.168.0.10][yayun]> select * from t1; +------+ | id | +------+ | 1 | +------+ 1 row in set (0.00 sec) [yayun@192.168.0.10][yayun]>
可以看到创建了表，并且插入了数据，查询也没问题。proxysql有个类似审计的功能，可以查看各类SQL的执行情况。在proxysql执行SQL查看。
[admin@127.0.0.1][(none)]> select * from stats_mysql_query_digest; +-----------+--------------------+----------+--------------------+----------------------------------+------------+------------+------------+----------+----------+----------+ | hostgroup | schemaname | username | digest | digest_text | count_star | first_seen | last_seen | sum_time | min_time | max_time | +-----------+--------------------+----------+--------------------+----------------------------------+------------+------------+------------+----------+----------+----------+ | 100 | yayun | yayun | 0xA9518ABEA63705E6 | create table t1 ( id int) | 1 | 1497577980 | 1497577980 | 79733 | 79733 | 79733 | | 100 | yayun | yayun | 0x3765930C7143F468 | select * from t1 | 1 | 1497577997 | 1497577997 | 1537 | 1537 | 1537 | | 100 | yayun | yayun | 0x4BBB5CD4BC2CFD94 | insert into t1 select ? | 1 | 1497577986 | 1497577986 | 33350 | 33350 | 33350 | | 100 | information_schema | yayun | 0x620B328FE9D6D71A 如何利用MHA+ProxySQL实现读写分离和负载均衡MySQL 之 MHA + ProxySQL + keepalived 实现读写分离，高可用