zabbix实现对mysql数据库主从监控

Posted

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了zabbix实现对mysql数据库主从监控相关的知识,希望对你有一定的参考价值。

技术图片

1.主从关系建立

配置mysql-master端:

1)修改mysql-master的配置文件

[[email protected] ~]# vim /etc/my.cnf
[mysqld]
server_id=1
innodb_file_per_table
datadir=/data/mysql
socket=/var/lib/mysql/mysql.sock
log-bin=/data/log-bin/bin
binlog_format=row
……

2)启动mysql服务,并授权从服务用户

[[email protected] ~]# systemctl start mariadb
[[email protected] ~]# systemctl enable mariadb

3)查看当前二进制日志位置

MariaDB [(none)]> show master logs;
+------------+-----------+
| Log_name   | File_size |
+------------+-----------+
| bin.000001 |      307 |

4)授予从服务用户权限

MariaDB [(none)]> grant REPLICATION CLIENT on *.* to [email protected]‘192.168.1.16‘ identified by ‘slave‘;

5)刷新权限

MariaDB [(none)]> flush privileges;

配置mysql-slave端:

1)修改从服务mysql-slave的数据库配置文件

[[email protected] ~]# vim /etc/my.cnf
[mysqld]
server_id=2
read_only
innodb_file_per_table
datadir=/data/mysql
socket=/var/lib/mysql/mysql.sock

2)登入数据库,建立组从连接

MariaDB [(none)]> change master to  
master_host=‘192.168.1.15‘,
master_user=‘slave‘, 
master_password=‘slave‘, 
master_log_file=‘bin.000001‘, 
master_log_pos=307;

3)启动主从连接

MariaDB [(none)]> start slave;

4)查看主从连接是否成功

ariaDB [(none)]> show slave status\G;
*************************** 1. row ***************************
                             Slave_IO_State: Waiting for master to send event
                                    Master_Host: 192.168.1.15
                                    Master_User: slave
                                    Master_Port: 3306
                                Connect_Retry: 60
                            Master_Log_File: bin.000003
                    Read_Master_Log_Pos: 321
                             Relay_Log_File: mariadb-relay-bin.000018
                                Relay_Log_Pos: 531
                Relay_Master_Log_File: bin.000003
                         Slave_IO_Running: Yes     #两个io进程启动,主从连接启动
                        Slave_SQL_Running: Yes
                            Replicate_Do_DB: 
                    Replicate_Ignore_DB: 
                     Replicate_Do_Table: 
             Replicate_Ignore_Table: 
            Replicate_Wild_Do_Table: 
    Replicate_Wild_Ignore_Table: 
                                     Last_Errno: 0
                                     Last_Error: 
                                 Skip_Counter: 0
                    Exec_Master_Log_Pos: 321
                            Relay_Log_Space: 1113
                            Until_Condition: None
                             Until_Log_File: 
                                Until_Log_Pos: 0
                     Master_SSL_Allowed: No
                     Master_SSL_CA_File: 
                     Master_SSL_CA_Path: 
                            Master_SSL_Cert: 
                        Master_SSL_Cipher: 
                             Master_SSL_Key: 
                Seconds_Behind_Master: 0   #主从同步数据延迟
Master_SSL_Verify_Server_Cert: No
                                Last_IO_Errno: 0
                                Last_IO_Error: 
                             Last_SQL_Errno: 0
                             Last_SQL_Error: 
    Replicate_Ignore_Server_Ids: 
                         Master_Server_Id: 1
                             Master_SSL_Crl: 
                     Master_SSL_Crlpath: 
                                     Using_Gtid: No
                                    Gtid_IO_Pos: 
            Replicate_Do_Domain_Ids: 
    Replicate_Ignore_Domain_Ids: 
                                Parallel_Mode: conservative

2.在从服务端mysql-slave配置zabbix-agent代理客户端(centos7.6)

1)安装zabbix-agent客户端

[email protected] percona-zabbix-tools]# yum install zabbix-agent -y

2)修改agent配置文件

[[email protected] ~]# vim /etc/zabbix/zabbix_agentd.conf 
EnableRemoteCommands=1 #允许远程命令
Server=192.168.1.14,192.168.1.20  #必须都指定监控服务端和proxy代理服务端的ip,否则会导致监控端或proxy代理端无法zabbix_get key值
ServerActive=192.168.1.20 #主动模式下的代理地址
Hostname=192.168.1.16 #为方便区分主机名改为本机的ip地址
Include=/etc/zabbix/zabbix_agentd.d/*.conf #包含的子目录
UnsafeUserParameters=1 #允许参数中的所有字符传递给用户定义的参数

3)下载percona-zabbix监控mysql数据库包

https://www.percona.com/downloads/percona-monitoring-plugins/LATEST/ #percona-zabbix官网地址
[[email protected] percona-zabbix-tools]# wget https://www.percona.com/downloads/percona-monitoring-plugins/percona-monitoring-plugins-1.1.8/binary/redhat/7/x86_64/percona-zabbix-templates-1.1.8-1.noarch.rpm

4)查看安装的percona-zabbix-templates生成的列表

[[email protected] percona-zabbix-tools]# rpm -ql percona-zabbix-templates
/var/lib/zabbix/percona
/var/lib/zabbix/percona/scripts
/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh
/var/lib/zabbix/percona/scripts/ss_get_mysql_stats.php
/var/lib/zabbix/percona/templates
/var/lib/zabbix/percona/templates/userparameter_percona_mysql.conf
/var/lib/zabbix/percona/templates/zabbix_agent_template_percona_mysql_server_ht_2.0.9-sver1.1.8.xml

5)将percona的配置文件复制到/etc/zabbix/zabbix_agentd.d/目录下

[[email protected] ~]#cp /var/lib/zabbix/percona/templates/userparameter_percona_mysql.conf /etc/zabbix/zabbix_agentd.d/

6)percona配置文件里保存的全是获取mysql数据库监控项的key

[[email protected] ~]# cat /etc/zabbix/zabbix_agentd.d/userparameter_percona_mysql.conf
UserParameter=MySQL.Com-select,/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh jx
UserParameter=MySQL.Qcache-total-blocks,/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh js
UserParameter=MySQL.Handler-read-prev,/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh mt
UserParameter=MySQL.Sort-rows,/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh ks
UserParameter=MySQL.Qcache-free-memory,/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh jm
UserParameter=MySQL.pages-read,/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh gu
…..
UserParameter=MySQL.Key-read-requests,/var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh gg

7)查看/etc/zabbix/zabbix_agentd.d/目录下的配置文件

[[email protected] ~]# ls /etc/zabbix/zabbix_agentd.d/
userparameter_mysql.conf  userparameter_percona_mysql.conf

8)删除userparameter_mysql.conf 配置文件,为agent自带的配置文件,避免配置冲突

[[email protected] ~]# rm /etc/zabbix/zabbix_agentd.d/userparameter_mysql.conf

9)配置php环境

[[email protected] ~]#yum install php php-mysql -y

10)php连接本地数据库配置

[[email protected] ~]# vim /var/lib/zabbix/percona/scripts/ss_get_mysql_stats.php.cnf
<?php
$mysql_user = ‘root‘;
$mysql_pass = ‘‘;  #没有设置密码就为空

11)启动zabbix-agent服务

[[email protected] ~]# systemctl restart zabbix-agent

12)测试与本地数据库的连接,若不能获取数字,说明没有装PHP环境或者上一步配置的数据库密码不对

[[email protected] ~]# /var/lib/zabbix/percona/scripts/get_mysql_stats_wrapper.sh gg
4

13)当上一步测试通过后,会自动生成localhost-mysql_cacti_stats.txt文件,记录了mysql当前运行状态的数据信息

[[[email protected] ~]# cat /tmp/localhost-mysql_cacti_stats.txt 
gg:4 gh:2 gi:2 gj:2 gk:5 gl:2832 gm:0 gn:3 go:0 gp:0 gq:8191 gr:8028 gs:163 gt:0 gu:157 gv:6 gw:27 gx:24 gy:175 gz:43 hg:18 hh:0 hi:0 hj:0 hk:-1 hl:0 hm:0 hn:-1 ho:0 hp:0 hq:0 hr:0 hs:0 ht:836 hu:1208 hv:11 hw:0 hx:0 hy:0 hz:0 ig:0 ih:35 ii:0 ij:29 ik:11 il:17 im:431 in:1024 io:431 ip:0 iq:0 ir:1 is:0 it:0 iu:1 iv:2 iw:1 ix:151 iy:0 iz:6 jg:0 jh:0 ji:0 jj:0 jk:0 jl:1 jm:1031336 jn:0 jo:0 jp:0 jq:0 jr:0 js:1 jt:1048576 ju:8 jv:0 jw:0 jx:1 jy:0 jz:0 kg:0 kh:0 ki:0 kj:0 kk:0 kl:0 km:0 kn:0 ko:0 kp:2 kq:0 kr:0 ks:0 kt:0 ku:2 kv:0 kw:6 kx:4886 ky:2250 kz:16777216 lg:0 lh:1632681 li:1632681 lj:1269 lk:32768 ll:0 lm:0 ln:-1 lo:0 lp:0 lq:0 lr:0 ls:0 lt:0 lu:1 lv:0 lw:0 lx:0 ly:0 lz:0 mg:0 mh:0 mi:0 mj:0 mk:0 ml:2 mm:3 mn:1 mo:0 mp:0 mq:5 mr:2 ms:0 mt:0 mu:0 mv:42 mw:0 mx:0 my:0 mz:0 ng:4 nh:0 ni:0 nj:-1 nk:-1 nl:-1 nm:-1 nn:0 no:1 np:0 nq:2 nr:2217568 ns:139112 nt:645374 nu:817696 nv:333952 nw:0 nx:-1 ny:-1 nz:-1 og:0 oh:24484864 oi:134217728 oj:0 ok:0 ol:-1 om:-1 on:-1 oo:-1 op:-1 oq:-1 or:-1 os:-1 ot:-1 ou:-1 ov:-1 ow:-1 ox:-1 oy:-1 oz:-1 pg:-1 ph:-1 pi:-1 pj:-1 pk:-1 pl:-1 pm:-1 pn:-1 po:-1 pp:-1 pq:-1 pr:-1 ps:-1 pt:-1 pu:-1 pv:-1 pw:-1 px:-1 py:0 pz:-1 qg:-1 qh:0 qi:-1 qj:-1 qk:-1 ql:-1 qm:-1 qn:-1 qo:158 qp:676

14)必须删除localhost-mysql_cacti_stats.txt文件,在本地自动生成的此文件权限为root,否则在server端将无权限获取mysql中的数据

[email protected] ~]# ll /tmp/localhost-mysql_cacti_stats.txt
-rw-r--r-- 1 root root 1228 Jul 15 23:52 /tmp/localhost-mysql_cacti_stats.txt

15)将其删除

[email protected] ~]#rm -rf  /tmp/localhost-mysql_cacti_stats.txt

3.在zabbix-server监控服务端创建zabbix-proxy的数据库,和授权用户

1)创建zabbix-proxy服务端的数据库

MariaDB [(none)]> create database zabbix_proxy_active character set utf8 collate utf8_bin;

2)创建zabbix-proxy服务端的数据库授权用户

MariaDB [(none)]> grant all privileges on zabbix_proxy_active.* to [email protected] identified by ‘zabbix_proxy_active‘;

3)查看创建的zabbix-proxy服务端数据库

MariaDB [(none)]> show databases;
+---------------------+
| Database            |
+---------------------+
| information_schema  |
| mysql               |
| performance_schema  |
| zabbix              |
| zabbix_proxy_active |
+---------------------+
5 rows in set (0.04 sec)

4)权限刷新

MariaDB [(none)]> flush privileges;
Query OK, 0 rows affected (0.00 sec)

5)查看授权用户所拥有的权限

MariaDB [(none)]> show grants for [email protected]‘192.168.1.20‘;
+-------------------------------------------------------------------------------------------------------------------------------+
| Grants for [email protected]                                                                                   |
+-------------------------------------------------------------------------------------------------------------------------------+
| GRANT USAGE ON *.* TO ‘zabbix_proxy_active‘@‘192.168.1.20‘ IDENTIFIED BY PASSWORD ‘*A63355661598C0599A07E41CE45344B7131CDF89‘ |
| GRANT ALL PRIVILEGES ON `zabbix_proxy_active`.* TO ‘zabbix_proxy_active‘@‘192.168.1.20‘                                       |
+-------------------------------------------------------------------------------------------------------------------------------+

4.在zabbix-proxy代理服务端进行配置(ubuntu系统18.4)

1)配置好仓库源

[email protected]:~# wget https://repo.zabbix.com/zabbix/4.0/debian/pool/main/z/zabbix-release/zabbix-release_4.0-2+stretch_all.deb
[email protected]:~# dpkg -i zabbix-release_4.0-2+stretch_all.deb
[email protected]:~# apt update

2)下载安装proxy代理软件

[email protected]:~# apt install zabbix-proxy-mysql -y

3)安装zabbix_get测试命令包

[email protected]:~# apt install zabbix-get -y

4)查看安装好的zabbix-proxy-mysql

[email protected]:~# dpkg -l | grep zabbix
ii  zabbix-get                            1:4.0.10-1+bionic                 amd64        Zabbix network monitoring solution - get
ii  zabbix-proxy-mysql                    1:4.0.10-1+bionic                 amd64        Zabbix network monitoring solution - proxy (MySQL)
ii  zabbix-release                        1:4.0-2+bionic                    all          Zabbix official repository configuration

5)测试是否能够访问zabbix-proxy的数据库

[email protected]:~# mysql -uzabbix_proxy_active -pzabbix_proxy_active -h192.168.1.14
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 58
Server version: 10.1.40-MariaDB-0ubuntu0.18.04.1 Ubuntu 18.04

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type ‘help;‘ or ‘\h‘ for help. Type ‘\c‘ to clear the current input statement.

MariaDB [(none)]>
MariaDB [(none)]> show databases;
+---------------------+
| Database            |
+---------------------+
| information_schema  |
| zabbix_proxy_active |     #可以看到此数据库
+---------------------+
2 rows in set (0.00 sec)

6)返回shell的命令行初始化zabbix-proxy服务端的数据库

[email protected]:~# zcat /usr/share/doc/zabbix-proxy-mysql/schema.sql.gz | 
mysql -uzabbix_proxy_active -pzabbix_proxy_active -h192.168.1.14 zabbix_proxy_active

7)在查看数据库,zabbix-proxy的数据中是否导入表格

[email protected]:~# mysql -uzabbix_proxy_active -pzabbix_proxy_active -h192.168.1.14
MariaDB [(none)]> use zabbix_proxy_active;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
MariaDB [zabbix_proxy_active]> show tables;
……
| task_acknowledge              |
| task_check_now                |
| task_close_problem            |
| task_remote_command           |
| task_remote_command_result    |
| timeperiods                   |
| trends                        |
| trends_uint                   |
| trigger_depends               |
| trigger_discovery             |
| trigger_tag                   |
| triggers                      |
| users                         |
| users_groups                  |
| usrgrp                        |
| valuemaps                     |
| widget                        |
| widget_field                  |
+-------------------------------+
144 rows in set (0.00 sec)

8)修改proxy代理服务的配置文件

[email protected]:~# grep ‘^[a-Z]‘ /etc/zabbix/zabbix_proxy.conf 
ProxyMode=0   #0表示开启主动模式
Server=192.168.1.14  #服务端的ip地址
Hostname=zabbix_proxy_active  #proxy代理主机名,在web端添加此代理是必须与此处主机名相同
ListenPort=10051  #proxy监听的端口
LogFileSize=0 #关闭日志自动轮换
DBHost=192.168.1.14 #数据库主机
DBName=zabbix_proxy_active   #数据库名
DBUser=zabbix_proxy_active   #数据库用户
DBPassword=zabbix_proxy_active   #数据库密码
ProxyLocalBuffer=24  #数据访问服务端后,本地保存数据时间为720小时
ProxyOfflineBuffer=24  #未提交数据到服务端,本地保存数据的时间为720小时
ConfigFrequency=10  #间隔多久到服务端获取监控项信息,默认3600秒
DataSenderFrequency=5 #数据发送时间间隔,默认为1秒
CacheSize=2G #保存监控项的最大内存,默认为8M
HistoryCacheSize=2G #保存监控历史数据的最大内存,默认为16M
Timeout=30 #监控项超时时间,单位秒
LogSlowQueries=3000  #多久的数据库查询会被记录到日志,单位毫秒

9)重新启动proxy服务,载入配置好的配置文件

[email protected]:~# systemctl restart zabbix-proxy
[email protected]:~# systemctl enable zabbix-proxy

10)查看proxy是否启动

● zabbix-proxy.service - Zabbix Proxy
     Loaded: loaded (/lib/systemd/system/zabbix-proxy.service; disabled; vendor preset: enabled)
     Active: active (running) since Tue 2019-07-16 18:06:43 CST; 2h 36min ago
    Process: 4514 ExecStop=/bin/kill -SIGTERM $MAINPID (code=exited, status=0/SUCCESS)
    Process: 4515 ExecStart=/usr/sbin/zabbix_proxy -c $CONFFILE (code=exited, status=0/SUCCESS)
 Main PID: 4527 (zabbix_proxy)
        Tasks: 25 (limit: 2293)
     CGroup: /system.slice/zabbix-proxy.service
                     ├─4527 /usr/sbin/zabbix_proxy -c /etc/zabbix/zabbix_proxy.conf
                     ├─4531 /usr/sbin/zabbix_proxy: configuration syncer [synced config 4069 bytes in 0.056334 sec, idle 3600 sec]
                     ├─4532 /usr/sbin/zabbix_proxy: heartbeat sender [sending heartbeat message success in 0.001186 sec, idle 60 sec]
                     ├─4533 /usr/sbin/zabbix_proxy: data sender [sent 0 values in 0.014112 sec, idle 1 sec]
                     ├─4534 /usr/sbin/zabbix_proxy: housekeeper [deleted 1454 records in 0.135417 sec, idle for 1 hour(s)]
                     ├─4535 /usr/sbin/zabbix_proxy: http poller #1 [got 0 values in 0.003211 sec, idle 5 sec]
……

5.在zabbix-server端配置

1)在web端添加proxy代理

技术图片
技术图片

2)web端创建mysql-slave从服务主机并添加代理

技术图片

3)添加一个mysql模板

技术图片

4)监控服务端命令行测试,获取msyql数据库key的值,能够获取值,则证明监控端与被监控端成功建立连接

[email protected]:~# zabbix_get -s 192.168.1.16 -p 10050 -k MySQL.Key-read-requests
4
[email protected]:~# zabbix_get -s 192.168.1.16 -p 10050 -k MySQL.Qcache-free-memory
1031336

5)web端查看成功添加被监控的mysql从服务

技术图片

6)在mysql从服务端查看到新生成的localhost-mysql_cacti_stats.txt文件是有监控服务端创建的,且属主和属组都为zabbix

[[email protected] ~]# ll  /tmp/localhost-mysql_cacti_stats.txt
-rw-rw-r-- 1 zabbix zabbix 1235 Jul 16 01:00 /tmp/localhost-mysql_cacti_stats.txt

6.创建自定义mysql主从监控模板、监控项

在mysql-slave端:

1)编写自定义监控脚本

[[email protected] ~]# vim /etc/zabbix/zabbix_agentd.d/mysql_monitor.sh
    #!/bin/bash
    master_slave_check()
    num1=`mysql -uroot -e "show slave status\G" | grep "Slave_IO_Running" | awk -F":" ‘print $2‘`
    num2=`mysql -uroot -e "show slave status\G" | grep "Slave_SQL_Running" | awk -F":" ‘print $2‘`
    if test $num1 == "Yes" && test $num2 == "Yes";then
    echo 60
    else
    echo 120
    fi
    
    mysql_sync_delay()
    num=`mysql -uroot -e "show slave status\G" | grep "Seconds_Behind_Master" | awk -F":" ‘print $2‘`
    echo $num
    

    menu()
    case $1 in  
        master_slave_check)
        master_slave_check
        ;;
        mysql_sync_delay)  

    mysql_sync_delay
    ;;
esac

menu $1

2)编写自定义监控项的配置文件,含有监控项的键值

[[email protected] ~]# vim /etc/zabbix/zabbix_agentd.d/mysql-master-slave.conf 
UserParameter=mysql_test[*],/etc/zabbix/zabbix_agentd.d/mysql_monitor.sh $1

3)脚本加上执行权限,避免在monitor-server端无权限获取key的值

[[email protected] ~]# chmod a+x  mysql_monitor.sh

4)重新启动本机的agent服务

 [[email protected] ~]# systemctl restart zabbix-agent

在zabbix-proxy服务端测试,是否能获取被监控端mysql-slave服务的key的值

[email protected]:~#  zabbix_get -s 192.168.1.16 -p 10050 -k "mysql_test[mysql_sync_delay]"
0
[email protected]:~# zabbix_get -s 192.168.1.16 -p 10050 -k "mysql_test[master_slave_check]"
60

在zabbix-server端先执行测试,是否能获取被监控端的key的值

1)利用zabbix-get命令测试

[email protected]:~# zabbix_get -s 192.168.1.16 -p 10050 -k "mysql_test[mysql_sync_delay]"
0
[email protected]:~# zabbix_get -s 192.168.1.16 -p 10050 -k "mysql_test[master_slave_check]"
60

2)当将mysql-slave服务停止,可以看到显示的数值为120,证明mysql-slave服务已断开

[email protected]:~# zabbix_get -s 192.168.1.16 -p 10050 -k "mysql_test[master_slave_check]"
120

3)在监控web端进行模板创建

技术图片

4)给此模板创建一个应用集,是用来给监控项分类

技术图片

5)在应用集中添加监控项

技术图片
技术图片

6)添加触发的动作,当数值大于65证明连接失败

技术图片
技术图片

7)给指定监控项创建图形显示

技术图片

8)将自定义创建好的模板添加到需要监控的mysql-slave主机

技术图片

9)再查看mysql-slave主机图形,红色为警戒线,绿色为正常

技术图片

10)当mysql-slave服务挂掉时在查看此图,获取的数值已经超过红色警戒线,证明主从连接断开,已挂

技术图片

11)仪表盘出现报警故障信息

技术图片

12)进入报警查看详情

技术图片

13)显示报警详细内容

技术图片

14)点击不

技术图片

15)问题解决后关闭报警通知

技术图片

16)仪表盘恢复正常

技术图片

17)再查看图形,以已下降到警戒线之下,恢复正常,主从已连接

技术图片

以上是关于zabbix实现对mysql数据库主从监控的主要内容,如果未能解决你的问题,请参考以下文章

zabbix实现对mysql数据库主从监控

zabbix监控mysql主从同步

Zabbix监控mysql主从

zabbix监控mysql主从

zabbix监控云端mysql等实例。

zabbix监控Mysql主从状态