Redis之——搭建高可用及负载均衡的Redis
Posted
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了Redis之——搭建高可用及负载均衡的Redis相关的知识，希望对你有一定的参考价值。
转载请注明出处：http://blog.csdn.net/l1028386804/article/details/52578080
之前，给大家介绍了一些关于Redis的文章，大家可以参见博文中有关Redis的文章。今天，我们就一起来学习如何搭建高可用及负载均衡的Redis，好了，不多说了，我们直接进入正题吧。
一、测试环境
1、机器
母机：centos6.5-64
虚拟机:centos6.5-64 单核 1G 独立ip 3个
虚拟机使用VMWare,centos为64位6.5.具体信息如下：
192.168.0.231 Redis-master 192.168.0.231 Redis-slave 192.168.0.239 Virtual IP
2、软件
Reidis
Keepalived
二、安装前配置
1、虚拟机最小化安装
虚拟机最小化安装，更新系统及安装必须组件
$ yum install -y openssl openssl-devel kernel kernel-devel gcc wget tcl libnl-devel $ yum upgrade $ reboot //重启系统
2、安装Keepalived
安装keepalived 下载地址:http://www.keepalived.org/software/keepalived-1.2.13.tar.gz 安装
$ wget http://www.keepalived.org/software/keepalived-1.2.13.tar.gz $ tar -zxvf keepalived-1.2.13.tar.gz $ cd keepalived-1.2.13 $ ln -s /usr/src/kernels/`uname -r`-`uname -m`/ /usr/src/linux $ ./configure --prefix=/usr/local/keepalived --sysconf=/etc $ chkconfig --add keepalived //查看是否成功 $ service keepalived status
3、安装redis
下载Redis,目前Redis的稳定版本是2.8.17，下载地址Redis-2.8.17
$ wget http://download.redis.io/releases/redis-2.8.17.tar.gz
$ tar -zxvf redis-2.8.17.tar.gz
$ cd redis-2.8.17
$ make && make test
$ mkdir -p /usr/local/redis/{bin,var,etc}
$ cp ./src/{redis-benchmark,redis-cli,redis-server,redis-check-dump,redis-check-aof} /usr/local/redis/bin/
$ cp /usr/local/redis/bin/* /usr/local/bin/
三、配置
1、Master配置
先配置好Redis，主从复制成功之后再行配置Keepalived。
Master-Redis配置
$ vim /usr/local/redis/etc/redis.conf
修改如下值
daemonize yes pidfile /var/run/redis.pid port 6379 tcp-backlog 511 timeout 0 tcp-keepalive 0 loglevel notice logfile "/usr/local/redis/log/redis.log" databases 16 save 900 1 save 300 10 save 60 10000 stop-writes-on-bgsave-error yes rdbcompression yes rdbchecksum yes dbfilename dump.rdb dir /usr/local/redis/data slave-serve-stale-data yes slave-read-only no repl-disable-tcp-nodelay no slave-priority 100 appendonly yes appendfilename "appendonly.aof" appendfsync everysec no-appendfsync-on-rewrite no auto-aof-rewrite-percentage 100 auto-aof-rewrite-min-size 64mb lua-time-limit 5000 slowlog-log-slower-than 10000 slowlog-max-len 128 notify-keyspace-events "" hash-max-ziplist-entries 512 hash-max-ziplist-value 64 list-max-ziplist-entries 512 list-max-ziplist-value 64 set-max-intset-entries 512 zset-max-ziplist-entries 128 zset-max-ziplist-value 64 activerehashing yes client-output-buffer-limit normal 0 0 0 client-output-buffer-limit slave 256mb 64mb 60 client-output-buffer-limit pubsub 32mb 8mb 60 hz 10 aof-rewrite-incremental-fsync yesMaster-Keepalived配置
global_defs {
router_id redis
}
vrrp_script chk_redis {
script "/etc/keepalived/scripts/redis_check.sh" ###监控脚本
interval 2 ###监控时间
timeout 2 ###超时时间
fall 3 ###重试次数
}
vrrp_instance redis {
state MASTER ###设置为MASTER
interface eth0 ###监控网卡
virtual_router_id 52
priority 101 ###权重值
authentication {
auth_type PASS ###加密
auth_pass redis ###密码
}
track_script {
chk_redis ###执行上面定义的chk_redis
}
virtual_ipaddress {
192.168.0.239 ###VIP
}
notify_master /etc/keepalived/scripts/redis_master.sh
notify_backup /etc/keepalived/scripts/redis_backup.sh
notify_fault /etc/keepalived/scripts/redis_fault.sh
notify_stop /etc/keepalived/scripts/redsi_stop.sh
}也可在本地编辑好后使用scp上传到服务器。 Master-keepalived脚本redis_master.sh:#!/bin/bash REDISCLI="/usr/local/redis/bin/redis-cli" LOGFILE="/usr/local/redis/var/keepalived-redis-state.log" echo "[master]" >> $LOGFILE date >> $LOGFILE echo "Being master...." >> $LOGFILE 2>&1 echo "Run SLAVEOF cmd ..." >> $LOGFILE $REDISCLI SLAVEOF 192.168.0.232 6379 >> $LOGFILE 2>&1 sleep 10 #延迟10秒以后待数据同步完成后再取消同步状态 echo "Run SLAVEOF NO ONE cmd ..." >> $LOGFILE $REDISCLI SLAVEOF NO ONE >> $LOGFILE 2>&1Master-keepalived脚本redis_backup.sh:
#!/bin/bash REDISCLI="/usr/local/redis/bin/redis-cli" LOGFILE="/usr/local/redis/log/keepalived-redis-state.log" echo "[backup]" >> $LOGFILE date >> $LOGFILE echo "Being slave...." >> $LOGFILE 2>&1 sleep 15 #延迟15秒待数据被对方同步完成之后再切换主从角色 echo "Run SLAVEOF cmd ..." >> $LOGFILE $REDISCLI SLAVEOF 192.168.0.232 6379 >> $LOGFILE 2>&1
2、Backup配置
同样先配置好Redis，主从复制成功之后再行配置Keepalived。
Backup-Redis配置
$ vim /usr/local/redis/etc/redis.conf修改如下值
daemonize yes pidfile /var/run/redis.pid port 6379 tcp-backlog 511 timeout 0 tcp-keepalive 0 loglevel notice logfile "/usr/local/redis/log/redis.log" databases 16 save 900 1 save 300 10 save 60 10000 stop-writes-on-bgsave-error yes rdbcompression yes rdbchecksum yes dbfilename dump.rdb dir /usr/local/redis/data slave-serve-stale-data yes slave-read-only no repl-disable-tcp-nodelay no slave-priority 100 appendonly yes appendfilename "appendonly.aof" appendfsync everysec no-appendfsync-on-rewrite no auto-aof-rewrite-percentage 100 auto-aof-rewrite-min-size 64mb lua-time-limit 5000 slowlog-log-slower-than 10000 slowlog-max-len 128 notify-keyspace-events "" hash-max-ziplist-entries 512 hash-max-ziplist-value 64 list-max-ziplist-entries 512 list-max-ziplist-value 64 set-max-intset-entries 512 zset-max-ziplist-entries 128 zset-max-ziplist-value 64 activerehashing yes client-output-buffer-limit normal 0 0 0 client-output-buffer-limit slave 256mb 64mb 60 client-output-buffer-limit pubsub 32mb 8mb 60 hz 10 aof-rewrite-incremental-fsync yes SLAVEOF 192.168.0.231 6379Backup-Keepalived配置
global_defs {
router_id redis
}
vrrp_script chk_redis {
script "/etc/keepalived/scripts/redis_check.sh" ###监控脚本
interval 2 ###监控时间
timeout 2 ###超时时间
fall 3 ###重试次数
}
vrrp_instance redis {
state BACKUP ###设置为MASTER
interface eth0 ###监控网卡
virtual_router_id 51
priority 100 ###权重值
authentication {
auth_type PASS ###加密
auth_pass redis ###密码
}
track_script {
chk_redis ###执行上面定义的chk_redis
}
virtual_ipaddress {
192.168.0.239 ###VIP
}
notify_master /etc/keepalived/scripts/redis_master.sh
notify_backup /etc/keepalived/scripts/redis_backup.sh
notify_fault /etc/keepalived/scripts/redis_fault.sh
notify_stop /etc/keepalived/scripts/redsi_stop.sh
}也可在本地编辑好后使用scp上传到服务器。 Master-keepalived脚本redis_master.sh:#!/bin/bash REDISCLI="/usr/local/redis/bin/redis-cli" LOGFILE="/usr/local/redis/var/keepalived-redis-state.log" echo "[master]" >> $LOGFILE date >> $LOGFILE echo "Being master...." >> $LOGFILE 2>&1 echo "Run SLAVEOF cmd ..." >> $LOGFILE $REDISCLI SLAVEOF 192.168.0.231 6379 >> $LOGFILE 2>&1 sleep 10 #延迟10秒以后待数据同步完成后再取消同步状态 echo "Run SLAVEOF NO ONE cmd ..." >> $LOGFILE $REDISCLI SLAVEOF NO ONE >> $LOGFILE 2>&1Master-keepalived脚本redis_backup.sh:
#!/bin/bash REDISCLI="/usr/local/redis/bin/redis-cli" LOGFILE="/usr/local/redis/log/keepalived-redis-state.log" echo "[backup]" >> $LOGFILE date >> $LOGFILE echo "Being slave...." >> $LOGFILE 2>&1 sleep 15 #延迟15秒待数据被对方同步完成之后再切换主从角色 echo "Run SLAVEOF cmd ..." >> $LOGFILE $REDISCLI SLAVEOF 192.168.0.231 6379 >> $LOGFILE 2>&1
四、公共脚本配置
1、redis_chekc.sh
可以使用netcat来检测redis服务的状态.
安装nc，使用nc检测redis的服务而不是ping
$ wget http://sourceforge.net/projects/netcat/files/netcat/0.7.1/netcat-0.7.1.tar.gz $ tar -zxvf netcat-0.7.1.tar.gz $ ./configure $ make && make install建立脚本:
$ vim /etc/keepalived/scripts/redis_check.sh脚本内容:
#!/bin/bash
ALIVE=`/usr/local/redis/bin/redis-cli PING`
if ["$ALIVE" == "PONG"] ;then
echo $ALIVE
exit 0
else
echo $ALIVE
exit 1
fi
2、redis_fault.sh
建立脚本:
$ vim /etc/keepalived/scripts/redis_fault.sh脚本内容:
# !/bin/bash LOGFILE=/usr/local/redis/var/keepalived-redis-state.log echo "[faule]" >> $LOGFILE date >> $LOGFILE
3、redis_stop.sh
建立脚本:
$ vim /etc/keepalived/scripts/redis_stop.sh脚本内容:
# !/bin/bash LOGFILE=/usr/local/redis/var/keepalived-redis-state.log echo "[stop]" >> $LOGFILE date >> $LOGFILE
五、测试
1、主从复制测试
先打开Master上的Redis，再打开Backup上的Redis，分别查看info
$ redis-cli infoMaster的rule显示master为正常，slave会显示为192.168.0.232
在Master上写入数据，在Backup读取
$ redis-cli set a hello //Master 写入数据 $ redis-cli get a //Backup 读取数据 "hello"主从复制正常。
2、主从切换测试
先后启动Master和Backup上的keepalived，在Master上查看vip
$ ip a
从图中可以看出vip已经绑定在Master上，现在通过vip来进行数据测试
$ redis-cli -h 192.168.0.239 set a test $ redis-cli -h 192.168.0.239 get a //测试虚拟ip数据读取 //在主机和从机上分别进行数据读取 $ redis-cli get a
从图中可以看出测试无问题。
现在关闭Master上的redis，来看VIP能否正常漂移，并进行数据测试。
$ killall -9 redis-server $ redis-cli -h 192.168.0.232 info
现在给redis写入数据，测试看Master恢复服务后能否正常恢复数据
$ redis-cli -h 192.168.0.239 set a nihao恢复Master上的Redis，查看ip a
$ service redis-server start $ ip a $ redis-cli get a
数据恢复，VIP切换回Master，Redis高可用环境搭建成功.
至此，已成功搭建高可用及负载均衡的Redis环境。
以上是关于Redis之——搭建高可用及负载均衡的Redis的主要内容，如果未能解决你的问题，请参考以下文章
keepalived+nginx搭建高可用and负载均衡集群