RocketMq安装
Posted happydreamzjl
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了RocketMq安装相关的知识,希望对你有一定的参考价值。
一、安装
1、下载
下载地址:http://rocketmq.apache.org/release_notes/
执行命令:wget http://mirrors.tuna.tsinghua.edu.cn/apache/rocketmq/4.6.0/rocketmq-all-4.6.0-bin-release.zip
unzip rocketmq-all-4.6.0-bin-release.zip
下载完解压可用
带source字样的需要自己下载maven编译。
二、配置
1、配置文件解析
# Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. #brokerClusterName=DefaultCluster #brokerName=broker-a #brokerId=0 #deleteWhen=04 #fileReservedTime=48 #brokerRole=ASYNC_MASTER #flushDiskType=ASYNC_FLUSH #所属集群名字 brokerClusterName=rocketmq-cluster #broker名字,注意此处不同的配置文件填写的不一样 brokerName=broker-a #0 表示 Master,>0 表示 Slave brokerId=0 #nameServer地址,分号分割 namesrvAddr=nameserver1:9876;nameserver2:9876 #在发送消息时,自动创建服务器不存在的topic,默认创建的队列数 defaultTopicQueueNums=4 #是否允许 Broker 自动创建Topic,建议线下开启,线上关闭 autoCreateTopicEnable=true #是否允许 Broker 自动创建订阅组,建议线下开启,线上关闭 autoCreateSubscriptionGroup=true #Broker 对外服务的监听端口 listenPort=10911 haListenPort=10912 #删除文件时间点,默认凌晨 4点 deleteWhen=04 #文件保留时间,默认 48 小时 fileReservedTime=18 #commitLog每个文件的大小默认1G mapedFileSizeCommitLog=1073741824 #ConsumeQueue每个文件默认存30W条,根据业务情况调整 mapedFileSizeConsumeQueue=300000 #destroyMapedFileIntervalForcibly=120000 #redeleteHangedFileInterval=120000 #检测物理文件磁盘空间 diskMaxUsedSpaceRatio=88 #存储路径 storePathRootDir=/home/rocketMQ/ZHF/rocketMQ-2m2s/store #commitLog 存储路径 storePathCommitLog=/home/rocketMQ/ZHF/rocketMQ-2m2s/store/commitlog #消费队列存储路径存储路径 storePathConsumeQueue=/home/rocketMQ/ZHF/rocketMQ-2m2s/store/consumequeue #消息索引存储路径 storePathIndex=/home/rocketMQ/ZHF/rocketMQ-2m2s/store/index #checkpoint 文件存储路径 storeCheckpoint=/home/rocketMQ/ZHF/rocketMQ-2m2s/store/checkpoint #abort 文件存储路径 abortFile=/home/rocketMQ/ZHF/rocketMQ-2m2s/store/abort #限制的消息大小 maxMessageSize=65536 #flushCommitLogLeastPages=4 #flushConsumeQueueLeastPages=2 #flushCommitLogThoroughInterval=10000 #flushConsumeQueueThoroughInterval=60000 #Broker 的角色 #- ASYNC_MASTER 异步复制Master #- SYNC_MASTER 同步双写Master #- SLAVE brokerRole=SYNC_MASTER #刷盘方式 #- ASYNC_FLUSH 异步刷盘 #- SYNC_FLUSH 同步刷盘 flushDiskType=ASYNC_FLUSH #checkTransactionMessageEnable=false #发消息线程池数量 #sendMessageThreadPoolNums=128 #拉消息线程池数量 #pullMessageThreadPoolNums=128 #强制指定本机IP,需要根据每台机器进行修改。官方介绍可为空,系统默认自动识别,但多网卡时IP地址可能读取错误 brokerIP1=192.168.162.235
三、部署
1、计划
服务器三台(每台服务器启动两个broker实例):
192.168.244.128 nameServer1 broker1-master broker3-slave 192.168.244.130 nameServer2 broker2-master broker1-slave 192.168.244.131 nameServer3 broker3-master broker2-slave2、创建目录如下
/zjl/program/rocketmq/store/store-m /zjl/program/rocketmq/store/store-m/commitlog /zjl/program/rocketmq/store/store-m/consumerqueue /zjl/program/rocketmq/store/store-m/index/zjl/program/rocketmq/store/store-s /zjl/program/rocketmq/store/store-s/commitlog /zjl/program/rocketmq/store/store-s/consumerqueue /zjl/program/rocketmq/store/store-s/index3、Broker配置文件
1)192.168.244.128 broker1-master.conf
View CodebrokerClusterName = DefaultCluster brokerName = broker1 brokerId = 0 namesrvAddr = 192.168.244.128:9876;192.168.244.130:9876;192.168.244.131:9876 defaultTopicQueueNums = 4 autoCreateTopicEnable = false autoCreateSubscriptionGroup = false listenPort = 10911 haListenPort = 10912 deleteWhen = 04 fileReservedTime = 48 brokerRole = ASYNC_MASTER flushDiskType = ASYNC_FLUSH diskMaxUsedSpaceRatio = 88 storePathRootDir = /zjl/program/rocketmq/store/store-m storePathCommitLog = /zjl/program/rocketmq/store/store-m/commitlog storePathConsumeQueue = /zjl/program/rocketmq/store/store-m/consumerqueue storePathIndex = /zjl/program/rocketmq/store/store-m/index storeCheckpoint = /zjl/program/rocketmq/store/store-m/checkpoint abortFile = /zjl/program/rocketmq/store/store-m/abort maxMessageSize = 65536 brokerIP1 = 192.168.244.1282)192.168.244.128 broker3-slave.conf
View CodebrokerClusterName = DefaultCluster brokerName = broker3 brokerId = 1 namesrvAddr = 192.168.244.128:9876;192.168.244.130:9876;192.168.244.131:9876 defaultTopicQueueNums = 4 autoCreateTopicEnable = false autoCreateSubscriptionGroup = false listenPort = 10931 haListenPort = 10932 deleteWhen = 04 fileReservedTime = 48 brokerRole = SLAVE flushDiskType = ASYNC_FLUSH diskMaxUsedSpaceRatio = 88 storePathRootDir = /zjl/program/rocketmq/store/store-s storePathCommitLog = /zjl/program/rocketmq/store/store-s/commitlog storePathConsumeQueue = /zjl/program/rocketmq/store/store-s/consumerqueue storePathIndex = /zjl/program/rocketmq/store/store-s/index storeCheckpoint = /zjl/program/rocketmq/store/store-s/checkpoint abortFile = /zjl/program/rocketmq/store/store-s/abort maxMessageSize = 65536 brokerIP1 = 192.168.244.1283)192.168.244.130 broker2-master.conf
View CodebrokerClusterName = DefaultCluster brokerName = broker2 brokerId = 0 namesrvAddr = 192.168.244.128:9876;192.168.244.130:9876;192.168.244.131:9876 defaultTopicQueueNums = 4 autoCreateTopicEnable = false autoCreateSubscriptionGroup = false listenPort = 10921 haListenPort = 10922 deleteWhen = 04 fileReservedTime = 48 brokerRole = ASYNC_MASTER flushDiskType = ASYNC_FLUSH diskMaxUsedSpaceRatio = 88 storePathRootDir = /zjl/program/rocketmq/store/store-m storePathCommitLog = /zjl/program/rocketmq/store/store-m/commitlog storePathConsumeQueue = /zjl/program/rocketmq/store/store-m/consumerqueue storePathIndex = /zjl/program/rocketmq/store/store-m/index storeCheckpoint = /zjl/program/rocketmq/store/store-m/checkpoint abortFile = /zjl/program/rocketmq/store/store-m/abort maxMessageSize = 65536 brokerIP1 = 192.168.244.1304)192.168.244.130 broker1-slave.conf
View CodebrokerClusterName = DefaultCluster brokerName = broker1 brokerId = 1 namesrvAddr = 192.168.244.128:9876;192.168.244.130:9876;192.168.244.131:9876 defaultTopicQueueNums = 4 autoCreateTopicEnable = false autoCreateSubscriptionGroup = false listenPort = 10911 haListenPort = 10912 deleteWhen = 04 fileReservedTime = 48 brokerRole = SLAVE flushDiskType = ASYNC_FLUSH diskMaxUsedSpaceRatio = 88 storePathRootDir = /zjl/program/rocketmq/store/store-s storePathCommitLog = /zjl/program/rocketmq/store/store-s/commitlog storePathConsumeQueue = /zjl/program/rocketmq/store/store-s/consumerqueue storePathIndex = /zjl/program/rocketmq/store/store-s/index storeCheckpoint = /zjl/program/rocketmq/store/store-s/checkpoint abortFile = /zjl/program/rocketmq/store/store-s/abort maxMessageSize = 65536 brokerIP1 = 192.168.244.1305)192.168.244.131 broker3-master.conf
View CodebrokerClusterName = DefaultCluster brokerName = broker3 brokerId = 0 namesrvAddr = 192.168.244.128:9876;192.168.244.130:9876;192.168.244.131:9876 defaultTopicQueueNums = 4 autoCreateTopicEnable = false autoCreateSubscriptionGroup = false listenPort = 10931 haListenPort = 10932 deleteWhen = 04 fileReservedTime = 48 brokerRole = ASYNC_MASTER flushDiskType = ASYNC_FLUSH diskMaxUsedSpaceRatio = 88 storePathRootDir = /zjl/program/rocketmq/store/store-m storePathCommitLog = /zjl/program/rocketmq/store/store-m/commitlog storePathConsumeQueue = /zjl/program/rocketmq/store/store-m/consumerqueue storePathIndex = /zjl/program/rocketmq/store/store-m/index storeCheckpoint = /zjl/program/rocketmq/store/store-m/checkpoint abortFile = /zjl/program/rocketmq/store/store-m/abort maxMessageSize = 65536 brokerIP1 = 192.168.244.1316)192.168.244.131 broker2-slave.conf
View CodebrokerClusterName = DefaultCluster brokerName = broker2 brokerId = 1 namesrvAddr = 192.168.244.128:9876;192.168.244.130:9876;192.168.244.131:9876 defaultTopicQueueNums = 4 autoCreateTopicEnable = false autoCreateSubscriptionGroup = false listenPort = 10921 haListenPort = 10922 deleteWhen = 04 fileReservedTime = 48 brokerRole = SLAVE flushDiskType = ASYNC_FLUSH diskMaxUsedSpaceRatio = 88 storePathRootDir = /zjl/program/rocketmq/store/store-s storePathCommitLog = /zjl/program/rocketmq/store/store-s/commitlog storePathConsumeQueue = /zjl/program/rocketmq/store/store-s/consumerqueue storePathIndex = /zjl/program/rocketmq/store/store-s/index storeCheckpoint = /zjl/program/rocketmq/store/store-s/checkpoint abortFile = /zjl/program/rocketmq/store/store-s/abort maxMessageSize = 65536 brokerIP1 = 192.168.244.1314、启动
按照官网启动rocketMQ会造成 java 运行内存的不足.需要修改找到runserver.sh和runbroker.sh
编辑 JAVA_OPT="${JAVA_OPT} -server -Xms256m -Xmx256m -Xmn128m -XX:MetaspaceSize=128m -XX:MaxMetaspaceSize=320m"
1)启动nameServer
命令:
cd /zjl/program/rocketmq/bin
nohup sh mqnamesrv &
较验启动是否成功
ps -ef|grep name
2)启动broker
cd /zjl/program/rocketmq/bin
nohup sh mqbroker -c /zjl/program/rocketmq/conf/broker.conf &
较验启动是否成功
ps -ef|grep broker
3)关闭命令
sh mqshutdown namesrv
sh mqshutdown broker
四、RocketMQ监控平台部署
1、下载
https://github.com/apache/rocketmq-externals
2、解压,修改配置
首先解压并进入解压后rockemq-externals-master目录rocketmq-externals-master/rocketmq-externals-master/rocketmq-console/src/main/resources,修改目录下application.properties配置文件内容如下图:
rocketmq.config.namesrvAddr=192.168.244.128:9876;192.168.244.130:9876;192.168.244.131:9876
rocketmq.config.isVIPChannel=false
rocketmq.config.dataPath=/zjl/program/rocketmq/store
3、编译启动
我在WINDOWS 下编译启动的
命令:mvn clean package “-Dmaven.test.skip=true”
成功后会在rocketmq-externals-master/rocketmq-console/target目录下产生一个rocketmq-console-ng-1.0.0.jar文件。
启动:java -jar target/rocketmq-console-ng-1.0.0.jar
访问 http://localhost:8080 看到如下页面表示mq集群和 控制台均部署成功
转载:https://blog.csdn.net/tubunanhai/article/details/81738416
以上是关于RocketMq安装的主要内容,如果未能解决你的问题,请参考以下文章
RocketMQ详细安装教程(RocketMQ安装RocketMQ修改默认端口console管理后台安装)
RocketMQ详细安装教程(RocketMQ安装RocketMQ修改默认端口console管理后台安装)