分布式组件-ActiveMQPersistent store is Full, 100%

Posted 2021-04-24 微创智云

问题描述

      最近生产环境出现了一次交易量下降，排查原因发现是ActiveMQ 有一个队列没有消费者，只有生产者，导致持久化磁盘Persistent store is Full,100%

问题重现

      针对本次出现的问题进行模拟监控，重现本次出现问题的整个过程。

 

1.持久化设置

2.执行监控过程

查看Hawtio Health可以看见如下图：

3.出现异常如下

 

 for more info | org.apache.activemq.broker.TransportConnection.Service | ActiveMQ Transport: tcp:///127.0.0.1:9471@61616
2018-05-23 17:09:41,565 | WARN  | Async error occurred: javax.jms.ResourceAllocationException: Persistent store is Full, 100% of 536870912. Stopping producer (ID:Fxdemon-9460-1527064971163-1:1:1:20) to prevent flooding queue://Jaycekon-MQ. See http://activemq.apache.org/producer-flow-control.html for more info | org.apache.activemq.broker.TransportConnection.Service | ActiveMQ Transport: tcp:///127.0.0.1:9461@61616
2018-05-23 17:13:41,466 | WARN  | Async error occurred: javax.jms.ResourceAllocationException: Persistent store is Full, 100% of 536870912. Stopping producer (ID:Fxdemon-9097-1527063928557-1:1:1:38) to prevent flooding queue://Jaycekon-MQ. See http://activemq.apache.org/producer-flow-control.html for more info | org.apache.activemq.broker.TransportConnection.Service | ActiveMQ Transport: tcp:///127.0.0.1:9098@61616
2018-05-23 17:13:41,565 | WARN  | Async error occurred: javax.jms.ResourceAllocationException: Persistent store is Full, 100% of 536870912. Stopping producer (ID:Fxdemon-8879-1527063225605-1:1:1:70) to prevent flooding queue://Jaycekon-MQ. See http://activemq.apache.org/producer-flow-control.html for more info | org.apache.activemq.broker.TransportConnection.Service | ActiveMQ Transport: tcp:///127.0.0.1:8880@61616

如何手动清楚没有消费者的消息

进入admin管控台，找到对应的队列，点击Purge

停止生产者，清除没有消费的队列，集群健康状态如下：