异常The channel is full or unexpected failure. The source will try again after 1000 ms

Posted huomei

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了异常The channel is full or unexpected failure. The source will try again after 1000 ms相关的知识,希望对你有一定的参考价值。

Flume采集的控制台提示:
The channel is full or unexpected failure. The source will try again after 1000 ms

这个是因为当前被采集的文件过大,深层的原因是文件采集的速度和sink的速度没有匹配好。所以应该可以通过增大keep-alive的值解决:
#channel中最多缓存多少
a1.channels.c1.capacity = 5000
#channel一次最多吐给sink多少
a1.channels.c1.transactionCapacity = 2000
#event的活跃时间
a1.channels.c1.keep-alive = 10

或者写到HDFS使用压缩,可以通过压缩来节省空间和网络流量,但是会增加cpu的消耗。

以上是关于异常The channel is full or unexpected failure. The source will try again after 1000 ms的主要内容,如果未能解决你的问题,请参考以下文章

异常:java.sql.SQLException: The server time zone value '?й???????' is unrecognized or represen

MySQL连接异常: The server time zone value ‘?й???????‘ is unrecognized or represents more than one time.

mysql连接异常:The server time zone value '?й???????' is unrecognized or represents more than one

mysql异常之: The server time zone value ‘?D1ú±ê×?ê±??‘ is unrecognized or represents more than one time

The server time zone value is unrecognized or repr

The server time zone value is unrecognized or repr