hadoop Requested data length 86483783 is longer than maximum configured RPC length

Posted 北漂-boy

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了hadoop Requested data length 86483783 is longer than maximum configured RPC length相关的知识,希望对你有一定的参考价值。

错误:

hadoop Requested data length 86483783 is longer than maximum configured RPC length

解决:

修改NameNode的hdfs-site.xml配置文件,添加以下配置:

<property>
    <name>ipc.maximum.data.length</name>
    <value>134217728</value>
</property>

允许ipc通讯最大的数据包为128MB,默认配置为64MB。

最后平滑重启NameNode,在重启异常的DataNode解决

 

借鉴:

https://zhuanlan.zhihu.com/p/44018321

以上是关于hadoop Requested data length 86483783 is longer than maximum configured RPC length的主要内容,如果未能解决你的问题,请参考以下文章

Hadoop:统计文本中单词熟练MapReduce程序

大数据集群ssh登录其他机器失败 RSA host key for zb03 has changed and you have requested strict checking. Host key

删除 Treasure-data/hadoop 中的查询?

Big Data - Hadoop - MapReduce初学Hadoop之图解MapReduce与WordCount示例分析

Uni app小程序计算声音大小

hadoop格式化:java.io.IOException: Incompatible clusterIDs in /home/lxh/hadoop/hdfs/data: namenode clust