hdfs.DataStreamer: Exception in createBlockOutputStream
Posted jhxxb
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了hdfs.DataStreamer: Exception in createBlockOutputStream相关的知识，希望对你有一定的参考价值。
在上传文件至 HDFS 提示如下信息
[[email protected] jdk1.8.0_202]# hadoop fs -put javafx-src.zip / 19/04/11 23:19:36 INFO hdfs.DataStreamer: Exception in createBlockOutputStream java.io.IOException: Got error, status=ERROR, status message , ack with firstBadLink as 192.168.8.140:50010 at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:121) at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1751) at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1655) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:710) 19/04/11 23:19:36 WARN hdfs.DataStreamer: Abandoning BP-362764591-192.168.8.136-1554970906073:blk_1073741827_1003 19/04/11 23:19:36 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[192.168.8.140:50010,DS-c5ff356a-e427-440d-980b-11a1abec3e1b,DISK]
意思是连接不上目标机器，在目标机器上服务已经启动
最后发现是防火墙的原因，关闭即可
[[email protected] jdk1.8.0_202]# systemctl stop firewalld.service [[email protected] jdk1.8.0_202]# systemctl disable firewalld.service
以上是关于hdfs.DataStreamer: Exception in createBlockOutputStream的主要内容，如果未能解决你的问题，请参考以下文章
Spark：Dataframe“except”方法引发错误：“unresolved operator:'Except;”