Datanode启动问题 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block
Posted 大大的橙子
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Datanode启动问题 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block 相关的知识,希望对你有一定的参考价值。
2017-04-15 21:21:15,423 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: supergroup = supergroup 2017-04-15 21:21:15,467 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 1000 2017-04-15 21:21:15,486 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50020 2017-04-15 21:21:15,511 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened IPC server at /0.0.0.0:50020 2017-04-15 21:21:15,521 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Refresh request received for nameservices: mycluster 2017-04-15 21:21:15,551 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting BPOfferServices for nameservices: mycluster 2017-04-15 21:21:15,559 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to hdp265m.test.com/192.168.56.104:53310 starting to offer service 2017-04-15 21:21:15,573 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to hdp265m2.test.com/192.168.56.107:53310 starting to offer service 2017-04-15 21:21:15,585 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2017-04-15 21:21:15,586 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 50020: starting 2017-04-15 21:21:15,903 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hdp/hadoop/data/in_use.lock acquired by nodename 12483@hdp265s1.test.com 2017-04-15 21:21:15,904 WARN org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: Incompatible clusterIDs in /home/hdp/hadoop/data: namenode clusterID = CID-bf7ff1f1-680c-4bbf-958b-bda65fb409de; datanode clusterID = c1 2017-04-15 21:21:15,951 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hdp/hadoop/data/in_use.lock acquired by nodename 12483@hdp265s1.test.com 2017-04-15 21:21:15,952 WARN org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: Incompatible clusterIDs in /home/hdp/hadoop/data: namenode clusterID = CID-bf7ff1f1-680c-4bbf-958b-bda65fb409de; datanode clusterID = c1 2017-04-15 21:21:15,952 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to hdp265m2.test.com/192.168.56.107:53310. Exiting. java.io.IOException: All specified directories are failed to load. at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:478) at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1342) at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1308) at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:314) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:226) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:867) at java.lang.Thread.run(Thread.java:745)
原因是clusterID不一致
删除tmp下的内容
从/home/hdp/hadoop/name/current/VERSION 获得clusterID
修改到
/home/hdp/hadoop/data/current/VERSION
修改保持一致,然后重启服务
以上是关于Datanode启动问题 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block 的主要内容,如果未能解决你的问题,请参考以下文章
namenode namespaceID与datanode namespaceID 不一致导致datanode无法启动的问题