yarn安装MapReduce框架JAR上传的时候报错处理

Posted 2022-03-05 江南独孤客

22/03/03 18:14:04 INFO uploader.FrameworkUploader: Adding /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./hadoop-yarn-server-common-3.0.0-cdh6.3.0.jar
22/03/03 18:14:04 INFO uploader.FrameworkUploader: Adding /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar
22/03/03 18:14:05 ERROR uploader.FrameworkUploader: Error in execution /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
 at java.io.FileInputStream.open0(Native Method)
 at java.io.FileInputStream.open(FileInputStream.java:195)
 at java.io.FileInputStream.<init>(FileInputStream.java:138)
 at org.apache.hadoop.mapred.uploader.FrameworkUploader.buildPackage(FrameworkUploader.java:334)
 at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:126)
 at org.apache.hadoop.mapred.uploader.FrameworkUploader.main(FrameworkUploader.java:612)
Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
 at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:136)
 at org.apache.hadoop.mapred.uploader.FrameworkUploader.main(FrameworkUploader.java:612)
Caused by: java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)
 at java.io.FileInputStream.open0(Native Method)
 at java.io.FileInputStream.open(FileInputStream.java:195)
 at java.io.FileInputStream.<init>(FileInputStream.java:138)
 at org.apache.hadoop.mapred.uploader.FrameworkUploader.buildPackage(FrameworkUploader.java:334)
 at org.apache.hadoop.mapred.uploader.FrameworkUploader.run(FrameworkUploader.java:126)
 ... 1 more

报错最明显的位置错误如下：

ERROR uploader.FrameworkUploader: Error in execution /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/./jindofs-sdk.jar (No such file or directory)

解决方案：

每台yarn节点上去执行
cd /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hadoop-yarn/
 rm -rf  ./jindofs-sdk.jar（此文件只是一个软链接，并非文件夹和文件，只能删除）
 重新上传jindofs-sdk.jar到此目录

然后执行成功