解决spark运行中failed to locate the winutils binary in the hadoop binary path的问题

Posted 教程之父

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了解决spark运行中failed to locate the winutils binary in the hadoop binary path的问题相关的知识,希望对你有一定的参考价值。

1.下载hadoop-common-2.2.0-bin并解压到某个目录

 https://github.com/srccodes/hadoop-common-2.2.0-bin

 

2.设置hadoop.home.dir

 

System.setProperty("hadoop.home.dir", "D:\\\\hadoop-common-2.2.0-bin-master")

 

以上是关于解决spark运行中failed to locate the winutils binary in the hadoop binary path的问题的主要内容,如果未能解决你的问题,请参考以下文章

成功解决Failed to execute stage ‘Setup validation’: Cannot locate gluster packages

iOS 苹果开发证书失效的解决方案(Failed to locate or generate matching signing assets)

iOS 苹果开发证书失效的解决方案(Failed to locate or generate matching signing assets)

spark模型运行时无法连接摸个excutors异常org.apache.spark.shuffle.FetchFailedException: Failed to connect to xxxx/x

visual studio 2017 编译v140 TRACKER : error TRK0005: Failed to locate: "CL.exe". 系统找不到指定的文件

解决ERROR Shell: Failed to locate the winutils binary in the hadoop binary path java.io.IOException: C