spark Failed to get main class in JAR with error null . Please specify one with --class.
Posted linpaomian
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了spark Failed to get main class in JAR with error null . Please specify one with --class.相关的知识,希望对你有一定的参考价值。
运行spark-submit命令示例
bin/spark-submit \\
--class org.apache.spark.examples.SparkPi \\
--master yarn \\
--deploy-mode cluster \\
./examples/jars/spark-examples_2.12-3.0.0.jar \\
1000
出现报错:Failed to get main class in JAR with error null . Please specify one with --class.主要是时说找不到程序入口
原因:最新的spark更改了示例,现在官方文档
./bin/spark-submit --class org.apache.spark.examples.SparkPi \\
--master yarn \\
--deploy-mode cluster \\
--driver-memory 4g \\
--executor-memory 2g \\
--executor-cores 1 \\
--queue thequeue \\
examples/jars/spark-examples*.jar \\
10
以上是关于spark Failed to get main class in JAR with error null . Please specify one with --class.的主要内容,如果未能解决你的问题,请参考以下文章