spark Failed to get main class in JAR with error null . Please specify one with --class.

Posted linpaomian

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了spark Failed to get main class in JAR with error null . Please specify one with --class.相关的知识,希望对你有一定的参考价值。

运行spark-submit命令示例

bin/spark-submit \\ 
--class org.apache.spark.examples.SparkPi \\ 
--master yarn \\ 
--deploy-mode cluster \\ 
./examples/jars/spark-examples_2.12-3.0.0.jar \\ 
1000

出现报错:Failed to get main class in JAR with error null . Please specify one with --class.主要是时说找不到程序入口

原因:最新的spark更改了示例,现在官方文档

./bin/spark-submit --class org.apache.spark.examples.SparkPi \\
    --master yarn \\
    --deploy-mode cluster \\
    --driver-memory 4g \\
    --executor-memory 2g \\
    --executor-cores 1 \\
    --queue thequeue \\
    examples/jars/spark-examples*.jar \\
    10

以上是关于spark Failed to get main class in JAR with error null . Please specify one with --class.的主要内容,如果未能解决你的问题,请参考以下文章