error when start pyspark
Posted 大大的橙子
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了error when start pyspark相关的知识，希望对你有一定的参考价值。
ERROR spark.SparkContext: Error initializing SparkContext.
java.lang.IllegalArgumentException: Required executor memory (1024+384 MB) is above the max threshold (1024 MB) of this cluster! Please check the values of ‘yarn.scheduler.maximum-allocation-mb‘ and/or ‘yarn.nodemanager.resource.memory-mb‘.
调整
yarn.nodemanager.resource.memory-mb
yarn.scheduler.minimum-allocation-mb
yarn.scheduler.maximum-allocation-mb
以上是关于error when start pyspark的主要内容，如果未能解决你的问题，请参考以下文章
“psql: could not connect to server: Connection refused” Error when connecting to remote database(示例代
Error 0x80070020 when you try to start a Web site in IIS 7.0
error when starting dev server:Error: listen EACCES: permission denied 0.0.0.0:80 at Server.set
Error: Default interface methods are only supported starting with Android N (--min-api 24)类似问题解决(示例代
PySpark local模式执行读取mongodb报错 Exception: Java gateway process exited before sending its port number(代