spark-submit报错/xxx/bin/spark-class: line 100: exec: : not found

Posted 2023-04-22

参考技术A 在本地执行spark-submit报错/xxx/bin/spark-class: line 100: exec: : not found，度/谷连问题都找不到，只能自己定位了。过程略去，结论：本机上安装了2个版本的spark，配置混乱，导致环境变量spark_home和spark_conf_dir不对应。修改为对应即可。

gem install XXX报错

问题：
    1、安装Ruby;
    2、安装rubygems：yum -y install rubygems
    3、通过gem安装bundle：gem install bundle

ERROR:  While executing gem ... (Gem::Exception)
    Unable to require openssl, install OpenSSL and rebuild ruby (preferred) or use non-HTTPS sources

方案：

[root@localhost ~]# yum -y install openssl-devel
...省略...
[root@localhost ~]# cd /opt/ruby-3.0.2/ext/openssl/
[root@localhost openssl]# ruby ./extconf.rb
checking for t_open() in -lnsl... no
checking for socket() in -lsocket... no
...省略...
creating extconf.h
creating Makefile
[root@localhost openssl]# vim /opt/ruby-3.0.2/ext/openssl/Makefile #在/opt/ruby-3.0.2/ext/openssl/Makefile文件顶部添加top_srcdir = ../..
[root@localhost openssl]# pwd
/opt/ruby-3.0.2/ext/openssl
[root@localhost openssl]# make install