ubuntu 安装 spark 单节点伪集群 failed to launch: nice -n 0 /usr/local/spark/bin/spark-class org.apache.spark

ubuntu 
hadoop 3.3.1
spark 3.2.1
jdk 1.8.231
scala 2.12.15

已经安装好单节点hadoop，并验证成功，可以访问，http://192.168.58.129:9870

1、安装spark单节点，启动报错，提示找不到一些class，如下

Caused by: java.lang.ClassNotFoundException: org.slf4j.Logger

下载log4j-1.2.17.jar 和 slf4j-api-1.7.36.jar 到spark里面的 jars 目录

2、增加jar包后，还是报错，如下所示

hadoop@ubuntu:/usr/local/spark/sbin$ ./start-all.sh
starting org.apache.spark.deploy.master.Master, logging to /usr/local/spark/logs/spark-hadoop-org.apache.spark.deploy.master.Master-1-ubuntu.out
failed to launch: nice -n 0 /usr/local/spark/bin/spark-class org.apache.spark.deploy.master.Master --host ubuntu --port 7077 --webui-port 8080
  Spark Command: /usr/lib/jvm/jdk1.8.0_231/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/jars/*:/opt/local/hadoop/etc/hadoop -Xmx1g org.apache.spark.deploy.master.Master --host ubuntu --port 7077 --webui-port 8080
  ========================================
full log in /usr/local/spark/logs/spark-hadoop-org.apache.spark.deploy.master.Master-1-ubuntu.out
ubuntu: starting org.apache.spark.deploy.worker.Worker, logging to /usr/local/spark/logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-ubuntu.out
ubuntu: failed to launch: nice -n 0 /usr/local/spark/bin/spark-class org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://ubuntu:7077
ubuntu:   Spark Command: /usr/lib/jvm/jdk1.8.0_231/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/jars/*:/opt/local/hadoop/etc/hadoop -Xmx1g org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://ubuntu:7077
ubuntu:   ========================================
ubuntu: full log in /usr/local/spark/logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-ubuntu.out

在spark/conf下面的spark-env.sh里面加上下面的配置

export SPARK_DIST_CLASSPATH=$(/usr/local/hadoop/bin/hadoop classpath)

修改后，博主的配置如下所示

export SPARK_DIST_CLASSPATH=$(/usr/local/hadoop/bin/hadoop classpath)

export JAVA_HOME=/usr/lib/jvm/jdk1.8.0_231
export SCALA_HOEM=/usr/local/scala
export SPARK_MASTER_IP=192.168.58.129
export HADOOP_CONF_DIR=/opt/local/hadoop/etc/hadoop
export SPARK_MASTER_PORT=7077
export SPARK_WORKER_CORES=1
export SPARK_WORKER_MEMORY=2g

重新执行./start-all.sh ，执行成功。