1、准备需要的运行包
kafka-clients-3.2.0.jar spark-streaming-kafka-0-10_2.12-3.0.0.jar spark-streaming-kafka-0-10-assembly_2.12-3.0.0.jar
2、测试运行
/home/hadoop/app/spark #把spark自带的spark-examples_2.12-3.3.0.jar放到YARN上运行 bin/spark-submit --class org.apache.spark.examples.streaming.JavaDirectKafkaWordCount --master yarn --jars examples/jars/kafka-clients-3.2.0.jar,examples/jars/spark-streaming-kafka-0-10_2.12-3.0.0.jar,examples/jars/spark-streaming-kafka-0-10-assembly_2.12-3.0.0.jar examples/jars/spark-examples_2.12-3.3.0.jar hadoop01:9092,hadoop02:9092,hadoop03:9092 1111 mydemo2 #调用kafka生产者，产生数据 /home/hadoop/app/kafka kafka-console-producer.sh --broker-list hadoop01:9092 --topic mydemo2 #上面的JavaDirectKafkaWordCount是从kafka的topic中取出数据，显示到控制台上
