一次Hudi Jar包中的HBase冲突导致的Spark任务失败

2022-08-08: 00:40 左右，正准备睡觉，Airflow调度任务出现了一些任务报错告警，于是爬起来打开电脑看是什么原因。

看了日志大概是Hbase版本的问题，当前的Hbase版本过高，导致Spark任务报错。于是检查了CDH集群，一切正常，Hbase也没有什么问题。经过半小时的各种分析，在CM->HBase->Commands->Recent Commands 最近的命令记录中发现了一条 Deploy Client Configuration 记录，原来是前一天下午在测试Hudi时，在Hive配置中指定了Hive Auxiliary JARs Directory的一个目录/opt/cloudera/parcels/CDH/lib/hive/auxlib，并且在改目录中添加了两个Jar包

hudi-hadoop-mr-bundle-0.11.0.jar
hudi-hive-sync-bundle-0.11.0.jar

这两个jar包中有引入HBase,移除后解决问题。

22/08/08 00:42:38 ERROR spark.SparkTask: Failed to execute Spark task "Stage-8"
java.lang.RuntimeException: hbase-default.xml file seems to be for an older version of HBase (2.4.9), this version is 2.1.0-cdh6.3.1
	at org.apache.hadoop.hbase.HBaseConfiguration.checkDefaultsVersion(HBaseConfiguration.java:70)
	at org.apache.hadoop.hbase.HBaseConfiguration.addHbaseResources(HBaseConfiguration.java:80)
	at org.apache.hadoop.hive.ql.exec.spark.HiveSparkClientFactory.initiateSparkConf(HiveSparkClientFactory.java:83)
	at org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionManagerImpl.setup(SparkSessionManagerImpl.java:98)
	at org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionManagerImpl.getSession(SparkSessionManagerImpl.java:119)
	at org.apache.hadoop.hive.ql.exec.spark.SparkUtilities.getSparkSession(SparkUtilities.java:131)
	at org.apache.hadoop.hive.ql.exec.spark.SparkTask.execute(SparkTask.java:122)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2200)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1843)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1563)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1339)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1328)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:187)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:409)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:342)
	at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:487)
	at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:503)
	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:806)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:772)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:699)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:313)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:227)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. hbase-default.xml file seems to be for an older version of HBase (2.4.9), this version is 2.1.0-cdh6.3.1
22/08/08 00:42:38 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. hbase-default.xml file seems to be for an older version of HBase (2.4.9), this version is 2.1.0-cdh6.3.1

The End.