栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

waterdrop1.5.1

waterdrop1.5.1

waterdrop1.5.1将hive中orc格式的文件导入clickhouse中
diagnostics: User class threw exception: java.lang.ExceptionInInitializerError
    at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:84)
    at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:48)
    at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parseTableIdentifier(ParseDriver.scala:49)
    at org.apache.spark.sql.DataframeWriter.saveAsTable(DataframeWriter.scala:409)
    at com.xinyan.blockchain.ods.DataLoadETH$.loadEth(DataLoadETH.scala:82)
    at com.xinyan.blockchain.ods.DataLoadETH$.main(DataLoadETH.scala:45)
    at com.xinyan.blockchain.ods.DataLoadETH.main(DataLoadETH.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:665)
Caused by: java.lang.UnsupportedOperationException: java.io.InvalidClassException: org.antlr.v4.runtime.atn.ATN; Could not deserialize ATN with UUID 59627784-3be5-417a-b9eb-8131a7286089 (expected aadb8d7e-aeef-4415-ad2b-8204d6cf042e or a legacy UUID).
    at org.antlr.v4.runtime.atn.ATNDeserializer.deserialize(ATNDeserializer.java:154)
    at org.apache.spark.sql.catalyst.parser.SqlbaseLexer.(SqlbaseLexer.java:1175)
解决方案:

在batch.conf中 配置 spark.executor.extraClassPath = "/*/parcels/CDH/lib/spark/hive/hive-exec-2.1.1-cdh6.3.2.jar"即可

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/350476.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号