栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

apache.hadoop.hive.metastore.HiveMetaException: Unknown version specified for initialization: 3.1.0

apache.hadoop.hive.metastore.HiveMetaException: Unknown version specified for initialization: 3.1.0

项目场景:

hive3.1.2配置mysql的问题


问题描述:

我在初始化mysql的时候,一直报错
metastore connection URL: jdbc:mysql://192.168.10.100:3306/metastore?useSSL=false
metastore Connection Driver : com.mysql.jdbc.Driver
metastore connection User: root
Starting metastore schema initialization to 3.1.0
org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0
org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
*** schemaTool failed ***

metastore connection URL:	 jdbc:mysql://192.168.10.100:3306/metastore?useSSL=false
metastore Connection Driver :	 com.mysql.jdbc.Driver
metastore connection User:	 root
Starting metastore schema initialization to 3.1.0
org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0
org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0
	at org.apache.hadoop.hive.metastore.metaStoreSchemaInfo.generateInitFileName(metaStoreSchemaInfo.java:137)
	at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:585)
	at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:567)
	at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1517)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
*** schemaTool failed ***


解决方案:

这里分很多情况

  1. 假如你在MySQL里面没有创建metastore数据库,也会报错的,所以先创建一个这样的数据库
    还有要给你的数据库里面用户赋权

  2. 创建文件夹

  3. 要启动集群,再进行初始化,这是最重要的,没启动也会报这样的错误
    你可以启动hdfs,也可以全启./sbin/start-all.sh


初始化命令是
这里是在hive的bin目录下

./schematool -dbType mysql -initSchema

这里是我的hive的配置文件:

①hive-site.xml



javax.jdo.option.ConnectionURL
jdbc:mysql://localhost:3306/metastore?createDatabaseIfNotExist=true&useSSL=false
metadata is stored in a MySQL server


javax.jdo.option.ConnectionDriverName
com.mysql.jdbc.Driver
MySQL JDBC driver class


javax.jdo.option.ConnectionUserName
root
user name for connecting to mysql server


javax.jdo.option.ConnectionPassword
123456
password for connecting to mysql server


hive.exec.local.scratchdir
/tmp/hive
Local scratch space for Hive jobs


hive.downloaded.resources.dir
/tmp/hive
Temporary local directory for added resources in the remote file system.


②hive-env.sh

export JAVA_HOME=/opt/module/jdk1.8.0_131
export HADOOP_HOME=/opt/module/hadoop-3.3.1
export HIVE_HOME=/opt/module/apache-hive-3.1.2-bin
export HIVE_CONF_DIR=/opt/module/apache-hive-3.1.2-bin/conf

在hive-env.sh加上基本的环境就ok了

ok,自此解决

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/460425.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号