hive3.1.2配置mysql的问题
问题描述:
我在初始化mysql的时候,一直报错
metastore connection URL: jdbc:mysql://192.168.10.100:3306/metastore?useSSL=false
metastore Connection Driver : com.mysql.jdbc.Driver
metastore connection User: root
Starting metastore schema initialization to 3.1.0
org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0
org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
*** schemaTool failed ***
metastore connection URL: jdbc:mysql://192.168.10.100:3306/metastore?useSSL=false metastore Connection Driver : com.mysql.jdbc.Driver metastore connection User: root Starting metastore schema initialization to 3.1.0 org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0 org.apache.hadoop.hive.metastore.HivemetaException: Unknown version specified for initialization: 3.1.0 at org.apache.hadoop.hive.metastore.metaStoreSchemaInfo.generateInitFileName(metaStoreSchemaInfo.java:137) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:585) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:567) at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1517) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:323) at org.apache.hadoop.util.RunJar.main(RunJar.java:236) *** schemaTool failed ***
解决方案:
这里分很多情况
-
假如你在MySQL里面没有创建metastore数据库,也会报错的,所以先创建一个这样的数据库
还有要给你的数据库里面用户赋权 -
创建文件夹
-
要启动集群,再进行初始化,这是最重要的,没启动也会报这样的错误
你可以启动hdfs,也可以全启./sbin/start-all.sh
初始化命令是
这里是在hive的bin目录下
./schematool -dbType mysql -initSchema
这里是我的hive的配置文件:
①hive-site.xml
javax.jdo.option.ConnectionURL jdbc:mysql://localhost:3306/metastore?createDatabaseIfNotExist=true&useSSL=false metadata is stored in a MySQL server javax.jdo.option.ConnectionDriverName com.mysql.jdbc.Driver MySQL JDBC driver class javax.jdo.option.ConnectionUserName root user name for connecting to mysql server javax.jdo.option.ConnectionPassword 123456 password for connecting to mysql server hive.exec.local.scratchdir /tmp/hive Local scratch space for Hive jobs hive.downloaded.resources.dir /tmp/hive Temporary local directory for added resources in the remote file system.
②hive-env.sh
export JAVA_HOME=/opt/module/jdk1.8.0_131 export HADOOP_HOME=/opt/module/hadoop-3.3.1 export HIVE_HOME=/opt/module/apache-hive-3.1.2-bin export HIVE_CONF_DIR=/opt/module/apache-hive-3.1.2-bin/conf
在hive-env.sh加上基本的环境就ok了
ok,自此解决



