栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

hive insert、select组合动态插入分区表

hive insert、select组合动态插入分区表

使用waterdrop操作hive的时候遇到一个问题,按照sql的insert、select组合插入应该使用下面的语句:

INSERT INTO table t_ads_gsddy_jzfdl_day

SELECT a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a

运行发现报错,查看表结构之后,发现要插入的表有分区,于是修改之后:

INSERT INTO table t_ads_gsddy_jzfdl_day PARTITION(partition_year)

SELECt a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a

但是waterdrop却又报错了,提示设置partition=true或者使用静态分区

思考了一下,发现默认是静态插入,所以采用了以下语句

SET hive.exec.dynamic.partition=true;                                 --开启动态分区,默认是false

SET hive.exec.dynamic.partition.mode=nonstric;                 -- 开启允许所有分区都是动态的,否则必须要有静态分区才能使用。

INSERT INTO table t_ads_gsddy_jzfdl_day PARTITION(partition_year)

SELECT a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a

最后提示插入成功!!!

回头试了下,在开启了动态分区的情况下,不指定分区使用常规的insert、select进行插入,发现也是可以的

SET hive.exec.dynamic.partition=true;

SET hive.exec.dynamic.partition.mode=nonstric;

INSERT INTO table t_ads_gsddy_jzfdl_day

SELECT a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/746980.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号