栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

sqoop出现ERROR tool.ImportTool: Import failed: java.io.IOException

sqoop出现ERROR tool.ImportTool: Import failed: java.io.IOException

21/11/08 12:13:10 ERROR tool.importTool: import failed: java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
        at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:143)
        at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:108)
        at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:101)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1311)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844)
        at org.apache.hadoop.mapreduce.Job.connect(Job.java:1306)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1335)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)
        at org.apache.sqoop.mapreduce.importJobbase.doSubmitJob(importJobbase.java:200)
        at org.apache.sqoop.mapreduce.importJobbase.runJob(importJobbase.java:173)
        at org.apache.sqoop.mapreduce.importJobbase.runimport(importJobbase.java:270)
        at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
        at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)
        at org.apache.sqoop.tool.importTool.importTable(importTool.java:520)
        at org.apache.sqoop.tool.importTool.run(importTool.java:628)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

运行sqoop脚本时出现如上错误(脚本内容就是将mysql数据导入到hdfs),返现是缺少依赖我将hadoop-mapreduce-client-common-2.8.5.jar和hadoop-mapreduce-client-core-2.8.5.jar这两个jar包拷贝到sqoop的lib目录下后还是报错,然后我就将hadoop的hadoop-2.8.5/share/hadoop/mapreduce目录下的所有jar包都拷贝了进去,解决问题,成功运行脚本,简单暴力.

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/443596.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号