栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

sqoop的安装(sqoop-1.4.6.bin

sqoop的安装(sqoop-1.4.6.bin

目录

一.下载sqoop

二.安装

三.验证


一.下载sqoop

官网如下:

http://archive.apache.org/dist/sqoop/

可以选择要的版本!但后面一定要是.tar.gz

我用的是sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz。

二.安装

1. 解压安装(在sqoop的目录下)

 tar -zvxf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz -C /training/

我的软件放在/training文件夹下。

2.配置环境变量

vi ~/.bash_profile

 加入

#sqoop
export SQOOP_HOME=/training/sqoop-1.4.6.bin__hadoop-2.0.4-alpha
export PATH=$PATH:$SQOOP_HOME/bin

环境变量生效

source ~/.bash_profile

3.将 mysql 的 java connector 复制到sqoop的lib目录下

cp mysql-connector-java-5.1.27-bin.jar /training/sqoop-1.                                                                            4.6.bin__hadoop-2.0.4-alpha/lib/

mysql-connector-java-5.1.27-bin.jar可以在我的百度网盘下载

链接:https://pan.baidu.com/s/1uQTVMzg8E5QULQTAoppdcQ 
提取码:58c5

 4.配置

1.在sqoop的conf文件夹下打开sqoop-env.sh

加入以下内容(前提:安装了hadoop,hive,hbase,zookeeper!!!没有安装的可以看我的博客)

export HADOOP_COMMON_HOME=/training/hadoop-2.7.3
export HADOOP_MAPRED_HOME=/training/hadoop-2.7.3
export Hbase_HOME=/training/hbase-2.0.3
export HIVE_HOME=/training/apache-hive-3.1.2-bin
export ZOOCFGDIR=/training/zookeeper-3.4.5

2.在sqoop的conf文件夹下用vi新建sqoop-site.xml

加入以下内容



    sqoop.metastore.client.autoconnect.username
    SA
    The username to bind to the metastore.
    
  

    sqoop.metastore.client.autoconnect.password
    
    The password to bind to the metastore.
    
  

    sqoop.metastore.client.record.password
    true
    If true, allow saved passwords in the metastore.
    
  

    sqoop.metastore.server.location
    /tmp/sqoop-metastore/shared.db
    Path to the shared metastore database files.
    If this is not set, it will be placed in ~/.sqoop/.
    
  

    sqoop.metastore.server.port
    16000
    Port that this metastore should listen on.
    
  

    sqoop.metastore.client.enable.autoconnect
    true
    If true, Sqoop will connect to a local metastore
      for job management when no other metastore arguments are
      provided.
    
  

    sqoop.metastore.client.autoconnect.url
    jdbc:hsqldb:file:/tmp/sqoop-meta/meta.db;shutdown=true
    The connect string to use when connecting to a
      job-management metastore. If unspecified, uses ~/.sqoop/.
      You can specify a different path here.
    
  

三.验证

在sqoop的lib目录下输入

./sqoop help

会看到以下内容则表示安装成功!!

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/761143.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号