Sqoop部署及测试

在sqoop根目录下的conf目录中。

 $ mv sqoop-env-template.sh sqoop-env.sh

 sqoop-env.sh

 
 export HADOOP_COMMON_HOME=/opt/module/hadoop
 
 export HADOOP_MAPRED_HOME=/opt/module/hadoop

 
 export HIVE_HOME=/opt/module/hive

 
 export ZOOKEEPER_HOME=/opt/module/zookeeper
 export ZOOCFGDIR=/opt/module/zookeeper
 
 export Hbase_HOME=/opt/module/hbase

 拷贝jdbc驱动到sqoop的lib目录下，如：
 
 $ cp mysql-connector-java-5.1.27-bin.jar /opt/module/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/lib/

 #通过某一个command来验证sqoop配置是否正确：
 
 $ bin/sqoop help
 

 出现一些Warning警告，并伴随着帮助命令的输出：
 
 Available commands:
 
  codegen       Generate code to interact with database records
 
  create-hive-table   import a table definition into Hive
 
  eval        evaluate a SQL statement and display the results
 
  export       Export an HDFS directory to a database table
 
  help        List available commands
 
  import       import a table from a database to HDFS
 
  import-all-tables   import tables from a database to HDFS
 
  import-mainframe   import datasets from a mainframe server to HDFS
 
  job         Work with saved jobs
 
  list-databases     List available databases on a server
 
  list-tables      List available tables in a database
 
  merge        Merge results of incremental imports
 
  metastore      Run a standalone Sqoop metastore
 
  version       Display version information

 $ bin/sqoop list-databases --connect jdbc:mysql://hadoop102:3306/ --username root --password passwd
 
 #出现如下输出：
 
 information_schema
 
 metastore
 
 mysql
 
 oozie
 
 performance_schema