sqoop的安装

Sqoop是一个用来完成Hadoop和关系型数据库中的数据相互转移的工具，

他可以将关系型数据库（MySql,Oracle,Postgres等）中的数据导入Hadoop的HDFS中，

也可以将HDFS的数据导入关系型数据库中。

前期准备：

1.Sqoop需要安装在成功部署的Hadoop平台上，并且要求Hadoop已经正常启动。hadoop集群的搭建

2.安装了mysql数据库，并且已经启动.CentOS安装mysql源码包

3.下载mysql-connector-java-5.1.12.tar.gz。

安装过程；

1.下载sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz压缩包。

2.上传至/usr/local/src

3.解压缩并且移动到上级目录（/usr/local）

4.解压缩mysql-connector-java-5.1.12.tar.gz文件，

并且复制文件mysql-connector-java-5.1.12-bin.jar到/usr/local/sqoop-1.4.7.bin__hadoop-2.6.0/lib中。

5.配置环境变量　　

cd   /usr/local/sqoop-1.4..bin__hadoop-2.6./conf
cp sqoop-env-template.sh sqoop-env.sh
vim sqoop-env.sh

根据情况添加配置信息 内容如下：

# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
 
# included in all the hadoop scripts with source command
# should not be executable directly
# also should not be passed any arguments, since we need original $*
 
# Set Hadoop-specific environment variables here.
 
#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/usr/local/hadoop-2.6.
 
#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/usr/local/hadoop-2.6.
 
#set the path to where bin/hbase is available
export HBASE_HOME=/usr/local/hbase-1.4.
 
#Set the path to where bin/hive is available
export HIVE_HOME=/usr/local/apache-hive-2.1.-bin
 
#Set the path for where zookeper config dir is
export ZOOCFGDIR=/usr/local/zookeeper/conf

6.配置linux的环境变量

cd
vim .bash_profile

在结尾添加如下代码：

#sqoop
export SQOOP_HOME=/usr/local/sqoop-1.4..bin__hadoop-2.6./
export PATH=$PATH:$SQOOP_HOME/bin

7.保存退出；时文件生效：

source .bash_profile

8.测试与mysql的连接：

cd   /usr/local/sqoop-1.4..bin__hadoop-2.6.0/bin
sqoop list-databases --connect jdbc:mysql://localhost:3306 --username root -P

输入密码后会显示具体的数据库列表

9.查看具体数据库中的 表信息：

sqoop list-tables --connect jdbc:mysql://localhost:3306/db1 --username root -P

10.执行查询语句：

sqoop -eval --connect jdbc:mysql://localhost:3306/db1 --username root  -P --query "select * from a limit 5"