[hadoop读书笔记] 第十五章 sqoop1.4.6小实验

导入命令

sqoop import

--connect jdbc:mysql://192.168.200.250:3306/sqoop

--table widgets

--hbase-create-table

--hbase-table WIDGETS_IN_HBASE

--column-family product

--hbase-row-key id

--username 'root'

-P

说明：
--connect jdbc:mysql://192.168.200.250:3306/sqoop 表示远程或者本地 Mysql 服务的URI，3306是Mysql默认监听端口， sqoop 是数据库，若是其他数据库，如Oracle,只需修改URI即可。
--table widgets 表示导出 sqoop 数据库的 widgets 表。
--hbase-table WIDGETS_IN_HBASE 表示在HBase中建立表 WIDGETS_IN_HBASE 。
--column-family product 表示在表A中建立列族 product 。
--hbase-row-key id 表示表 WIDGETS_IN_HBASE 的row-key是 widgets 表的id字段。
--hbase-create-table 表示在HBase中建立表。
--username 'root' 表示使用用户root连接Mysql。

sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-create-table --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --username 'root' -P

报错：

如上可知，找不到HBASE的classpath，加载不到JAR，因此将$HBASE_HOME 设置到环境变量中：

再次执行sqoop导入

据说是兼容性问题，手动创建该表

再次执行，成功！

后台日志：

[hadoop@hadoop-allinone-- bin]$  
sqoop import  --connect jdbc:mysql://192.168.200.250:3306/sqoop  --table widgets   --hbase-table WIDGETS_IN_HBASE  --column-family product  --hbase-row-key id  --hbase-create-table --username 'root'  -P// :: INFO sqoop.Sqoop: Running Sqoop version: 1.4.

Enter password:

// :: INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.

// :: INFO tool.CodeGenTool: Beginning code generation

// :: INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT

// :: INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT

// :: INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /wdcloud/app/hadoop-2.7.

Note: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.java uses or overrides a deprecated API.

Note: Recompile with -Xlint:deprecation for details.

// :: INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.jar

// :: WARN manager.MySQLManager: It looks like you are importing from mysql.

// :: WARN manager.MySQLManager: This transfer can be faster! Use the --direct

// :: WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.

// :: INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)

// :: INFO mapreduce.ImportJobBase: Beginning import of widgets

// :: INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/wdcloud/app/hbase-1.1./lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

// :: INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar

// :: INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps

// :: INFO zookeeper.RecoverableZooKeeper: 
Process identifier=hconnection-0x333d2dad connecting to ZooKeeper ensemble=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183

// :: INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.-, built on // : GMT

// :: INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop-allinone--.wdcloud.locl

// :: INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_67

// :: INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation

// :: INFO zookeeper.ZooKeeper: Client environment:java.home=/wdcloud/app/jdk1u7/jre

// :: INFO zookeeper.ZooKeeper: Client environment:java.class.path=/wdcloud/app/hadoop-2.7./etc/hadoop:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jets3t-0.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpclient-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpcore-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-api-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/gson-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-auth-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-util-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-framework-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsch-0.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-recipes-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/mockito-all-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-math3-3.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-daemon-1.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-all-4.0..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xercesImpl-2.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xml-apis-1.3..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-api-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-tests-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-registry-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.-tests.jar:/wdcloud/app/sqoop-1.4./conf::/wdcloud/app/sqoop-1.4./lib/ant-contrib-.0b3.jar:/wdcloud/app/sqoop-1.4./lib/ant-eclipse-1.0-jvm1..jar:/wdcloud/app/sqoop-1.4./lib/avro-1.7..jar:/wdcloud/app/sqoop-1.4./lib/avro-mapred-1.7.-hadoop2.jar:/wdcloud/app/sqoop-1.4./lib/commons-codec-1.4.jar:/wdcloud/app/sqoop-1.4./lib/commons-compress-1.4..jar:/wdcloud/app/sqoop-1.4./lib/commons-io-1.4.jar:/wdcloud/app/sqoop-1.4./lib/commons-jexl-2.1..jar:/wdcloud/app/sqoop-1.4./lib/commons-logging-1.1..jar:/wdcloud/app/sqoop-1.4./lib/hsqldb-1.8.0.10.jar:/wdcloud/app/sqoop-1.4./lib/jackson-annotations-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-core-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-core-asl-1.9..jar:/wdcloud/app/sqoop-1.4./lib/jackson-databind-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-core-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-hive-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-mapreduce-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-hadoop-compatibility-1.0..jar:/wdcloud/app/sqoop-1.4./lib/mysql-connector-java-5.1.-bin.jar:/wdcloud/app/sqoop-1.4./lib/opencsv-2.3.jar:/wdcloud/app/sqoop-1.4./lib/paranamer-2.3.jar:/wdcloud/app/sqoop-1.4./lib/parquet-avro-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-column-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-common-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-encoding-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-format-2.0..jar:/wdcloud/app/sqoop-1.4./lib/parquet-generator-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-hadoop-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-jackson-1.4..jar:/wdcloud/app/sqoop-1.4./lib/slf4j-api-1.6..jar:/wdcloud/app/sqoop-1.4./lib/snappy-java-1.0..jar:/wdcloud/app/sqoop-1.4./lib/xz-1.0.jar:/wdcloud/app/hbase-1.1./conf:/wdcloud/app/jdk1u7/lib/tools.jar:/wdcloud/app/hbase-1.1.:/wdcloud/app/hbase-1.1./lib/activation-1.1.jar:/wdcloud/app/hbase-1.1./lib/aopalliance-1.0.jar:/wdcloud/app/hbase-1.1./lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hbase-1.1./lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hbase-1.1./lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hbase-1.1./lib/api-util-1.0.-M20.jar:/wdcloud/app/hbase-1.1./lib/asm-3.1.jar:/wdcloud/app/hbase-1.1./lib/avro-1.7..jar:/wdcloud/app/hbase-1.1./lib/commons-beanutils-1.7..jar:/wdcloud/app/hbase-1.1./lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hbase-1.1./lib/commons-cli-1.2.jar:/wdcloud/app/hbase-1.1./lib/commons-codec-1.9.jar:/wdcloud/app/hbase-1.1./lib/commons-collections-3.2..jar:/wdcloud/app/hbase-1.1./lib/commons-compress-1.4..jar:/wdcloud/app/hbase-1.1./lib/commons-configuration-1.6.jar:/wdcloud/app/hbase-1.1./lib/commons-daemon-1.0..jar:/wdcloud/app/hbase-1.1./lib/commons-digester-1.8.jar:/wdcloud/app/hbase-1.1./lib/commons-el-1.0.jar:/wdcloud/app/hbase-1.1./lib/commons-httpclient-3.1.jar:/wdcloud/app/hbase-1.1./lib/commons-io-2.4.jar:/wdcloud/app/hbase-1.1./lib/commons-lang-2.6.jar:/wdcloud/app/hbase-1.1./lib/commons-logging-1.2.jar:/wdcloud/app/hbase-1.1./lib/commons-math-2.2.jar:/wdcloud/app/hbase-1.1./lib/commons-math3-3.1..jar:/wdcloud/app/hbase-1.1./lib/commons-net-3.1.jar:/wdcloud/app/hbase-1.1./lib/disruptor-3.3..jar:/wdcloud/app/hbase-1.1./lib/findbugs-annotations-1.3.-.jar:/wdcloud/app/hbase-1.1./lib/guava-12.0..jar:/wdcloud/app/hbase-1.1./lib/guice-3.0.jar:/wdcloud/app/hbase-1.1./lib/guice-servlet-3.0.jar:/wdcloud/app/hbase-1.1./lib/hadoop-annotations-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-auth-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-client-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-hdfs-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-app-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-core-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-jobclient-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-shuffle-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-api-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-client-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-server-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hbase-annotations-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-annotations-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-client-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-common-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-common-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-examples-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-hadoop2-compat-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-hadoop-compat-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-it-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-it-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-prefix-tree-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-procedure-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-protocol-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-resource-bundle-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-rest-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-server-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-server-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-shell-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-thrift-1.1..jar:/wdcloud/app/hbase-1.1./lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hbase-1.1./lib/httpclient-4.2..jar:/wdcloud/app/hbase-1.1./lib/httpcore-4.1..jar:/wdcloud/app/hbase-1.1./lib/jackson-core-asl-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-xc-1.9..jar:/wdcloud/app/hbase-1.1./lib/jamon-runtime-2.3..jar:/wdcloud/app/hbase-1.1./lib/jasper-compiler-5.5..jar:/wdcloud/app/hbase-1.1./lib/jasper-runtime-5.5..jar:/wdcloud/app/hbase-1.1./lib/javax.inject-.jar:/wdcloud/app/hbase-1.1./lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hbase-1.1./lib/jaxb-api-2.2..jar:/wdcloud/app/hbase-1.1./lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hbase-1.1./lib/jcodings-1.0..jar:/wdcloud/app/hbase-1.1./lib/jersey-client-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-core-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-guice-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-json-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-server-1.9.jar:/wdcloud/app/hbase-1.1./lib/jets3t-0.9..jar:/wdcloud/app/hbase-1.1./lib/jettison-1.3..jar:/wdcloud/app/hbase-1.1./lib/jetty-6.1..jar:/wdcloud/app/hbase-1.1./lib/jetty-sslengine-6.1..jar:/wdcloud/app/hbase-1.1./lib/jetty-util-6.1..jar:/wdcloud/app/hbase-1.1./lib/joni-2.1..jar:/wdcloud/app/hbase-1.1./lib/jruby-complete-1.6..jar:/wdcloud/app/hbase-1.1./lib/jsch-0.1..jar:/wdcloud/app/hbase-1.1./lib/jsp-2.1-6.1..jar:/wdcloud/app/hbase-1.1./lib/jsp-api-2.1-6.1..jar:/wdcloud/app/hbase-1.1./lib/junit-4.12.jar:/wdcloud/app/hbase-1.1./lib/leveldbjni-all-1.8.jar:/wdcloud/app/hbase-1.1./lib/libthrift-0.9..jar:/wdcloud/app/hbase-1.1./lib/log4j-1.2..jar:/wdcloud/app/hbase-1.1./lib/metrics-core-2.2..jar:/wdcloud/app/hbase-1.1./lib/netty-3.2..Final.jar:/wdcloud/app/hbase-1.1./lib/netty-all-4.0..Final.jar:/wdcloud/app/hbase-1.1./lib/paranamer-2.3.jar:/wdcloud/app/hbase-1.1./lib/protobuf-java-2.5..jar:/wdcloud/app/hbase-1.1./lib/servlet-api-2.5-6.1..jar:/wdcloud/app/hbase-1.1./lib/servlet-api-2.5.jar:/wdcloud/app/hbase-1.1./lib/slf4j-api-1.7..jar:/wdcloud/app/hbase-1.1./lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hbase-1.1./lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hbase-1.1./lib/spymemcached-2.11..jar:/wdcloud/app/hbase-1.1./lib/xmlenc-0.52.jar:/wdcloud/app/hbase-1.1./lib/xz-1.0.jar:/wdcloud/app/hbase-1.1./lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./etc/hadoop:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jets3t-0.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpclient-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpcore-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-api-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/gson-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-auth-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-util-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-framework-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsch-0.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-recipes-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/mockito-all-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-math3-3.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-daemon-1.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-all-4.0..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xercesImpl-2.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xml-apis-1.3..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-api-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-tests-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-registry-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./contrib/capacity-scheduler/*.jar:/wdcloud/app/sqoop-1.4.6/sqoop-1.4.6.jar:/wdcloud/app/sqoop-1.4.6/sqoop-test-1.4.6.jar::/wdcloud/app/hadoop-2.7.3/contrib/capacity-scheduler/*.jar

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/wdcloud/app/hadoop-2.7.3/lib/native

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-229.el7.x86_64

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.dir=/wdcloud/app/sqoop-1.4.6/bin

17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183 sessionTimeout=90000 watcher=hconnection-0x333d2dad0x0, quorum=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183, baseZNode=/hbase

17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181. Will not attempt to authenticate using SASL (unknown error)

17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Socket connection established to hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, initiating session

17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Session establishment complete on server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, sessionid = 0x159cecea3b60004, negotiated timeout = 40000

17/01/24 01:56:12 INFO mapreduce.HBaseImportJob: Creating missing column family product

17/01/24 01:56:12 INFO client.HBaseAdmin: Started disable of WIDGETS_IN_HBASE

17/01/24 01:56:15 INFO client.HBaseAdmin: Disabled WIDGETS_IN_HBASE

17/01/24 01:56:16 INFO client.HBaseAdmin: Started enable of WIDGETS_IN_HBASE

17/01/24 01:56:17 INFO client.HBaseAdmin: Enabled WIDGETS_IN_HBASE

17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService

17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x159cecea3b60004

17/01/24 01:56:17 INFO zookeeper.ZooKeeper: Session: 0x159cecea3b60004 closed

17/01/24 01:56:17 INFO zookeeper.ClientCnxn: EventThread shut down

17/01/24 01:56:17 INFO client.RMProxy: Connecting to ResourceManager at hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:8032

17/01/24 01:56:24 INFO db.DBInputFormat: Using read commited transaction isolation

17/01/24 01:56:24 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`id`), MAX(`id`) FROM `widgets`

17/01/24 01:56:24 INFO mapreduce.JobSubmitter: number of splits:4

17/01/24 01:56:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1485230213604_0007

17/01/24 01:56:26 INFO impl.YarnClientImpl: Submitted application application_1485230213604_0007

17/01/24 01:56:26 INFO mapreduce.Job: The url to track the job: http://hadoop-allinone-200-123.wdcloud.locl:8088/proxy/application_1485230213604_0007/

17/01/24 01:56:26 INFO mapreduce.Job: Running job: job_1485230213604_0007

17/01/24 01:56:42 INFO mapreduce.Job: Job job_1485230213604_0007 running in uber mode : false

17/01/24 01:56:42 INFO mapreduce.Job:  map 0% reduce 0%

17/01/24 01:57:00 INFO mapreduce.Job:  map 25% reduce 0%

17/01/24 01:57:01 INFO mapreduce.Job:  map 75% reduce 0%

17/01/24 01:57:02 INFO mapreduce.Job:  map 100% reduce 0%

17/01/24 01:57:03 INFO mapreduce.Job: Job job_1485230213604_0007 completed successfully

17/01/24 01:57:03 INFO mapreduce.Job: Counters: 31

    File System Counters

        FILE: Number of bytes read=0

        FILE: Number of bytes written=672888

        FILE: Number of read operations=0

        FILE: Number of large read operations=0

        FILE: Number of write operations=0

        HDFS: Number of bytes read=393

        HDFS: Number of bytes written=0

        HDFS: Number of read operations=4

        HDFS: Number of large read operations=0

        HDFS: Number of write operations=0

    Job Counters

        Killed map tasks=1

        Launched map tasks=4

        Other local map tasks=4

        Total time spent by all maps in occupied slots (ms)=59561

        Total time spent by all reduces in occupied slots (ms)=0

        Total time spent by all map tasks (ms)=59561

        Total vcore-milliseconds taken by all map tasks=59561

        Total megabyte-milliseconds taken by all map tasks=60990464

    Map-Reduce Framework

        Map input records=4

        Map output records=4

        Input split bytes=393

        Spilled Records=0

        Failed Shuffles=0

        Merged Map outputs=0

        GC time elapsed (ms)=1163

        CPU time spent (ms)=17450

        Physical memory (bytes) snapshot=1051938816

        Virtual memory (bytes) snapshot=11712344064

        Total committed heap usage (bytes)=882900992

    File Input Format Counters

        Bytes Read=0

    File Output Format Counters

        Bytes Written=0

17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 46.0288 seconds (0 bytes/sec)

17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Retrieved 4 records.

查看作业历史执行情况

查看hbase表 WIDGETS_IN_HBASE 数据

追加数据，与导入hdfs不同，无需使用--append 参数，再次运行导入命令即可重新导入新数据

[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE的更多相关文章

[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入hive
安装hive 1.下载hive-2.1.1(搭配hadoop版本为2.7.3) 2.解压到文件夹下 /wdcloud/app/hive-2.1.1 3.配置环境变量 4.在mysql上创建元数据库hi ...
[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 数据在mysq和hdfs之间的相互转换
P573 从mysql导入数据到hdfs 第一步:在mysql中创建待导入的数据 1.创建数据库并允许所有用户访问该数据库 mysql -h 192.168.200.250 -u root -p CR ...
《android开发艺术探索》读书笔记（十五）--Android性能优化
接上篇<android开发艺术探索>读书笔记(十四)--JNI和NDK编程 No1: 如果<include>制定了这个id属性,同时被包含的布局文件的根元素也制定了id属性,那 ...
《LINUX内核设计与实现》读书笔记之第五章
第五章——系统调用 5.1 与内核通信 1.为用户空间提供一种硬件的抽象接口 2.保证系统稳定和安全 3.除异常和陷入,是内核唯一的合法入口. API.POSIX和C库关于Unix接口设计:提供机制 ...
Linux内核分析读书笔记（第五章）
第五章系统调用 5.1 与内核通信 1.调用在用户空间进程和硬件设备之间添加了一个中间层.该层主要作用有三个: 为用户空间提供了硬件的抽象接口. 系统调用保证了系统的稳定和安全. 实现多任务和虚拟内 ...
《深入理解java虚拟机》读书笔记四——第五章
第五章调优案例分析与实战
《APUE》读书笔记第十二章-线程控制
本章中,主要是介绍控制线程行为方面的内容,同时介绍了在同一进程中的多个线程之间如何保持数据的私有性以及基于进程的系统调用如何与线程进行交互. 一.线程属性我们在创建线程的时候可以通过修改pthrea ...
Programming In Scala笔记-第十五章、Case Classes和模式匹配
本章主要分析case classes和模式匹配(pattern matching). 一.简单例子接下来首先以一个包含case classes和模式匹配的例子来展开本章内容. 下面的例子中将模拟实现 ...
C primer plus 读书笔记第十四章
这一章主要介绍C语言的结构和其他数据形式,是学习算法和数据结构的重点. 1.示例代码 /*book.c -- 仅包含一本书的图书目录*/ #include <stdio.h> #defin ...

随机推荐

Atitit codeblock c++开发环境建立attilax总结
Atitit codeblock c++开发环境建立attilax总结 1.1. C++的重要意义 1 1.2. 项目ide的选项 1 1.3. 安装MinGW (基于GCC的C++编译器) 50 ...
autofac IOC
http://www.cnblogs.com/liupeng/p/4806184.html srvanyui 自建服务
python2和Python3异同总结
1. python3 异常不再接收逗号(,)作为参数: ## python3 中这样可以正常运行 try: print("在这里执行的代码,有异常进入except") except ...
菜鸟学Java（十五）——Java反射机制（二）
上一篇博文<菜鸟学编程(九)——Java反射机制(一)>里面,向大家介绍了什么是Java的反射机制,以及Java的反射机制有什么用.上一篇比较偏重理论,理论的东西给人讲出来总感觉虚无缥缈, ...
【小白的CFD之旅】20 计算区域的构建
计算域是什么计算域如何创建常用的建模软件计算域几何的特殊之处具体的计算域提取方法小白总结自从上次在食堂听了小牛师兄关于计算网格的一些问题后,小白决定在寒假期间好好的补习一下关于计算网格的划分内容.在 ...
PHP网站环境搭配： Apache Http+PHP+Mysql
Apache Http+PHP+Mysql 环境搭配 1. 先下载上述三个软件都要下载对应系统的软件,mysql还可以再下载navicat for mysql. 2. 安装Apache Http ...
【原理】Java的ThreadLocal实现原理浅读
当前线程的值传递,ThreadLocal 通过ThreadLocal设值,在线程内可获取,即时获取值时在其它Class或其它Method. public class BasicUsage { priv ...
【转载】关于Java String, StringBuilder, StringBuffer, Hashtable, HashMap的面试题
REF: http://blog.csdn.net/fightforyourdream/article/details/15333405 题目是一道简单的小程序,像下面这样:[java] view p ...
（转载）设计模式之-策略模式（Strategy）
原文:http://blog.sina.com.cn/s/blog_48df74430100t2m7.html 前言部门组织培训,<Effective Java>,每人每天给大家讲解一节 ...
电商网站jQuery放大镜代码
分享一款电商网站jQuery放大镜代码.这是一款基于jquery.elevatezoom插件实现的类似淘宝放大镜代码,提供40多种参数,可自由配置多种效果,适合电商或图片类网站使用.效果图如下: 在线 ...

[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE

[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE的更多相关文章

随机推荐

热门专题