[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE
导入命令
sqoop import
--connect jdbc:mysql://192.168.200.250:3306/sqoop
--table widgets
--hbase-create-table
--hbase-table WIDGETS_IN_HBASE
--column-family product
--hbase-row-key id
--username 'root'
-P
说明:
--connect jdbc:mysql://192.168.200.250:3306/sqoop 表示远程或者本地 Mysql 服务的URI,3306是Mysql默认监听端口, sqoop 是数据库,若是其他数据库,如Oracle,只需修改URI即可。
--table widgets 表示导出 sqoop 数据库的 widgets 表。
--hbase-table WIDGETS_IN_HBASE 表示在HBase中建立表 WIDGETS_IN_HBASE 。
--column-family product 表示在表A中建立列族 product 。
--hbase-row-key id 表示表 WIDGETS_IN_HBASE 的row-key是 widgets 表的id字段。
--hbase-create-table 表示在HBase中建立表。
--username 'root' 表示使用用户root连接Mysql。
sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-create-table --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --username 'root' -P
报错:
如上可知,找不到HBASE的classpath,加载不到JAR,因此将$HBASE_HOME 设置到环境变量中:
再次执行sqoop导入
据说是兼容性问题,手动创建该表
再次执行,成功!
后台日志:
[hadoop@hadoop-allinone-- bin]$
sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --hbase-create-table --username 'root' -P// :: INFO sqoop.Sqoop: Running Sqoop version: 1.4.
Enter password:
// :: INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
// :: INFO tool.CodeGenTool: Beginning code generation
// :: INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT
// :: INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT
// :: INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /wdcloud/app/hadoop-2.7.
Note: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
// :: INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.jar
// :: WARN manager.MySQLManager: It looks like you are importing from mysql.
// :: WARN manager.MySQLManager: This transfer can be faster! Use the --direct
// :: WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
// :: INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
// :: INFO mapreduce.ImportJobBase: Beginning import of widgets
// :: INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/wdcloud/app/hbase-1.1./lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
// :: INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
// :: INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
// :: INFO zookeeper.RecoverableZooKeeper:
Process identifier=hconnection-0x333d2dad connecting to ZooKeeper ensemble=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183
// :: INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.-, built on // : GMT
// :: INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop-allinone--.wdcloud.locl
// :: INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_67
// :: INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
// :: INFO zookeeper.ZooKeeper: Client environment:java.home=/wdcloud/app/jdk1u7/jre
// :: INFO zookeeper.ZooKeeper: Client environment:java.class.path=/wdcloud/app/hadoop-2.7./etc/hadoop:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jets3t-0.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpclient-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpcore-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-api-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/gson-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-auth-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-util-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-framework-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsch-0.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-recipes-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/mockito-all-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-math3-3.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-daemon-1.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-all-4.0..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xercesImpl-2.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xml-apis-1.3..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-api-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-tests-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-registry-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.-tests.jar:/wdcloud/app/sqoop-1.4./conf::/wdcloud/app/sqoop-1.4./lib/ant-contrib-.0b3.jar:/wdcloud/app/sqoop-1.4./lib/ant-eclipse-1.0-jvm1..jar:/wdcloud/app/sqoop-1.4./lib/avro-1.7..jar:/wdcloud/app/sqoop-1.4./lib/avro-mapred-1.7.-hadoop2.jar:/wdcloud/app/sqoop-1.4./lib/commons-codec-1.4.jar:/wdcloud/app/sqoop-1.4./lib/commons-compress-1.4..jar:/wdcloud/app/sqoop-1.4./lib/commons-io-1.4.jar:/wdcloud/app/sqoop-1.4./lib/commons-jexl-2.1..jar:/wdcloud/app/sqoop-1.4./lib/commons-logging-1.1..jar:/wdcloud/app/sqoop-1.4./lib/hsqldb-1.8.0.10.jar:/wdcloud/app/sqoop-1.4./lib/jackson-annotations-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-core-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-core-asl-1.9..jar:/wdcloud/app/sqoop-1.4./lib/jackson-databind-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-core-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-hive-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-mapreduce-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-hadoop-compatibility-1.0..jar:/wdcloud/app/sqoop-1.4./lib/mysql-connector-java-5.1.-bin.jar:/wdcloud/app/sqoop-1.4./lib/opencsv-2.3.jar:/wdcloud/app/sqoop-1.4./lib/paranamer-2.3.jar:/wdcloud/app/sqoop-1.4./lib/parquet-avro-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-column-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-common-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-encoding-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-format-2.0..jar:/wdcloud/app/sqoop-1.4./lib/parquet-generator-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-hadoop-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-jackson-1.4..jar:/wdcloud/app/sqoop-1.4./lib/slf4j-api-1.6..jar:/wdcloud/app/sqoop-1.4./lib/snappy-java-1.0..jar:/wdcloud/app/sqoop-1.4./lib/xz-1.0.jar:/wdcloud/app/hbase-1.1./conf:/wdcloud/app/jdk1u7/lib/tools.jar:/wdcloud/app/hbase-1.1.:/wdcloud/app/hbase-1.1./lib/activation-1.1.jar:/wdcloud/app/hbase-1.1./lib/aopalliance-1.0.jar:/wdcloud/app/hbase-1.1./lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hbase-1.1./lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hbase-1.1./lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hbase-1.1./lib/api-util-1.0.-M20.jar:/wdcloud/app/hbase-1.1./lib/asm-3.1.jar:/wdcloud/app/hbase-1.1./lib/avro-1.7..jar:/wdcloud/app/hbase-1.1./lib/commons-beanutils-1.7..jar:/wdcloud/app/hbase-1.1./lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hbase-1.1./lib/commons-cli-1.2.jar:/wdcloud/app/hbase-1.1./lib/commons-codec-1.9.jar:/wdcloud/app/hbase-1.1./lib/commons-collections-3.2..jar:/wdcloud/app/hbase-1.1./lib/commons-compress-1.4..jar:/wdcloud/app/hbase-1.1./lib/commons-configuration-1.6.jar:/wdcloud/app/hbase-1.1./lib/commons-daemon-1.0..jar:/wdcloud/app/hbase-1.1./lib/commons-digester-1.8.jar:/wdcloud/app/hbase-1.1./lib/commons-el-1.0.jar:/wdcloud/app/hbase-1.1./lib/commons-httpclient-3.1.jar:/wdcloud/app/hbase-1.1./lib/commons-io-2.4.jar:/wdcloud/app/hbase-1.1./lib/commons-lang-2.6.jar:/wdcloud/app/hbase-1.1./lib/commons-logging-1.2.jar:/wdcloud/app/hbase-1.1./lib/commons-math-2.2.jar:/wdcloud/app/hbase-1.1./lib/commons-math3-3.1..jar:/wdcloud/app/hbase-1.1./lib/commons-net-3.1.jar:/wdcloud/app/hbase-1.1./lib/disruptor-3.3..jar:/wdcloud/app/hbase-1.1./lib/findbugs-annotations-1.3.-.jar:/wdcloud/app/hbase-1.1./lib/guava-12.0..jar:/wdcloud/app/hbase-1.1./lib/guice-3.0.jar:/wdcloud/app/hbase-1.1./lib/guice-servlet-3.0.jar:/wdcloud/app/hbase-1.1./lib/hadoop-annotations-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-auth-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-client-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-hdfs-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-app-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-core-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-jobclient-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-shuffle-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-api-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-client-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-server-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hbase-annotations-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-annotations-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-client-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-common-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-common-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-examples-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-hadoop2-compat-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-hadoop-compat-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-it-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-it-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-prefix-tree-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-procedure-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-protocol-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-resource-bundle-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-rest-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-server-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-server-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-shell-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-thrift-1.1..jar:/wdcloud/app/hbase-1.1./lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hbase-1.1./lib/httpclient-4.2..jar:/wdcloud/app/hbase-1.1./lib/httpcore-4.1..jar:/wdcloud/app/hbase-1.1./lib/jackson-core-asl-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-xc-1.9..jar:/wdcloud/app/hbase-1.1./lib/jamon-runtime-2.3..jar:/wdcloud/app/hbase-1.1./lib/jasper-compiler-5.5..jar:/wdcloud/app/hbase-1.1./lib/jasper-runtime-5.5..jar:/wdcloud/app/hbase-1.1./lib/javax.inject-.jar:/wdcloud/app/hbase-1.1./lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hbase-1.1./lib/jaxb-api-2.2..jar:/wdcloud/app/hbase-1.1./lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hbase-1.1./lib/jcodings-1.0..jar:/wdcloud/app/hbase-1.1./lib/jersey-client-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-core-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-guice-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-json-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-server-1.9.jar:/wdcloud/app/hbase-1.1./lib/jets3t-0.9..jar:/wdcloud/app/hbase-1.1./lib/jettison-1.3..jar:/wdcloud/app/hbase-1.1./lib/jetty-6.1..jar:/wdcloud/app/hbase-1.1./lib/jetty-sslengine-6.1..jar:/wdcloud/app/hbase-1.1./lib/jetty-util-6.1..jar:/wdcloud/app/hbase-1.1./lib/joni-2.1..jar:/wdcloud/app/hbase-1.1./lib/jruby-complete-1.6..jar:/wdcloud/app/hbase-1.1./lib/jsch-0.1..jar:/wdcloud/app/hbase-1.1./lib/jsp-2.1-6.1..jar:/wdcloud/app/hbase-1.1./lib/jsp-api-2.1-6.1..jar:/wdcloud/app/hbase-1.1./lib/junit-4.12.jar:/wdcloud/app/hbase-1.1./lib/leveldbjni-all-1.8.jar:/wdcloud/app/hbase-1.1./lib/libthrift-0.9..jar:/wdcloud/app/hbase-1.1./lib/log4j-1.2..jar:/wdcloud/app/hbase-1.1./lib/metrics-core-2.2..jar:/wdcloud/app/hbase-1.1./lib/netty-3.2..Final.jar:/wdcloud/app/hbase-1.1./lib/netty-all-4.0..Final.jar:/wdcloud/app/hbase-1.1./lib/paranamer-2.3.jar:/wdcloud/app/hbase-1.1./lib/protobuf-java-2.5..jar:/wdcloud/app/hbase-1.1./lib/servlet-api-2.5-6.1..jar:/wdcloud/app/hbase-1.1./lib/servlet-api-2.5.jar:/wdcloud/app/hbase-1.1./lib/slf4j-api-1.7..jar:/wdcloud/app/hbase-1.1./lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hbase-1.1./lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hbase-1.1./lib/spymemcached-2.11..jar:/wdcloud/app/hbase-1.1./lib/xmlenc-0.52.jar:/wdcloud/app/hbase-1.1./lib/xz-1.0.jar:/wdcloud/app/hbase-1.1./lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./etc/hadoop:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jets3t-0.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpclient-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpcore-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-api-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/gson-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-auth-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-util-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-framework-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsch-0.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-recipes-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/mockito-all-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-math3-3.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-daemon-1.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-all-4.0..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xercesImpl-2.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xml-apis-1.3..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-api-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-tests-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-registry-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./contrib/capacity-scheduler/*.jar:/wdcloud/app/sqoop-1.4.6/sqoop-1.4.6.jar:/wdcloud/app/sqoop-1.4.6/sqoop-test-1.4.6.jar::/wdcloud/app/hadoop-2.7.3/contrib/capacity-scheduler/*.jar
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/wdcloud/app/hadoop-2.7.3/lib/native
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-229.el7.x86_64
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.dir=/wdcloud/app/sqoop-1.4.6/bin
17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183 sessionTimeout=90000 watcher=hconnection-0x333d2dad0x0, quorum=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183, baseZNode=/hbase
17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181. Will not attempt to authenticate using SASL (unknown error)
17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Socket connection established to hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, initiating session
17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Session establishment complete on server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, sessionid = 0x159cecea3b60004, negotiated timeout = 40000
17/01/24 01:56:12 INFO mapreduce.HBaseImportJob: Creating missing column family product
17/01/24 01:56:12 INFO client.HBaseAdmin: Started disable of WIDGETS_IN_HBASE
17/01/24 01:56:15 INFO client.HBaseAdmin: Disabled WIDGETS_IN_HBASE
17/01/24 01:56:16 INFO client.HBaseAdmin: Started enable of WIDGETS_IN_HBASE
17/01/24 01:56:17 INFO client.HBaseAdmin: Enabled WIDGETS_IN_HBASE
17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService
17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x159cecea3b60004
17/01/24 01:56:17 INFO zookeeper.ZooKeeper: Session: 0x159cecea3b60004 closed
17/01/24 01:56:17 INFO zookeeper.ClientCnxn: EventThread shut down
17/01/24 01:56:17 INFO client.RMProxy: Connecting to ResourceManager at hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:8032
17/01/24 01:56:24 INFO db.DBInputFormat: Using read commited transaction isolation
17/01/24 01:56:24 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`id`), MAX(`id`) FROM `widgets`
17/01/24 01:56:24 INFO mapreduce.JobSubmitter: number of splits:4
17/01/24 01:56:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1485230213604_0007
17/01/24 01:56:26 INFO impl.YarnClientImpl: Submitted application application_1485230213604_0007
17/01/24 01:56:26 INFO mapreduce.Job: The url to track the job: http://hadoop-allinone-200-123.wdcloud.locl:8088/proxy/application_1485230213604_0007/
17/01/24 01:56:26 INFO mapreduce.Job: Running job: job_1485230213604_0007
17/01/24 01:56:42 INFO mapreduce.Job: Job job_1485230213604_0007 running in uber mode : false
17/01/24 01:56:42 INFO mapreduce.Job: map 0% reduce 0%
17/01/24 01:57:00 INFO mapreduce.Job: map 25% reduce 0%
17/01/24 01:57:01 INFO mapreduce.Job: map 75% reduce 0%
17/01/24 01:57:02 INFO mapreduce.Job: map 100% reduce 0%
17/01/24 01:57:03 INFO mapreduce.Job: Job job_1485230213604_0007 completed successfully
17/01/24 01:57:03 INFO mapreduce.Job: Counters: 31
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=672888
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=393
HDFS: Number of bytes written=0
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=0
Job Counters
Killed map tasks=1
Launched map tasks=4
Other local map tasks=4
Total time spent by all maps in occupied slots (ms)=59561
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=59561
Total vcore-milliseconds taken by all map tasks=59561
Total megabyte-milliseconds taken by all map tasks=60990464
Map-Reduce Framework
Map input records=4
Map output records=4
Input split bytes=393
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=1163
CPU time spent (ms)=17450
Physical memory (bytes) snapshot=1051938816
Virtual memory (bytes) snapshot=11712344064
Total committed heap usage (bytes)=882900992
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0
17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 46.0288 seconds (0 bytes/sec)
17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Retrieved 4 records.
查看作业历史执行情况
查看hbase表 WIDGETS_IN_HBASE 数据
追加数据,与导入hdfs不同,无需使用--append 参数,再次运行导入命令即可重新导入新数据
[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE的更多相关文章
- [hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入hive
安装hive 1.下载hive-2.1.1(搭配hadoop版本为2.7.3) 2.解压到文件夹下 /wdcloud/app/hive-2.1.1 3.配置环境变量 4.在mysql上创建元数据库hi ...
- [hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 数据在mysq和hdfs之间的相互转换
P573 从mysql导入数据到hdfs 第一步:在mysql中创建待导入的数据 1.创建数据库并允许所有用户访问该数据库 mysql -h 192.168.200.250 -u root -p CR ...
- 《android开发艺术探索》读书笔记(十五)--Android性能优化
接上篇<android开发艺术探索>读书笔记(十四)--JNI和NDK编程 No1: 如果<include>制定了这个id属性,同时被包含的布局文件的根元素也制定了id属性,那 ...
- 《LINUX内核设计与实现》读书笔记之第五章
第五章——系统调用 5.1 与内核通信 1.为用户空间提供一种硬件的抽象接口 2.保证系统稳定和安全 3.除异常和陷入,是内核唯一的合法入口. API.POSIX和C库 关于Unix接口设计:提供机制 ...
- Linux内核分析 读书笔记 (第五章)
第五章 系统调用 5.1 与内核通信 1.调用在用户空间进程和硬件设备之间添加了一个中间层.该层主要作用有三个: 为用户空间提供了硬件的抽象接口. 系统调用保证了系统的稳定和安全. 实现多任务和虚拟内 ...
- 《深入理解java虚拟机》读书笔记四——第五章
第五章 调优案例分析与实战
- 《APUE》读书笔记第十二章-线程控制
本章中,主要是介绍控制线程行为方面的内容,同时介绍了在同一进程中的多个线程之间如何保持数据的私有性以及基于进程的系统调用如何与线程进行交互. 一.线程属性 我们在创建线程的时候可以通过修改pthrea ...
- Programming In Scala笔记-第十五章、Case Classes和模式匹配
本章主要分析case classes和模式匹配(pattern matching). 一.简单例子 接下来首先以一个包含case classes和模式匹配的例子来展开本章内容. 下面的例子中将模拟实现 ...
- C primer plus 读书笔记第十四章
这一章主要介绍C语言的结构和其他数据形式,是学习算法和数据结构的重点. 1.示例代码 /*book.c -- 仅包含一本书的图书目录*/ #include <stdio.h> #defin ...
随机推荐
- 【八】注入框架RoboGuice使用:(Your First Injected Fragment)
上一篇我们简单的介绍了一下RoboGuice的使用([七]注入框架RoboGuice使用:(Your First Custom Binding)),今天我们来看下fragment的注解 ...
- 【R】R语言常用函数
R语言常用函数 基本 一.数据管理vector:向量 numeric:数值型向量 logical:逻辑型向量character:字符型向量 list:列表 data.frame:数据框c:连接为向量或 ...
- Java 技术新手入门
对于想学习Java的朋友 请参考IBM旗下站点:http://www.ibm.com/developerworks/cn/java/newto/index.html 我看了下对于新手有很好的指导,并且 ...
- IBM研究院找到度量安全性方法:容器与虚拟机,谁更安全?
https://zhuanlan.zhihu.com/p/40446759 虚拟机比容器更安全吗?你可能会有自己的答案,但IBM研究院发现容器的安全性与虚拟机一样,甚至更加安全. 一般来说,从接口宽度 ...
- Splunk Web页面的登录密码忘记了怎么办
splunk的web登录密码忘记的话,可以使用以下方法重置. 一.关闭splunk服务 /opt/splunk/bin/splunk stop 二.删除默认密码配置文件 三.重启启动splunk服务, ...
- 利用babel-cli搭建支持ES6的node环境
现在ES6盛行,开始大量使用ES6的特性敲代码,但限于Node.js本身对ES6的特性支持的不够完备,那么需要借助于其他工具来完成. 基本上,现在都直接写ES6的代码,然后使用babel-cli提供的 ...
- 【ARM】ARM程序规范
1.函数名单词之间用_隔开,每一个字母大写 Uart_Printf() //这个由三星的TEST风格延续下来,因此没有参数时,必须加void,否则ADS会编译报警 void Te ...
- 使用BC库解密出现no such provider错误
使用BC库解密出现no such provider错误 错误提示如下: Exception in thread "main" java.security.NoSuchProvide ...
- strrchr()函数
函数简介 函数名称: strrchr 函数原型:char *strrchr(const char *str, char c); 所属库: string.h 函数功能:查找一个字符c在另一个字符串str ...
- Django-管理站点重写admin模板
参考链接:https://blog.csdn.net/u013378306/article/details/79023242 使用Django的admin管理工具,可以快速的构建自己的管理平台,使用D ...