[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE
导入命令
- sqoop import
- --connect jdbc:mysql://192.168.200.250:3306/sqoop
- --table widgets
- --hbase-create-table
- --hbase-table WIDGETS_IN_HBASE
- --column-family product
- --hbase-row-key id
- --username 'root'
- -P
说明:
--connect jdbc:mysql://192.168.200.250:3306/sqoop 表示远程或者本地 Mysql 服务的URI,3306是Mysql默认监听端口, sqoop 是数据库,若是其他数据库,如Oracle,只需修改URI即可。
--table widgets 表示导出 sqoop 数据库的 widgets 表。
--hbase-table WIDGETS_IN_HBASE 表示在HBase中建立表 WIDGETS_IN_HBASE 。
--column-family product 表示在表A中建立列族 product 。
--hbase-row-key id 表示表 WIDGETS_IN_HBASE 的row-key是 widgets 表的id字段。
--hbase-create-table 表示在HBase中建立表。
--username 'root' 表示使用用户root连接Mysql。
- sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-create-table --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --username 'root' -P
报错:
如上可知,找不到HBASE的classpath,加载不到JAR,因此将$HBASE_HOME 设置到环境变量中:
再次执行sqoop导入
据说是兼容性问题,手动创建该表
再次执行,成功!
后台日志:
- [hadoop@hadoop-allinone-- bin]$
sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --hbase-create-table --username 'root' -P// :: INFO sqoop.Sqoop: Running Sqoop version: 1.4.- Enter password:
- // :: INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
- // :: INFO tool.CodeGenTool: Beginning code generation
- // :: INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT
- // :: INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT
- // :: INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /wdcloud/app/hadoop-2.7.
- Note: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.java uses or overrides a deprecated API.
- Note: Recompile with -Xlint:deprecation for details.
- // :: INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.jar
- // :: WARN manager.MySQLManager: It looks like you are importing from mysql.
- // :: WARN manager.MySQLManager: This transfer can be faster! Use the --direct
- // :: WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
- // :: INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
- // :: INFO mapreduce.ImportJobBase: Beginning import of widgets
- // :: INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
- SLF4J: Class path contains multiple SLF4J bindings.
- SLF4J: Found binding in [jar:file:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]
- SLF4J: Found binding in [jar:file:/wdcloud/app/hbase-1.1./lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]
- SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
- SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
- // :: INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
- // :: INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
- // :: INFO zookeeper.RecoverableZooKeeper:
Process identifier=hconnection-0x333d2dad connecting to ZooKeeper ensemble=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183- // :: INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.-, built on // : GMT
- // :: INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop-allinone--.wdcloud.locl
- // :: INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_67
- // :: INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
- // :: INFO zookeeper.ZooKeeper: Client environment:java.home=/wdcloud/app/jdk1u7/jre
- // :: INFO zookeeper.ZooKeeper: Client environment:java.class.path=/wdcloud/app/hadoop-2.7./etc/hadoop:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jets3t-0.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpclient-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpcore-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-api-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/gson-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-auth-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-util-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-framework-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsch-0.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-recipes-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/mockito-all-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-math3-3.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-daemon-1.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-all-4.0..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xercesImpl-2.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xml-apis-1.3..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-api-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-tests-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-registry-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.-tests.jar:/wdcloud/app/sqoop-1.4./conf::/wdcloud/app/sqoop-1.4./lib/ant-contrib-.0b3.jar:/wdcloud/app/sqoop-1.4./lib/ant-eclipse-1.0-jvm1..jar:/wdcloud/app/sqoop-1.4./lib/avro-1.7..jar:/wdcloud/app/sqoop-1.4./lib/avro-mapred-1.7.-hadoop2.jar:/wdcloud/app/sqoop-1.4./lib/commons-codec-1.4.jar:/wdcloud/app/sqoop-1.4./lib/commons-compress-1.4..jar:/wdcloud/app/sqoop-1.4./lib/commons-io-1.4.jar:/wdcloud/app/sqoop-1.4./lib/commons-jexl-2.1..jar:/wdcloud/app/sqoop-1.4./lib/commons-logging-1.1..jar:/wdcloud/app/sqoop-1.4./lib/hsqldb-1.8.0.10.jar:/wdcloud/app/sqoop-1.4./lib/jackson-annotations-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-core-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-core-asl-1.9..jar:/wdcloud/app/sqoop-1.4./lib/jackson-databind-2.3..jar:/wdcloud/app/sqoop-1.4./lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-core-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-hive-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-data-mapreduce-1.0..jar:/wdcloud/app/sqoop-1.4./lib/kite-hadoop-compatibility-1.0..jar:/wdcloud/app/sqoop-1.4./lib/mysql-connector-java-5.1.-bin.jar:/wdcloud/app/sqoop-1.4./lib/opencsv-2.3.jar:/wdcloud/app/sqoop-1.4./lib/paranamer-2.3.jar:/wdcloud/app/sqoop-1.4./lib/parquet-avro-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-column-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-common-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-encoding-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-format-2.0..jar:/wdcloud/app/sqoop-1.4./lib/parquet-generator-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-hadoop-1.4..jar:/wdcloud/app/sqoop-1.4./lib/parquet-jackson-1.4..jar:/wdcloud/app/sqoop-1.4./lib/slf4j-api-1.6..jar:/wdcloud/app/sqoop-1.4./lib/snappy-java-1.0..jar:/wdcloud/app/sqoop-1.4./lib/xz-1.0.jar:/wdcloud/app/hbase-1.1./conf:/wdcloud/app/jdk1u7/lib/tools.jar:/wdcloud/app/hbase-1.1.:/wdcloud/app/hbase-1.1./lib/activation-1.1.jar:/wdcloud/app/hbase-1.1./lib/aopalliance-1.0.jar:/wdcloud/app/hbase-1.1./lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hbase-1.1./lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hbase-1.1./lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hbase-1.1./lib/api-util-1.0.-M20.jar:/wdcloud/app/hbase-1.1./lib/asm-3.1.jar:/wdcloud/app/hbase-1.1./lib/avro-1.7..jar:/wdcloud/app/hbase-1.1./lib/commons-beanutils-1.7..jar:/wdcloud/app/hbase-1.1./lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hbase-1.1./lib/commons-cli-1.2.jar:/wdcloud/app/hbase-1.1./lib/commons-codec-1.9.jar:/wdcloud/app/hbase-1.1./lib/commons-collections-3.2..jar:/wdcloud/app/hbase-1.1./lib/commons-compress-1.4..jar:/wdcloud/app/hbase-1.1./lib/commons-configuration-1.6.jar:/wdcloud/app/hbase-1.1./lib/commons-daemon-1.0..jar:/wdcloud/app/hbase-1.1./lib/commons-digester-1.8.jar:/wdcloud/app/hbase-1.1./lib/commons-el-1.0.jar:/wdcloud/app/hbase-1.1./lib/commons-httpclient-3.1.jar:/wdcloud/app/hbase-1.1./lib/commons-io-2.4.jar:/wdcloud/app/hbase-1.1./lib/commons-lang-2.6.jar:/wdcloud/app/hbase-1.1./lib/commons-logging-1.2.jar:/wdcloud/app/hbase-1.1./lib/commons-math-2.2.jar:/wdcloud/app/hbase-1.1./lib/commons-math3-3.1..jar:/wdcloud/app/hbase-1.1./lib/commons-net-3.1.jar:/wdcloud/app/hbase-1.1./lib/disruptor-3.3..jar:/wdcloud/app/hbase-1.1./lib/findbugs-annotations-1.3.-.jar:/wdcloud/app/hbase-1.1./lib/guava-12.0..jar:/wdcloud/app/hbase-1.1./lib/guice-3.0.jar:/wdcloud/app/hbase-1.1./lib/guice-servlet-3.0.jar:/wdcloud/app/hbase-1.1./lib/hadoop-annotations-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-auth-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-client-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-hdfs-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-app-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-core-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-jobclient-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-mapreduce-client-shuffle-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-api-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-client-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hadoop-yarn-server-common-2.5..jar:/wdcloud/app/hbase-1.1./lib/hbase-annotations-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-annotations-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-client-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-common-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-common-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-examples-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-hadoop2-compat-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-hadoop-compat-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-it-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-it-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-prefix-tree-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-procedure-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-protocol-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-resource-bundle-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-rest-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-server-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-server-1.1.-tests.jar:/wdcloud/app/hbase-1.1./lib/hbase-shell-1.1..jar:/wdcloud/app/hbase-1.1./lib/hbase-thrift-1.1..jar:/wdcloud/app/hbase-1.1./lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hbase-1.1./lib/httpclient-4.2..jar:/wdcloud/app/hbase-1.1./lib/httpcore-4.1..jar:/wdcloud/app/hbase-1.1./lib/jackson-core-asl-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hbase-1.1./lib/jackson-xc-1.9..jar:/wdcloud/app/hbase-1.1./lib/jamon-runtime-2.3..jar:/wdcloud/app/hbase-1.1./lib/jasper-compiler-5.5..jar:/wdcloud/app/hbase-1.1./lib/jasper-runtime-5.5..jar:/wdcloud/app/hbase-1.1./lib/javax.inject-.jar:/wdcloud/app/hbase-1.1./lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hbase-1.1./lib/jaxb-api-2.2..jar:/wdcloud/app/hbase-1.1./lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hbase-1.1./lib/jcodings-1.0..jar:/wdcloud/app/hbase-1.1./lib/jersey-client-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-core-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-guice-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-json-1.9.jar:/wdcloud/app/hbase-1.1./lib/jersey-server-1.9.jar:/wdcloud/app/hbase-1.1./lib/jets3t-0.9..jar:/wdcloud/app/hbase-1.1./lib/jettison-1.3..jar:/wdcloud/app/hbase-1.1./lib/jetty-6.1..jar:/wdcloud/app/hbase-1.1./lib/jetty-sslengine-6.1..jar:/wdcloud/app/hbase-1.1./lib/jetty-util-6.1..jar:/wdcloud/app/hbase-1.1./lib/joni-2.1..jar:/wdcloud/app/hbase-1.1./lib/jruby-complete-1.6..jar:/wdcloud/app/hbase-1.1./lib/jsch-0.1..jar:/wdcloud/app/hbase-1.1./lib/jsp-2.1-6.1..jar:/wdcloud/app/hbase-1.1./lib/jsp-api-2.1-6.1..jar:/wdcloud/app/hbase-1.1./lib/junit-4.12.jar:/wdcloud/app/hbase-1.1./lib/leveldbjni-all-1.8.jar:/wdcloud/app/hbase-1.1./lib/libthrift-0.9..jar:/wdcloud/app/hbase-1.1./lib/log4j-1.2..jar:/wdcloud/app/hbase-1.1./lib/metrics-core-2.2..jar:/wdcloud/app/hbase-1.1./lib/netty-3.2..Final.jar:/wdcloud/app/hbase-1.1./lib/netty-all-4.0..Final.jar:/wdcloud/app/hbase-1.1./lib/paranamer-2.3.jar:/wdcloud/app/hbase-1.1./lib/protobuf-java-2.5..jar:/wdcloud/app/hbase-1.1./lib/servlet-api-2.5-6.1..jar:/wdcloud/app/hbase-1.1./lib/servlet-api-2.5.jar:/wdcloud/app/hbase-1.1./lib/slf4j-api-1.7..jar:/wdcloud/app/hbase-1.1./lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hbase-1.1./lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hbase-1.1./lib/spymemcached-2.11..jar:/wdcloud/app/hbase-1.1./lib/xmlenc-0.52.jar:/wdcloud/app/hbase-1.1./lib/xz-1.0.jar:/wdcloud/app/hbase-1.1./lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./etc/hadoop:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jets3t-0.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpclient-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/httpcore-4.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-beanutils-core-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-api-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/gson-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-auth-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-kerberos-codec-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/apacheds-i18n-2.0.-M15.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-asn1-api-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/api-util-1.0.-M20.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-framework-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsch-0.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/curator-recipes-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/mockito-all-1.8..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-math3-3.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-common-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/common/hadoop-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/htrace-core-3.1.-incubating.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/commons-daemon-1.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/netty-all-4.0..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xercesImpl-2.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/xml-apis-1.3..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/hdfs/hadoop-hdfs-nfs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4.-tests.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guava-11.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jsr305-3.0..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-logging-1.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-api-2.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/stax-api-1.0-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-util-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-jaxrs-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jackson-xc-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jaxb-impl-2.2.-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/zookeeper-3.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/commons-collections-3.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/lib/jetty-6.1..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-api-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-tests-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-client-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/yarn/hadoop-yarn-registry-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/protobuf-java-2.5..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/avro-1.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-core-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-compress-1.4..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hadoop-annotations-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/log4j-1.2..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/netty-3.6..Final.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/javax.inject-.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7..jar:/wdcloud/app/hadoop-2.7./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.-tests.jar:/wdcloud/app/hadoop-2.7./contrib/capacity-scheduler/*.jar:/wdcloud/app/sqoop-1.4.6/sqoop-1.4.6.jar:/wdcloud/app/sqoop-1.4.6/sqoop-test-1.4.6.jar::/wdcloud/app/hadoop-2.7.3/contrib/capacity-scheduler/*.jar
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/wdcloud/app/hadoop-2.7.3/lib/native
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-229.el7.x86_64
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.dir=/wdcloud/app/sqoop-1.4.6/bin
- 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183 sessionTimeout=90000 watcher=hconnection-0x333d2dad0x0, quorum=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183, baseZNode=/hbase
- 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181. Will not attempt to authenticate using SASL (unknown error)
- 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Socket connection established to hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, initiating session
- 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Session establishment complete on server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, sessionid = 0x159cecea3b60004, negotiated timeout = 40000
- 17/01/24 01:56:12 INFO mapreduce.HBaseImportJob: Creating missing column family product
- 17/01/24 01:56:12 INFO client.HBaseAdmin: Started disable of WIDGETS_IN_HBASE
- 17/01/24 01:56:15 INFO client.HBaseAdmin: Disabled WIDGETS_IN_HBASE
- 17/01/24 01:56:16 INFO client.HBaseAdmin: Started enable of WIDGETS_IN_HBASE
- 17/01/24 01:56:17 INFO client.HBaseAdmin: Enabled WIDGETS_IN_HBASE
- 17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService
- 17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x159cecea3b60004
- 17/01/24 01:56:17 INFO zookeeper.ZooKeeper: Session: 0x159cecea3b60004 closed
- 17/01/24 01:56:17 INFO zookeeper.ClientCnxn: EventThread shut down
- 17/01/24 01:56:17 INFO client.RMProxy: Connecting to ResourceManager at hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:8032
- 17/01/24 01:56:24 INFO db.DBInputFormat: Using read commited transaction isolation
- 17/01/24 01:56:24 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`id`), MAX(`id`) FROM `widgets`
- 17/01/24 01:56:24 INFO mapreduce.JobSubmitter: number of splits:4
- 17/01/24 01:56:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1485230213604_0007
- 17/01/24 01:56:26 INFO impl.YarnClientImpl: Submitted application application_1485230213604_0007
- 17/01/24 01:56:26 INFO mapreduce.Job: The url to track the job: http://hadoop-allinone-200-123.wdcloud.locl:8088/proxy/application_1485230213604_0007/
- 17/01/24 01:56:26 INFO mapreduce.Job: Running job: job_1485230213604_0007
- 17/01/24 01:56:42 INFO mapreduce.Job: Job job_1485230213604_0007 running in uber mode : false
- 17/01/24 01:56:42 INFO mapreduce.Job: map 0% reduce 0%
- 17/01/24 01:57:00 INFO mapreduce.Job: map 25% reduce 0%
- 17/01/24 01:57:01 INFO mapreduce.Job: map 75% reduce 0%
- 17/01/24 01:57:02 INFO mapreduce.Job: map 100% reduce 0%
- 17/01/24 01:57:03 INFO mapreduce.Job: Job job_1485230213604_0007 completed successfully
- 17/01/24 01:57:03 INFO mapreduce.Job: Counters: 31
- File System Counters
- FILE: Number of bytes read=0
- FILE: Number of bytes written=672888
- FILE: Number of read operations=0
- FILE: Number of large read operations=0
- FILE: Number of write operations=0
- HDFS: Number of bytes read=393
- HDFS: Number of bytes written=0
- HDFS: Number of read operations=4
- HDFS: Number of large read operations=0
- HDFS: Number of write operations=0
- Job Counters
- Killed map tasks=1
- Launched map tasks=4
- Other local map tasks=4
- Total time spent by all maps in occupied slots (ms)=59561
- Total time spent by all reduces in occupied slots (ms)=0
- Total time spent by all map tasks (ms)=59561
- Total vcore-milliseconds taken by all map tasks=59561
- Total megabyte-milliseconds taken by all map tasks=60990464
- Map-Reduce Framework
- Map input records=4
- Map output records=4
- Input split bytes=393
- Spilled Records=0
- Failed Shuffles=0
- Merged Map outputs=0
- GC time elapsed (ms)=1163
- CPU time spent (ms)=17450
- Physical memory (bytes) snapshot=1051938816
- Virtual memory (bytes) snapshot=11712344064
- Total committed heap usage (bytes)=882900992
- File Input Format Counters
- Bytes Read=0
- File Output Format Counters
- Bytes Written=0
- 17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 46.0288 seconds (0 bytes/sec)
- 17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Retrieved 4 records.
查看作业历史执行情况
查看hbase表 WIDGETS_IN_HBASE 数据
追加数据,与导入hdfs不同,无需使用--append 参数,再次运行导入命令即可重新导入新数据
[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE的更多相关文章
- [hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入hive
安装hive 1.下载hive-2.1.1(搭配hadoop版本为2.7.3) 2.解压到文件夹下 /wdcloud/app/hive-2.1.1 3.配置环境变量 4.在mysql上创建元数据库hi ...
- [hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 数据在mysq和hdfs之间的相互转换
P573 从mysql导入数据到hdfs 第一步:在mysql中创建待导入的数据 1.创建数据库并允许所有用户访问该数据库 mysql -h 192.168.200.250 -u root -p CR ...
- 《android开发艺术探索》读书笔记(十五)--Android性能优化
接上篇<android开发艺术探索>读书笔记(十四)--JNI和NDK编程 No1: 如果<include>制定了这个id属性,同时被包含的布局文件的根元素也制定了id属性,那 ...
- 《LINUX内核设计与实现》读书笔记之第五章
第五章——系统调用 5.1 与内核通信 1.为用户空间提供一种硬件的抽象接口 2.保证系统稳定和安全 3.除异常和陷入,是内核唯一的合法入口. API.POSIX和C库 关于Unix接口设计:提供机制 ...
- Linux内核分析 读书笔记 (第五章)
第五章 系统调用 5.1 与内核通信 1.调用在用户空间进程和硬件设备之间添加了一个中间层.该层主要作用有三个: 为用户空间提供了硬件的抽象接口. 系统调用保证了系统的稳定和安全. 实现多任务和虚拟内 ...
- 《深入理解java虚拟机》读书笔记四——第五章
第五章 调优案例分析与实战
- 《APUE》读书笔记第十二章-线程控制
本章中,主要是介绍控制线程行为方面的内容,同时介绍了在同一进程中的多个线程之间如何保持数据的私有性以及基于进程的系统调用如何与线程进行交互. 一.线程属性 我们在创建线程的时候可以通过修改pthrea ...
- Programming In Scala笔记-第十五章、Case Classes和模式匹配
本章主要分析case classes和模式匹配(pattern matching). 一.简单例子 接下来首先以一个包含case classes和模式匹配的例子来展开本章内容. 下面的例子中将模拟实现 ...
- C primer plus 读书笔记第十四章
这一章主要介绍C语言的结构和其他数据形式,是学习算法和数据结构的重点. 1.示例代码 /*book.c -- 仅包含一本书的图书目录*/ #include <stdio.h> #defin ...
随机推荐
- iconv 使用方法封装
std::string iconv_exec(const std::string& in, const char* fromcode, const char* tocode) { char b ...
- Atitit 快速开发的推荐技术标准化 规范 大原则
Atitit 快速开发的推荐技术标准化 规范 大原则 1. 如何评估什么样的技术适合快速开发??1 1.1. (重要)判断语言层次..层次越高开发效率越高 4gl dsl> 3.5gl &g ...
- 四大Java EE容器(Tomcat、JBoss、Resin、Glassfish)之简单比较
转自:http://www.cxybl.com/html/bcyy/java/201106241007.html 现在流行的Java EE容器有很多:Tomcat.JBoss.Resin.Glassf ...
- android 覆盖安装问题
1.android中覆盖安装不会导致data/data/package下的数据被删除 2.数据库会有数据库的一套升级机制 3.sharepreference 不会被覆盖,如果在app中有使用Key记录 ...
- 【React Native开发】React Native应用设备执行(Running)以及调试(Debugging)(3)
),React Native技术交流4群(458982758),请不要反复加群.欢迎各位大牛,React Native技术爱好者加入交流!同一时候博客左側欢迎微信扫描关注订阅号,移动技术干货,精彩文章 ...
- ASP.NET MVC@model多个对象
需求:同时查看一个产品信息和发布会员的信息 方案1:新建ViewModel 方案2:ViewData.ViewBag 方案3:Tuple<obj1,obj2> 在这里我们使用方案3来实现这 ...
- Asp.Net采集网页方法大全(5种)
/// <summary>方法一:比较推荐 /// 用HttpWebRequest取得网页源码 /// 对于带BOM的网页很有效,不管是什么编码都能正确识别 /// </summar ...
- C#对DataTable里数据筛选排序的方法
在日常开发过程中,有一个DataTable集合,里面有很多字段,现在要求针对某一列进行排序,如果该列为数字的话,进行ASC即可实现,但是该字段类型为string,此时排序就有点不正确了 protect ...
- idea 提示忽略大小写
- JAVA-JSP内置对象之request对象参数
相关资料:<21天学通Java Web开发> request对象1.request对象不但可以用来设置和取得requset范围变量,还可以用来获得客户端请求参数请求的来源.表头.cooki ...