ZooKeeper伪分布式集群安装及使用

让Hadoop跑在云端系列文章，介绍了如何整合虚拟化和Hadoop，让Hadoop集群跑在VPS虚拟主机上，通过云向用户提供存储和计算的服务。

现在硬件越来越便宜，一台非品牌服务器，2颗24核CPU，配48G内存，2T的硬盘，已经降到2万块人民币以下了。这种配置如果简单地放几个web应用，显然是奢侈的浪费。就算是用来实现单节点的hadoop，对计算资源浪费也是非常高的。对于这么高性能的计算机，如何有效利用计算资源，就成为成本控制的一项重要议题了。

通过虚拟化技术，我们可以将一台服务器，拆分成12台VPS，每台2核CPU，4G内存，40G硬盘，并且支持资源重新分配。多么伟大的技术啊！现在我们有了12个节点的hadoop集群， 让Hadoop跑在云端，让世界加速。

关于作者：

  • 张丹(Conan), 程序员Java,R,PHP,Javascript
  • weibo：@Conan_Z
  • blog: http://blog.fens.me
  • email: bsspirit@gmail.com

转载请注明出处：
http://blog.fens.me/hadoop-zookeeper-intro/

前言

ZooKeeper是Hadoop家族的一款高性能的分布式协作的产品。在单机中，系统协作大都是进程级的操作。分布式系统中，服务协作都是跨服务器才能完成的。在ZooKeeper之前，我们对于协作服务大都使用消息中间件，随着分布式系统的普及，用消息中间件完成协作，会有大量的程序开发。ZooKeeper直接面向于分布式系统，可以减少我们自己的开发，帮助我们更好完成分布式系统的数据管理问题。

目录

  1. zookeeper介绍
  2. zookeeper单节点安装
  3. zookeeper伪分布式集群安装
  4. zookeeper命令行操作
  5. Java编程现实命令行操作

1. zookeeper介绍

ZooKeeper是一个为分布式应用所设计的分布的、开源的协调服务，它主要是用来解决分布式应用中经常遇到的一些数据管理问题，简化分布式应用协调及其管理的难度，提供高性能的分布式服务。ZooKeeper本身可以以Standalone模式安装运行，不过它的长处在于通过分布式ZooKeeper集群（一个Leader，多个Follower），基于一定的策略来保证ZooKeeper集群的稳定性和可用性，从而实现分布式应用的可靠性。

ZooKeeper是作为分布式协调服务，是不需要依赖于Hadoop的环境，也可以为其他的分布式环境提供服务。

2. zookeeper单节点安装Standalones模式

系统环境：

  • Linux Ubuntu 12.04.2 LTS 64bit server
  • Java: 1.6.0_29 64-Bit Server VM
  1. ~ uname -a
  2. Linux conan 3.5.0-23-generic #35~precise1-Ubuntu SMP Fri Jan 25 17:13:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
  4. ~ cat /etc/issue
  5. Ubuntu 12.04.2 LTS \n \l
  7. ~ java -version
  8. java version "1.6.0_29"
  9. Java(TM) SE Runtime Environment (build 1.6.0_29-b11)
  10. Java HotSpot(TM) 64-Bit Server VM (build 20.4-b02, mixed mode)

下载zookeeper

  1. ~ mkdir /home/conan/toolkit
  2. ~ cd /home/conan/toolkit
  3. ~ wget http://apache.dataguru.cn/zookeeper/stable/zookeeper-3.4.5.tar.gz
  4. ~ tar xvf zookeeper-3.4.5.tar.gz
  5. ~ mv zookeeper-3.4.5 zookeeper345
  6. ~ cd zookeeper345
  7. ~ ls -l
  8. drwxr-xr-x  2 conan conan    4096 Aug 12 04:34 bin
  9. -rw-r--r--  1 conan conan   75988 Aug 12 04:34 build.xml
  10. -rw-r--r--  1 conan conan   70223 Aug 12 04:34 CHANGES.txt
  11. drwxr-xr-x  2 conan conan    4096 Aug 12 04:34 conf
  12. drwxr-xr-x 10 conan conan    4096 Aug 12 04:34 contrib
  13. drwxr-xr-x  2 conan conan    4096 Aug 12 04:34 dist-maven
  14. drwxr-xr-x  6 conan conan    4096 Aug 12 04:34 docs
  15. -rw-r--r--  1 conan conan    1953 Aug 12 04:34 ivysettings.xml
  16. -rw-r--r--  1 conan conan    3120 Aug 12 04:34 ivy.xml
  17. drwxr-xr-x  4 conan conan    4096 Aug 12 04:34 lib
  18. -rw-r--r--  1 conan conan   11358 Aug 12 04:34 LICENSE.txt
  19. -rw-r--r--  1 conan conan     170 Aug 12 04:34 NOTICE.txt
  20. -rw-r--r--  1 conan conan    1770 Aug 12 04:34 README_packaging.txt
  21. -rw-r--r--  1 conan conan    1585 Aug 12 04:34 README.txt
  22. drwxr-xr-x  5 conan conan    4096 Aug 12 04:34 recipes
  23. drwxr-xr-x  8 conan conan    4096 Aug 12 04:34 src
  24. -rw-r--r--  1 conan conan 1315806 Aug 12 04:34 zookeeper-3.4.5.jar
  25. -rw-r--r--  1 conan conan     833 Aug 12 04:34 zookeeper-3.4.5.jar.asc
  26. -rw-r--r--  1 conan conan      33 Aug 12 04:34 zookeeper-3.4.5.jar.md5
  27. -rw-r--r--  1 conan conan      41 Aug 12 04:34 zookeeper-3.4.5.jar.sha1

修改配置文件conf/zoo.cfg


  2. ~ mkdir /home/conan/zoo/zk0
  3. ~ cp conf/zoo_sample.cfg conf/zoo.cfg
  5. ~ vi conf/zoo.cfg
  6. tickTime=2000
  7. initLimit=10
  8. syncLimit=5
  9. dataDir=/home/conan/zoo/zk0
  10. clientPort=2181

非常简单，我们已经配置好了的zookeeper单节点

启动zookeeper


  2. ~ bin/zkServer.sh
  3. JMX enabled by default
  4. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg
  5. Usage: bin/zkServer.sh {start|start-foreground|stop|restart|status|upgrade|print-cmd}
  6. conan@conan:~/zoo/zk0/zookeeper345$ bin/zkServer.sh start
  7. JMX enabled by default
  8. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg
  9. Starting zookeeper ... STARTED
  11. #zk的服务显示为QuorumPeerMain
  12. ~ jps
  13. 5321 QuorumPeerMain
  14. 5338 Jps
  16. #查看运行状态
  17. ~ bin/zkServer.sh status
  18. JMX enabled by default
  19. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg
  20. Mode: standalone

单节点的时，Mode会显示为standalone

停止ZooKeeper服务


  2. ~ bin/zkServer.sh stop
  3. JMX enabled by default
  4. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg
  5. Stopping zookeeper ... STOPPED

3. zookeeper伪分布式集群安装

所谓 “伪分布式集群” 就是在，在一台PC中，启动多个ZooKeeper的实例。“完全分布式集群” 是每台PC，启动一个ZooKeeper实例。

由于我的测试环境PC数量有限，所以在一台PC中，启动3个ZooKeeper的实例。

创建环境目录


  2. ~ mkdir /home/conan/zoo/zk1
  3. ~ mkdir /home/conan/zoo/zk2
  4. ~ mkdir /home/conan/zoo/zk3
  6. #新建myid文件
  7. ~ echo "1" > /home/conan/zoo/zk1/myid
  8. ~ echo "2" > /home/conan/zoo/zk2/myid
  9. ~ echo "3" > /home/conan/zoo/zk3/myid

分别修改配置文件

修改：dataDir,clientPort

增加：集群的实例，server.X，”X”表示每个目录中的myid的值


  2. ~ vi /home/conan/toolkit/zookeeper345/conf/zk1.cfg
  3. tickTime=2000
  4. initLimit=10
  5. syncLimit=5
  6. dataDir=/home/conan/zoo/zk1
  7. clientPort=2181
  8. server.1=192.168.1.201:2888:3888
  9. server.2=192.168.1.201:2889:3889
  10. server.3=192.168.1.201:2890:3890
  12. ~ vi /home/conan/toolkit/zookeeper345/conf/zk2.cfg
  13. tickTime=2000
  14. initLimit=10
  15. syncLimit=5
  16. dataDir=/home/conan/zoo/zk2
  17. clientPort=2182
  18. server.1=192.168.1.201:2888:3888
  19. server.2=192.168.1.201:2889:3889
  20. server.3=192.168.1.201:2890:3890
  22. ~ vi /home/conan/toolkit/zookeeper345/conf/zk3.cfg
  23. tickTime=2000
  24. initLimit=10
  25. syncLimit=5
  26. dataDir=/home/conan/zoo/zk3
  27. clientPort=2183
  28. server.1=192.168.1.201:2888:3888
  29. server.2=192.168.1.201:2889:3889
  30. server.3=192.168.1.201:2890:3890

3个节点的ZooKeeper集群配置完成，接下来我们的启动服务。

启动集群


  2. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh start zk1.cfg
  3. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh start zk2.cfg
  4. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh start zk3.cfg
  6. ~ jps
  7. 5422 QuorumPeerMain
  8. 5395 QuorumPeerMain
  9. 5463 QuorumPeerMain
  10. 5494 Jps
  12. #查看节点状态
  13. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh status zk1.cfg
  14. JMX enabled by default
  15. Using config: /home/conan/toolkit/zookeeper345/bin/../conf/zk1.cfg
  16. Mode: follower
  18. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh status zk2.cfg
  19. JMX enabled by default
  20. Using config: /home/conan/toolkit/zookeeper345/bin/../conf/zk2.cfg
  21. Mode: leader
  23. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh status zk3.cfg
  24. JMX enabled by default
  25. Using config: /home/conan/toolkit/zookeeper345/bin/../conf/zk3.cfg
  26. Mode: follower

我们可以看到zk2是leader，zk1和zk3是follower

查看ZooKeeper物理文件目录结构


  2. ~ tree  -L 3 /home/conan/zoo
  3. /home/conan/zoo
  4. ├── zk0
  5. ├── zk1
  6. │   ├── myid
  7. │   ├── version-2
  8. │   │   ├── acceptedEpoch
  9. │   │   ├── currentEpoch
  10. │   │   ├── log.100000001
  11. │   │   └── snapshot.0
  12. │   └── zookeeper_server.pid
  13. ├── zk2
  14. │   ├── myid
  15. │   ├── version-2
  16. │   │   ├── acceptedEpoch
  17. │   │   ├── currentEpoch
  18. │   │   ├── log.100000001
  19. │   │   └── snapshot.0
  20. │   └── zookeeper_server.pid
  21. └── zk3
  22.     ├── myid
  23.     ├── version-2
  24.     │   ├── acceptedEpoch
  25.     │   ├── currentEpoch
  26.     │   ├── log.100000001
  27.     │   └── snapshot.100000000
  28.     └── zookeeper_server.pid
  30. 7 directories, 18 files

4. zookeeper命令行操作

我们通过客户端连接ZooKeeper的集群，我们可以任意的zookeeper是进行连接。


  2. ~ /home/conan/toolkit/zookeeper345/bin/zkCli.sh -server 192.168.1.201:2181
  4. Connecting to 192.168.1.201
  5. 2013-08-12 05:25:39,260 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
  6. 2013-08-12 05:25:39,267 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=conan
  7. 2013-08-12 05:25:39,269 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.6.0_29
  8. 2013-08-12 05:25:39,269 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Sun Microsystems Inc.
  9. 2013-08-12 05:25:39,270 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/home/conan/toolkit/jdk16/jre
  10. 2013-08-12 05:25:39,270 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/home/conan/toolkit/zookeeper345/bin/../build/classes:/home/conan/toolkit/zookeeper345/bin/../build/lib/*.jar:/home/conan/toolkit/zookeeper345/bin/../lib/slf4j-log4j12-1.6.1.jar:/home/conan/toolkit/zookeeper345/bin/../lib/slf4j-api-1.6.1.jar:/home/conan/toolkit/zookeeper345/bin/../lib/netty-3.2.2.Final.jar:/home/conan/toolkit/zookeeper345/bin/../lib/log4j-1.2.15.jar:/home/conan/toolkit/zookeeper345/bin/../lib/jline-0.9.94.jar:/home/conan/toolkit/zookeeper345/bin/../zookeeper-3.4.5.jar:/home/conan/toolkit/zookeeper345/bin/../src/java/lib/*.jar:/home/conan/toolkit/zookeeper345/bin/../conf:
  11. 2013-08-12 05:25:39,271 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/home/conan/toolkit/jdk16/jre/lib/amd64/server:/home/conan/toolkit/jdk16/jre/lib/amd64:/home/conan/toolkit/jdk16/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
  12. 2013-08-12 05:25:39,275 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
  13. 2013-08-12 05:25:39,276 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=
  14. 2013-08-12 05:25:39,276 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
  15. 2013-08-12 05:25:39,277 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
  16. 2013-08-12 05:25:39,281 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.5.0-23-generic
  17. 2013-08-12 05:25:39,282 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=conan
  18. 2013-08-12 05:25:39,282 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/home/conan
  19. 2013-08-12 05:25:39,283 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/home/conan/zoo
  20. 2013-08-12 05:25:39,284 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=192.168.1.201 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@22ba6c83
  21. Welcome to ZooKeeper!
  22. JLine support is enabled
  23. [zk: 192.168.1.201(CONNECTING) 0] 2013-08-12 05:25:39,336 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@966] - Opening socket connection to server 192.168.1.201/192.168.1.201:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration)
  24. 2013-08-12 05:25:39,345 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@849] - Socket connection established to 192.168.1.201/192.168.1.201:2181, initiating session
  25. 2013-08-12 05:25:39,384 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@1207] - Session establishment complete on server 192.168.1.201/192.168.1.201:2181, sessionid = 0x1406f3c1ef90001, negotiated timeout = 30000
  27. WATCHER::
  29. WatchedEvent state:SyncConnected type:None path:null
  31. [zk: 192.168.1.201(CONNECTED) 0]

集群已连接，下面我们要使用一下，ZooKeeper的命令行操作。

命令行操作

通过help打印命令行帮助


  2. [zk: 192.168.1.201(CONNECTED) 1] help
  3. ZooKeeper -server host:port cmd args
  4.         connect host:port
  5.         get path [watch]
  6.         ls path [watch]
  7.         set path data [version]
  8.         rmr path
  9.         delquota [-n|-b] path
  10.         quit
  11.         printwatches on|off
  12.         create [-s] [-e] path data acl
  13.         stat path [watch]
  14.         close
  15.         ls2 path [watch]
  16.         history
  17.         listquota path
  18.         setAcl path acl
  19.         getAcl path
  20.         sync path
  21.         redo cmdno
  22.         addauth scheme auth
  23.         delete path [version]
  24.         setquota -n|-b val path

ZooKeeper的结构，很像是目录结构，我们看到了像ls这样熟悉的命令。


  2. #ls,查看/目录内容
  3. [zk: 192.168.1.201(CONNECTED) 1] ls /
  4. [zookeeper]
  6. #create,创建一个znode节点
  7. [zk: 192.168.1.201(CONNECTED) 2] create /node conan
  8. Created /node
  10. #ls,再查看/目录
  11. [zk: 192.168.1.201(CONNECTED) 3] ls /
  12. [node, zookeeper]
  14. #get,查看/node的数据信息
  15. [zk: 192.168.1.201(CONNECTED) 4] get /node
  16. conan
  17. cZxid = 0x100000006
  18. ctime = Mon Aug 12 05:32:49 CST 2013
  19. mZxid = 0x100000006
  20. mtime = Mon Aug 12 05:32:49 CST 2013
  21. pZxid = 0x100000006
  22. cversion = 0
  23. dataVersion = 0
  24. aclVersion = 0
  25. ephemeralOwner = 0x0
  26. dataLength = 5
  27. numChildren = 0
  29. #set,修改数据
  30. [zk: 192.168.1.201(CONNECTED) 5] set /node fens.me
  31. cZxid = 0x100000006
  32. ctime = Mon Aug 12 05:32:49 CST 2013
  33. mZxid = 0x100000007
  34. mtime = Mon Aug 12 05:34:32 CST 2013
  35. pZxid = 0x100000006
  36. cversion = 0
  37. dataVersion = 1
  38. aclVersion = 0
  39. ephemeralOwner = 0x0
  40. dataLength = 7
  41. numChildren = 0
  43. #get,再查看/node的数据信息，已改为fens.me
  44. [zk: 192.168.1.201(CONNECTED) 6] get /node
  45. fens.me
  46. cZxid = 0x100000006
  47. ctime = Mon Aug 12 05:32:49 CST 2013
  48. mZxid = 0x100000007
  49. mtime = Mon Aug 12 05:34:32 CST 2013
  50. pZxid = 0x100000006
  51. cversion = 0
  52. dataVersion = 1
  53. aclVersion = 0
  54. ephemeralOwner = 0x0
  55. dataLength = 7
  56. numChildren = 0
  58. #delete,删除/node
  59. [zk: 192.168.1.201(CONNECTED) 7] delete /node
  60. [zk: 192.168.1.201(CONNECTED) 8] ls /
  61. [zookeeper]
  63. #quit,退出客户端连接
  64. [zk: 192.168.1.201(CONNECTED) 19] quit
  65. Quitting...
  66. 2013-08-12 05:40:29,304 [myid:] - INFO  [main:ZooKeeper@684] - Session: 0x1406f3c1ef90002 closed
  67. 2013-08-12 05:40:29,305 [myid:] - INFO  [main-EventThread:ClientCnxn$EventThread@509] - EventThread shut down

5. Java编程现实命令行操作


  2. package org.conan.zookeeper.demo;
  4. import java.io.IOException;
  6. import org.apache.zookeeper.CreateMode;
  7. import org.apache.zookeeper.KeeperException;
  8. import org.apache.zookeeper.WatchedEvent;
  9. import org.apache.zookeeper.Watcher;
  10. import org.apache.zookeeper.ZooDefs.Ids;
  11. import org.apache.zookeeper.ZooKeeper;
  13. public class BasicDemo1 {
  15.     public static void main(String[] args) throws IOException, KeeperException, InterruptedException {
  16.         // 创建一个与服务器的连接
  17.         ZooKeeper zk = new ZooKeeper("192.168.1.201:2181", 60000, new Watcher() {
  18.             // 监控所有被触发的事件
  19.             public void process(WatchedEvent event) {
  20.                 System.out.println("EVENT:" + event.getType());
  21.             }
  22.         });
  24.         // 查看根节点
  25.         System.out.println("ls / => " + zk.getChildren("/", true));
  27.         // 创建一个目录节点
  28.         if (zk.exists("/node", true) == null) {
  29.             zk.create("/node", "conan".getBytes(), Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT);
  30.             System.out.println("create /node conan");
  31.             // 查看/node节点数据
  32.             System.out.println("get /node => " + new String(zk.getData("/node", false, null)));
  33.             // 查看根节点
  34.             System.out.println("ls / => " + zk.getChildren("/", true));
  35.         }
  37.         // 创建一个子目录节点
  38.         if (zk.exists("/node/sub1", true) == null) {
  39.             zk.create("/node/sub1", "sub1".getBytes(), Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT);
  40.             System.out.println("create /node/sub1 sub1");
  41.             // 查看node节点
  42.             System.out.println("ls /node => " + zk.getChildren("/node", true));
  43.         }
  45.         // 修改节点数据
  46.         if (zk.exists("/node", true) != null) {
  47.             zk.setData("/node", "changed".getBytes(), -1);
  48.             // 查看/node节点数据
  49.             System.out.println("get /node => " + new String(zk.getData("/node", false, null)));
  50.         }
  52.         // 删除节点
  53.         if (zk.exists("/node/sub1", true) != null) {
  54.             zk.delete("/node/sub1", -1);
  55.             zk.delete("/node", -1);
  56.             // 查看根节点
  57.             System.out.println("ls / => " + zk.getChildren("/", true));
  58.         }
  60.         // 关闭连接
  61.         zk.close();
  62.     }
  63. }

运行结果：

  1. 2013-08-12 15:33:29,699 [myid:] - INFO  [main:Environment@97] - Client environment:zookeeper.version=3.3.1-942149, built on 05/07/2010 17:14 GMT
  2. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:host.name=PC201304202140
  3. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:java.version=1.6.0_45
  4. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:java.vendor=Sun Microsystems Inc.
  5. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:java.home=D:\toolkit\java\jdk6\jre
  6. 2013-08-12 15:33:29,703 [myid:] - INFO  [main:Environment@97] - Client environment:java.class.path=D:\workspace\java\zkdemo\target\classes;C:\Users\Administrator\.m2\repository\org\apache\hadoop\zookeeper\3.3.1\zookeeper-3.3.1.jar;C:\Users\Administrator\.m2\repository\log4j\log4j\1.2.15\log4j-1.2.15.jar;C:\Users\Administrator\.m2\repository\javax\mail\mail\1.4\mail-1.4.jar;C:\Users\Administrator\.m2\repository\javax\activation\activation\1.1\activation-1.1.jar;C:\Users\Administrator\.m2\repository\jline\jline\0.9.94\jline-0.9.94.jar;C:\Users\Administrator\.m2\repository\junit\junit\3.8.1\junit-3.8.1.jar
  7. 2013-08-12 15:33:29,703 [myid:] - INFO  [main:Environment@97] - Client environment:java.library.path=D:\toolkit\java\jdk6\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;D:\toolkit\Rtools\bin;D:\toolkit\Rtools\gcc-4.6.3\bin;C:\Program Files (x86)\Common Files\NetSarang;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;D:\toolkit\Git\cmd;D:\toolkit\Git\bin;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;c:\Program Files (x86)\Common Files\Ulead Systems\MPEG;C:\Program Files (x86)\QuickTime\QTSystem\;D:\toolkit\MiKTex\miktex\bin\x64\;D:\toolkit\sshclient;D:\toolkit\ant19\bin;D:\toolkit\eclipse;D:\toolkit\gradle15\bin;D:\toolkit\java\jdk6\bin;D:\toolkit\maven3\bin;D:\toolkit\mysql56\bin;D:\toolkit\python27;D:\toolkit\putty;C:\Program Files\R\R-3.0.1\bin\x64;D:\toolkit\mongodb243\bin;D:\toolkit\php54;D:\toolkit\nginx140;D:\toolkit\nodejs;D:\toolkit\npm12\bin;D:\toolkit\java\jdk6\jre\bin\server;.
  8. 2013-08-12 15:33:29,703 [myid:] - INFO  [main:Environment@97] - Client environment:java.io.tmpdir=C:\Users\ADMINI~1\AppData\Local\Temp\
  9. 2013-08-12 15:33:29,704 [myid:] - INFO  [main:Environment@97] - Client environment:java.compiler=
  10. 2013-08-12 15:33:29,704 [myid:] - INFO  [main:Environment@97] - Client environment:os.name=Windows 7
  11. 2013-08-12 15:33:29,704 [myid:] - INFO  [main:Environment@97] - Client environment:os.arch=amd64
  12. 2013-08-12 15:33:29,705 [myid:] - INFO  [main:Environment@97] - Client environment:os.version=6.1
  13. 2013-08-12 15:33:29,705 [myid:] - INFO  [main:Environment@97] - Client environment:user.name=Administrator
  14. 2013-08-12 15:33:29,705 [myid:] - INFO  [main:Environment@97] - Client environment:user.home=C:\Users\Administrator
  15. 2013-08-12 15:33:29,706 [myid:] - INFO  [main:Environment@97] - Client environment:user.dir=D:\workspace\java\zkdemo
  16. 2013-08-12 15:33:29,707 [myid:] - INFO  [main:ZooKeeper@373] - Initiating client connection, connectString=192.168.1.201:2181 sessionTimeout=60000 watcher=org.conan.zookeeper.demo.BasicDemo1$1@3dfeca64
  17. 2013-08-12 15:33:29,731 [myid:] - INFO  [main-SendThread():ClientCnxn$SendThread@1000] - Opening socket connection to server /192.168.1.201:2181
  18. 2013-08-12 15:33:38,736 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@908] - Socket connection established to 192.168.1.201/192.168.1.201:2181, initiating session
  19. 2013-08-12 15:33:38,804 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@701] - Session establishment complete on server 192.168.1.201/192.168.1.201:2181, sessionid = 0x1406f3c1ef9000d, negotiated timeout = 60000
  20. EVENT:None
  21. ls / => [zookeeper]
  22. EVENT:NodeCreated
  23. EVENT:NodeChildrenChanged
  24. create /node conan
  25. get /node => conan
  26. ls / => [node, zookeeper]
  27. EVENT:NodeCreated
  28. create /node/sub1 sub1
  29. ls /node => [sub1]
  30. EVENT:NodeDataChanged
  31. get /node => changed
  32. EVENT:NodeDeleted
  33. EVENT:NodeChildrenChanged
  34. EVENT:NodeChildrenChanged
  35. ls / => [zookeeper]
  36. 2013-08-12 15:33:38,877 [myid:] - INFO  [main:ZooKeeper@538] - Session: 0x1406f3c1ef9000d closed

pom.xml，maven配置文件

  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <project
  3. xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"
  4. xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  5. <modelVersion>4.0.0</modelVersion>
  6. <groupId>org.conan.zookeeper</groupId>
  7. <artifactId>zkdemo</artifactId>
  8. <version>0.0.1</version>
  9. <name>zkdemo</name>
  10. <description>zkdemo</description>
  12. <dependencies>
  13. <dependency>
  14. <groupId>org.apache.hadoop</groupId>
  15. <artifactId>zookeeper</artifactId>
  16. <version>3.3.1</version>
  17. <exclusions>
  18. <exclusion>
  19. <groupId>javax.jms</groupId>
  20. <artifactId>jms</artifactId>
  21. </exclusion>
  22. <exclusion>
  23. <groupId>com.sun.jdmk</groupId>
  24. <artifactId>jmxtools</artifactId>
  25. </exclusion>
  26. <exclusion>
  27. <groupId>com.sun.jmx</groupId>
  28. <artifactId>jmxri</artifactId>
  29. </exclusion>
  30. </exclusions>
  31. </dependency>
  32. </dependencies>
  33. </project>

基础讲完，接下来就让我动手管理起，我们自己的分布式系统吧。

ZooKeeper伪分布式集群安装及使用的更多相关文章

  1. （转）ZooKeeper伪分布式集群安装及使用

    转自:http://blog.fens.me/hadoop-zookeeper-intro/ 前言 ZooKeeper是Hadoop家族的一款高性能的分布式协作的产品.在单机中,系统协作大都是进程级的 ...

  2. zookeeper伪分布式集群安装

    1.安装3个zookeeper 1.1创建集群安装的目录 1.2配置一个完整的服务 这里不做详细说明,参考我之前写的 zookeeper单节点安装 进行配置即可,此处直接复制之前单节点到集群目录 创建 ...

  3. ZooKeeper伪分布集群安装及使用 RMI+ZooKeeper实现远程调用框架

    使用 RMI + ZooKeeper 实现远程调用框架,包括ZooKeeper伪集群安装和代码实现两部分.  一.ZooKeeper伪集群安装: 1>获取ZooKeeper安装包 下载地址:ht ...

  4. 搭建zookeeper伪分布式集群

    伪分布式集群的意思就是在同一台机子上部署多个zookeeoer,但是他们的端口不一样. 1.安装zookeeper 到/usr/local 2.cd /usr/local/zookeeper 3.cd ...

  5. Hadoop学习---CentOS中hadoop伪分布式集群安装

    注意:此次搭建是在ssh无密码配置.jdk环境已经配置好的情况下进行的 可以参考: Hadoop完全分布式安装教程 CentOS环境下搭建hadoop伪分布式集群 1.更改主机名 执行命令:vi  / ...

  6. Linux单机环境下HDFS伪分布式集群安装操作步骤v1.0

    公司平台的分布式文件系统基于Hadoop HDFS技术构建,为开发人员学习及后续项目中Hadoop HDFS相关操作提供技术参考特编写此文档.本文档描述了Linux单机环境下Hadoop HDFS伪分 ...

  7. zookeeper伪分布式集群搭建

    zookeeper集群搭建注意点:         配置数据文件myid1/2/3对应server.1/2/3         通过zkCli.sh -server [ip]:[port]检测集群是否 ...

  8. kafka2.9.2的伪分布式集群安装和demo(java api)测试

    目录: 一.什么是kafka? 二.kafka的官方网站在哪里? 三.在哪里下载?需要哪些组件的支持? 四.如何安装? 五.FAQ 六.扩展阅读   一.什么是kafka? kafka是LinkedI ...

  9. ubuntu12.04+kafka2.9.2+zookeeper3.4.5的伪分布式集群安装和demo(java api)测试

    博文作者:迦壹 博客地址:http://idoall.org/home.php?mod=space&uid=1&do=blog&id=547 转载声明:可以转载, 但必须以超链 ...

随机推荐

  1. 剑指 Offer 44. 数字序列中某一位的数字

    题目描述 数字以0123456789101112131415-的格式序列化到一个字符序列中.在这个序列中,第5位(从下标0开始计数)是5,第13位是1,第19位是4,等等. 请写一个函数,求任意第n位 ...

  2. Java中的String字符串及其常用方法

    字符串(String) 文章目录 字符串(String) 直接定义字符串 常用方法 字符串长度 toLowerCase() & toUpperCase()方法 trim()方法去除空格 判空 ...

  3. 5.AVStream和AVCodecParameters

    AVStream和AVCodecParameters 说明: AVStream 结构表示当前媒体流的上下文,着重于所有媒体流共有的属性(并且是在程序运行时才能确定其值)和关联其他结构的字段. 其中co ...

  4. H5C3综合案例

    案例:实现步骤 1. 搭建HTML结构 <section> <div></div> <div></div> <div></ ...

  5. JavaScript中关于获取浏览器可视窗口的几个兼容性写法的理解

    1.浏览器可视窗口的概述: 浏览器可视区域不是网页的body的大小.可视区指的是浏览器减去上面菜单栏.工具栏,下面状态栏和任务栏,右边滚动条(如果有的话)后的中间网页内容的单页面积大小.而body大小 ...

  6. yum管理——ningx部署私有repo源（4）

    一.前言: 为了加快安装效率,或者日后服务器处于内网环境,本次特写一片搭建的是一个属于个人私有repo源仓库,思路如下: 1.首先到mirrors.ustc.edu.cn下载用到的源的仓库 2.然后安 ...

  7. 基于MAXIMO的发电行业EAM解决方案

    1. 行业背景 随着我国以“厂网分开,竞价上网”为特点的电力市场的起步和发展,发电厂.发电集团成为独立企业参与市场竞争,原有的“生产型”管理模式已经不再适应市场的需求.发电企业在重视安全质量.保证电力 ...

  8. python安装scrapy库失败

    解决方法: 首先,下载Twisted.cp后数字为python版本,例如cp36为python3.6:amd则表示系统位数,例如amd64为64位.下载对应版本即可.点击打开链接 找到Twisted, ...

  9. echarts配置进度池

    近日,使用dataV中的配置,完成了进度池图表,但是有有一个缺点,就是官方没有动画方面的配置.如下图: 为了给这个进度池添加动画效果,我反向的在进度池上面铺一层由一格一格与进度池中相同的块状组成的与背 ...

  10. ORA-00060: Deadlock detected 模拟死锁产生与解决方案

    死锁:死锁是指两个或两个以上的进程在执行过程中,由于竞争资源或者由于彼此通信而造成的一种阻塞的现象,若无外力作用,它们都将无法推进下去.此时称系统处于死锁状态或系统产生了死锁,这些永远在互相等待的进程 ...