Storm 单机版环境搭建
1 需要安装的软件
要使用storm首先要安装以下工具:python、zookeeper、zeromq、jzmq、storm
1.1 安装zeromq
wget http://download.zeromq.org/zeromq-2.2.0.tar.gz ##http://zeromq.org
tar zxf zeromq-2.2..tar.gz
cd zeromq-2.2.
./configure
make
make install
1.2 安装jzmq
wget https://github.com/zeromq/jzmq.git
./autogen.sh
./configure
make
make install
1.3 安装Zookeeper
http://apache.fayea.com/zookeeper/stable/
1.上传zk安装包
2.解压
3.配置
3.1添加一个zoo.cfg配置文件
$ZOOKEEPER/conf
mv zoo_sample.cfg zoo.cfg
3.2修改配置文件(zoo.cfg)
dataDir=/itcast/zookeeper-3.4.5/data
server.1=主机名:2888:3888
在(dataDir=/itcast/zookeeper-3.4.5/data)创建一个myid文件,里面内容是server.N中的N(server.2里面内容为2)
echo "5" > myid
4.启动zk
./zkServer.sh start
1.4 安装Storm
1 http://www.apache.org/dyn/closer.lua/storm/apache-storm-0.9.6/apache-storm-0.9.6.tar.gz 2 修改conf/storm.yaml 文件, 在下面加入下面的内容: storm.zookeeper.servers:
- "192.168.67.133"
storm.zookeeper.port: 2181
ui.port: 18080
nimbus.host: "192.168.67.133"
storm.local.dir: "/home/sms/apache-storm-0.9.6/tmp"
supervisor.slots.ports:
- 6700
- 6701 3 创建tmp文件夹,对应storm.local.dir
4 最后,配置用户的profile,加入 ZOOKEEPER_HOME 和 STORM_HOME 方便使用相关shell 命令
说明一下:
storm.local.dir表示storm需要用到的本地目录。
nimbus.host表示那一台机器是master机器,即 nimbus。
storm.zookeeper.servers表示哪几台机器是zookeeper服务器。
storm.zookeeper.port表示zookeeper的端口号,这里一定要与zookeeper配置的端口号一致,否则会出现通信错误,切记切记。
当然你也可以配 superevisor.slot.port,supervisor.slots.ports表示supervisor节点的槽数,就是最多能跑几个 worker进程(每个sprout或bolt默认只启动一个worker,但是可以通过conf修改成多个)。
2 启动和关闭Storm
1 启动ZOOPKEEPER zkServer.sh start
2 启动NIMBUS storm nimbus &
3 启动SUPERVISOR storm supervisor &
4 启动UI storm ui &
5 部署TOPOLOGY storm jar storm-starter-topologies-0.9.6.jar storm.starter.ExclamationTopology test
6 删除TOPOLOGY storm kill {toponame}
7 激活TOPOLOGY storm active {toponame}
8 不激活TOPOLOGY storm deactive {toponame}
9 列出所有TOPOLOGY storm list
aaarticlea/png;base64,iVBORw0KGgoAAAANSUhEUgAAAUsAAACUCAIAAACVypyHAAAgAElEQVR4nO2dZ1xTyf6HeX0SWEXlete77f5PCKjISYCEDgZZkCBIU4qEYqWJioIiYOGuvZddFhXbqquuK2thReyrIlJt4IKIUkSKSIcEkt//xQkhEHIIuBZw+DyvkswwCTyZOXNmvqPGo9F9ja0IDH8PjHdbWwSi7A16ugSmzfnKgs/kmqi/j1/0yWHmfE0our1w7MdvCeIzR+19Go6ztNwSH4uh/NKWqdZmGkzjr02tRjI++nv+ACDDEZ8IajwaXfDeDCcwnP2l+5Yzz4VA/tSdtdH76O8Zgfh8eO+Gk7C1TPiTbOz/M4H9sd8wAvFZQY7SrT96OxAIxPtAjUejC0yQ4QjE8IQcpX9KhtNZPuH7f1053fijtwSBGPp8oOvwAaAxefNjgFvBFv9otawxkwM8Fvh+zfww72Kwc+mTfLf/LRQWH5tCsD76HwIxLHjfhjNMDZb9equ8HQDaKjL3hDtq9lfk/RjOtTxSA9UnLCe+7w+UNWZqbEJ6eQt576CtJufkku9U/lqhcSIuCwE6MvxN0JQk4h/h/Y7SDXQi/2qEmvObF1k7ejnEnC8Rle92N6UuNbQN1w88UA2S4rPhcwRmLgJ+6P+WL3Pp90tNDraWtbcFz4z+XhuJ+IzoMdPGHjt9/dHcSrL/EbfWPjwRPI5BYDjXePu9Fy0AICzLSjlyq7QZxG8enphhakBZisCIecfeQsk+nzHkL2NY+6aLGi/O18KJkY77S6D51Cyp7WMXZAIULecZYl2GNxUUlLUDgKgi+0wQ35SGExhlKTo3ZPedorIG8sZ7c/HtI95WHPJlYzzP1UGvn9azAjPqCknUTRYfLevsLL/gpVqnOtLxQAnA3UXWtIH9GVhfL86Ta574+jxz8ik6N2RPxovqNgAA6KjNvbjb0UTWPOWfPAIhRY1Ho/tJR+l6fgdqoTXr4Bx/P0u3gGmhqxcG8UfgBHlVCc8SXWZGHqgEKEqa4bv6ZC1UHReMpipFaAkuNcLzGFtDuoFg+fn8SvLfNH+DLrN/w5tzTi2PCHcN33biuQQaLnsaszEVvheKD69yDwiesTzpZhNA/nZ9XQLDCdpEm0l2Xn7n6+HtJT9nV7a9K9ve+f/0+qmQZLTHb9UAAHVJM1Sa+VO3iM8A6Mg/4sEzHpDk6vr2hL0r296VE3DwmZzh5PsqOrDCSbDAIzrp6huA8hN2bBbl3wuBkEEaTvbh7PBUEVScCFW4bjRzviaUZC4dh5s5pbVLsqK+YpjxL7VKclZ+y6AoZcTe8RLq/7Alpvhdb4WqlBAvQcgdIRRu09Pp31XZKP0L2535ADmrHTRUMLyrlIHumqcA+aEWso6371F6v4ZjTJup8Qe3/W+eqtfSDBPO/27XAAB0vrx7evkcpzED7FQ1Jm9+rGC47NMY5XzgOUjSV9ipU/29EAgZajwa3c9EOtPGZcVcKQOAN/nJSZvc7c27dol0G+6Y2ibJXvE1w3TqhWZJXux32hSlTO3ONcHzvQbmy/8SQ+aK79Vx06kXmgdqODbRN6Eami7MU2VsLyul5Xe1BUp/mGrU9T4Ha3hfaJhFJD5pBuioepy2aZn/BI69Y2LWte0zuq63WZrmfnN2X7z/BgCg/Hw0U2cAfxJqwzE938RqaDw/V4vq74VAyCANl5tpG8H18l537FxBI0B7VuL8r5iEvOH8P5tFmVE9DVdaavo1Ify9lWW/vQBazgjMMHnD+YnF0JrsZ0YWpzJcz/fnrv9p1UtpCS43Qdl6B07X+1JiuPIKlcO1OPji5ZlwhqGTY3xydiN5XZ8dzef2fuX4qd6nKwGaTgnMVP+T9GO43Ped8k8egZChYLgUhrHhhnyAkjhbQznDZS/obXhfpUynnm+Gl4lcq5h7IL4ebCVvuLr52iyAR/GOGjiBUbqq6fhzEUjuRdur4wMopWA4h5tQAU2XHPR7NJiiQilMG/u1SQqjdLa67I3rmGvbOv1Xr+95OHLiLXO5repz49SGy1+zKP/kP/p/FeLTQY1Ho/tLDScC1p86ErU45Hs3HyufiOjUWujMmW/O7sdwpaWM9LeUQNsNF860ZY/E7Zkb2XpmDilSwzEdx6UPJNCcuTVyIV8Q7L//RS9Xnx1c6SwI8ow5dLUWoOKUPTm31F8p5Yaz/hN0sxWEmQdWuQeEeC7fNNeeS10hyWiP0wOaafvCeuXeo3vnz5tt6exp7hURc7kWoDDOzkiVsiR9Gt6Sc2r50sXui7b/WgLQkOZlzKb8e330/yrEp4NcH67ODdp4rbBautFTWPX05pagqSNxgtpw5aWIUW4nKqH+6Cyz0fbrzlVKbwS1pK9hMgkMJ0ZYhG/9q6xJWq6+OOukmzEbwwk6N/THzLK6DgAA6KzNS9njZNatnLJS/RlOYLp8v1/yXgkBADrePEkIsKJTVkiibrL4l4HcLRs1dcPJh1WtXTe9ap9eXz/HbkDz26Th13oa3vR30etOAOh4ldN975Dik0cgupDvw/9xUMbLwMuOdEgs7rpdj72v9T+Izwc1Ho3ub/q+1rShjBfVXq8zVZB4JC460iNo9Za7TSBMl61aRYYj3o33aziBMl5UQs8rNq2oqg0AoKk8Y/u872UTachwxLvx3g0nQRkvCMRH4QMZjkAgPgrIcARiOKPGo9EDkOEIxDAFGY5ADGf6HKUzTLnrMpoAnu1yk62goBv4r7hYWCcBkNQ/Ttk+xVA2Z8YabRu1605pEwBAe1n272FO3QEGyktRMeL7PYU9dnNfddTvvxQCgVCgjz6cw1qTXi+q72E40yH0nhBacnZEhXtEHb7TAu3pa3WZBIYTNGJOUjW05h4O8PYy943b+0gE9RedDFjUpaihjZ88ie/BcfTgOHp7HX+NDEcgBktvw9n/8T9d0pK/ThB+or7bcE2nw6XQnhpuQ8cJDGd/t+hOG7zaNo2D4cQo1+Ov4M2BrmXboz1+q4ZX25041KVUxoi946XMcBR4gkAMkJ6Ga5itOF9Xl7zITkMv8Fi34WydVQUAeYEWzhH3mprydhpZx90HyImxV8cJdcv4DAmUHJz9pTaB4VyjrYXixjQ3QxZ1KZXb18NwFHiCQAwQNR6NHig1nGk//1Zj5dmwr7UJrIfhHNN9ldCc6sD13lUBUHvGxmRBciu8SCAzD7hETFoFQH3+9V/+/Lup9clmH3JTB3UpFenDcBR4gkCoTLfh7G+Dr9Q13PAlV0T3afgkQoNtr2NghOnLucq05u/Lb3h9e3P89h0X8+sBXp5bOV63v1KqQmU4CjxBIPpDZjhjsn9m70RSAOjIi2cyu8bbXdsq6SZx9wFyY+zVcUJr1rk3ULJmKnl1zR4nOFUBbefnWdJwqlIqt49juLsUWq/0bTgKPEEg+kGuD/+X1XS2vasUl9iLLVB+bBHHykIDJzSdD5dC+6UwHjln9u1C2ZyZgc7qpyC67WHQVaPB4iud8GCNA2Up1dtn4XypGapOWEwkMBR4gkAMGPJ+uOKZJz1G6QSmww+7J4TmrC2RC90ik241Q/u9ePK+l+a0pGcAL89vcnF1N3QJWXquAuDFRkcOdSkKNCxXHkv7NTJ03mSPubO2XKkAqDjqR/bSKPAEgRggKhqOE+qGAdEpRfUAAI1P/txh2712hTMx7HDa82byLlVd8Z0doY4qlFLKFxbh61MLKsn9pk2lV5OW6+tJD/FCgScIxAAZUqtW0WZpBGKAIMMRiOHMkNo9igxHIAbIkOrDEQjEAJFf04ZAIIYbyHAEYjjzGRiuzg3bezc3yXcAh4chEMOFz8BwND+H+IyRN3w833vvlZwqIQCAqDYvZZc9R2GBSh/xLxQZLywtxzVJ2VXtANBZ9/DPnXaKFb5/kOGIz5ieu0cFh85sjIt08Q/z33CuoBNari75qkeIQh/xLxQZL3Tukt8boS3vcICPr23w7pRa6HywVV/3Q79JZDjiM0aNR6PP7muUbuZyXQhlB7jjZY/0Hf+iPOOF9c2iLHH39g/Wl3OuNEHVHheFc7bl0Q861wrZ0d/LH8c7LjSroyWNr09gODHCYuH6K8VvAUBS/yTtZ1cL2bGe7HEzN/2c9qCopllELl1tyI22M8J6Ga5tZZdY2NFZuM3LkvwVGtzZy5MfvRIBQGdNweVYn8nq/VWIQAwd+rwOZ5pNEOy60SwpThLINmYqiX+hynhhxhUAPJrXdQSXuuUPuQAZS21oFA2a4Lm9QlK8x30kztLkOuqZGtNww4nrijrK9nPGEzSDefsqAcpTYxaFui7efbYCoPK0A5kJR+4kh5eHfljh4T/Xzjd4ZvhCfT0CkzecaTP9YJFImL9llvTgUZq+387nIHx6dumCwMk+kWuv14Eoe6G1AXWFCMTQobfh7O8icjoBAKA97ycrQrrlQ3n8C6E844XQdDr0AiB/X7D2BBbGNNP1SyoCyImxo9ofrj1lbp644fxcLe0pszPFULBpAtN48vFaYebybxhsZuwjgJJ46V50YiQ/oRAgQ7rhvEdWhDyk4X9FBISl1ojf3l7mZNb1FcNmrMjrFGbMNpV+B9GMll3rgEfxfA3KChGIoYNCH65O8Dluc2fGHr35FjoeJ5jqEZTxLxQZLwTGMLNYf6NUIkuTAADRpTnmlA0y+f5MvTgvDjeJutYOIH4YYmkzK0P4+rjvaNzMIaUFqk9ZyzpSPd+fq6HxPJkA0Y/hIASQ5Efbye9ON516oVkx9OL1L76jKCtEIIYOajwafbZZX3fLtHySa6HppI8pZfwLRcZLV1U6Fjhvmq6JtcGmIoD8xVYGlA1iM+MKOiqOTo9Kr3mYtCO/KX11yOaXwozIKXTS8JrT8oYnqmx44ckz99ug48khByPZfL6ZQ0oLvLng6+zaHX1h76JnzKVRVohADB3UeDR6YN+Ge56tgebfBKaU8S9UGS9ytbFG2a272gqNqRHfavfTpjGeybWi4ouFdbeW2euuzGt4fvtpe9VPrlwMJ0fpL+IdBjNKvxVsOWpK7MlKkBQfd5LetGNrr3wogYqdbqZ9TQ0gwxHDALk+XMMkdNXuTYELgh0Ewd4xBy5VA1Sf5RuwepfpOUqnynhhGDP4vvbz42KO3n0pgc6CI44q3A+nm8SkA0DrTU8jFt1kxTURQGeGjxELwwmawbz9lQDll1ctDvdYuvePVwozbVSGW2A48YVF1Mlq6HicQE4x0FiBe0oBWvOPbI6dGRjsGrIq6odFTB2CukIEYuggZ/gIXtz+9OfV5K2h1tc5lxI9J3P66Nx6z7Qpz3iZOOunSgBR/bPcK7tXzWWMV61N42dsLoOaU7O1cAJjWDidb4RnO/Wl1hEjLMI3Xi9pBABo+vv6PndL2e0rlQzHcGIUf2e2GGqSw7/WJjCcUOcERv6WXUI2v7Oh6MZOzoR+KkQghg7Kr8MRCMTQBxmOQAxnkOEIxHAGGY5ADGfUeDT6HGQ4AjFMQYYjEMMZZDgCMZxR49Hoc5HhwxCGpcOxUlFbwQZnyu26iGGOvOFMK6vY0zdKGjoBoPPtk7QEJxPpGvIxnufqFNal1/zqN1pWkbYZa8HOpJtPy1vE7Q/W6XQdTjaSv+95j0K5fkYKi+QUGGG+cMO15w0AIGl8ejXRzeLT2pVN50acKW/vekfNL7LPL/ex6X064j8EzTg6HeBl4kxNnMBwjtGeMoD8MAsVonKYdgsyxQCt5+ag6IvPGTUejT7XnFzTZrvtfl1J8t41MwNCBevPF0pAeDcGZxIYTtD1Hc1n+NvMJAn0/PGxCGqPL7Ah94HS9NzCU6vaqrMP7Yj38Q8wt7MZ2ZUMM9r91Gt4uXW2F8fRg+PowXHgj+3vZEKavt+ulyApuRAZNM8hZPvpcoDSX2z0+/9e+GCom8fnADzeNt98ug/Pf+X6m3UAz9Y5DuhMVVUZ6bivGADKD5lMILDxHhtfAsDrPa4qdcvqhJPF9KljGO/aBsRQpsconaWhK+scTKaceguNKXaTepdRN1mW3Ajlv8z5N/mvwzDjHSpryN5uPKkPCbX8rjR3ZnkbqN4g9v8ty+6A4tVdaSqa/IRCEN+O/F4dJ0Y67i+B5lOzTMmnxi7IBChazpMeITyI+BflFXKNt9970QIAwrKslCO3SptB/ObhiRmmBliX4XcWWpFLemlGS691QMlPM8i1uspDYwaTJ6MlSKsuu3m3tmyHE2ek4/7CmuyU8qbL0h247P9beKmokdzOL6zITQ53JhPy2Hj0E9moqVd8FZ0bsvtOUVkDeYZjc/HtI95W7+W7CfFpINeH90Dbxv+2EAq2TdLp+TjD3O5ELdRfcu/ag0k3jroqhMZnz8qbOqGzpTQneZGLuSyJ8ZslD8SttwKnTvm3roqdsIX7dSE838uWxbnpusaXgPBG+JeUhg8u/kV5hWbO14TwLNFlZuSBSoCipBm+q0/WQtVxwWgFwzF2WEq7dCBNERozqDwZ1jeL85oLds4+U1m838/qpxelv0WvzG/LWiFNudLkhQoWzLdx87Wdu+FoCUD1yclkrA1rKmHvauS3v1DBcHKVfvHhVe4BwTOWJ91sAsjf/uHD8xAfir4N5+ivvFUP5T96W/TaeaJhve6+GB5scP6i6xEtweUmaEzbu9LRdaap5/Kt2e3QfM2HPNMbN5q0NqOsvrUTAKCzLONEgK0xVYQTTmA6TiuLQHx38ZfdD1rOvCMmN58oF3KQ8S/Uhksyl47DzZzS2iVZUV8xzPiXWiU5K79lyBvOHmU8w/dwkRiqEjxMKENjBpcnY6i/6Xn7o3h9z5MvXmdcffVqv6dT0ANh0Q7XEQof3b/n3RZCcYw0FY/AcELDav0DJYZ3PWigu+YpQH6oKhf2iCGJGo9Gn9fDcIaZyQ9366H290hHhfO3OdyEcmj7y4cr+4dgf7fsIcCTEHPpIyPsfywC8Y0w6x4mM011Zq45VCyB2j8cFbejyjPeY0MptF0N/lf3g2ZOV4RQup8znkrIwcW/qGK4Y2qbJHvF1wzTqReaJXmx32lLDe/+aSw4utJ9DIOgDI0ZXJ4M1+JwlSgv9r96PnteA1SftJ7EC8juqDwyaxROYLjBt747TmSXvWkTS4SNVW86AcrWO3QPuVUwnNDyu9oCpT9M/bTmMhH/HL36cG0L3q6HbVBxNMxesZfAJvr8WAWNF4PHdj/I+io8B+BFvL30X4RmGHkH4FG8o+Lc8pgZv1VD82lfU6oG6ThFF4LkXsS47getvNLFULRjkg4xkp9YDK3JftLTS3obPvD4F4oKZYbz/2wWZUYpGv5w42wu33WSueWI7qksitCYweXJmNqfb+7MjPqKwR47xcvM1kIdt/S+39lwbo4WTnxhszlLDHW3EgMEs4ydfKdvyhX2NFxdarilfJ29DRdcbupZCjG86GG4AWPJjQaoPBps2+e9H02nQ6XQ1uvui6bzkTIQp68gx8PEKJejZdD6R2AfYWxanmf6Nxy3cLsuhNJ9HNlm8vEzNpdB27WwsTihbr42S+7rQ2GUPuD4F+UVygyXvbi34d3X4d1QhMYMLk/G3OOOWJK++N89HxHdDPsXTvxrzm0hlG3gS9+ylk9KQ09X6SYxGQC5sfby0ZfI8M8M+VG6nt++Gmi8uoZH3tly9OA4uk9gy2LVDHTXPgV4ON+05zWb7vToRxJoyfhfsJ+5d+zPhWIoP8YjZ+AneUcl7A4ODeELgr1jklKrof9ROs7+b0SGCMq2OEsD2Me4HSkF0dVFNnScwHQclz6QQHPm1siFfEGw//4X8jNtg4h/UV7h4AynCo0ZTJ6Mts2cXBDdCJW/ZnG50QFZy79mECNsdz4CeHVph7ePr7mrwHljdq8+HJvgtfMVQOkfS0LCZ63YONuOgyHDPzvkDP/CZusThQvFzKgpXRPjpnbJjfDmDE8hM1zDZEH85Wd1EgAQlqYfnTVZ+u+ibhy87eaz120AANBek3d5v7cNt5+ZNpzA9LzWPZVAzZ2tsdGBa47crAdxwU/GXb90hEX41r/KmsjGCeuLs066GbNlTw00/kV5hYM0HKMKjRl4ngyTv6wAWlKDtLofNHNKa4f89TpMAsM5E0IOpRbVkYtvJO2N5U8uzu4RdMn+WrDvxisRAIjfFiTOtqYjwz871Hg0+nyLT2zVKt3Ad9GvOa8BQPLq5ol1VgZopheBGByfpOEYTmC4yeQjr6E9d+2sKX3M+SEQCJX4dA0naHrT55562gzQUf1wpyc6/RuBGASfsOEkI4xc7BYssjBEA3UEYhCo8Wj0BZ+y4QgE4h1AhiMQw5nPwHA6yyd8/68rpxt/9JYgEB+cT/46vDcDjy7pdQcYgficUOPR6Ass3ynjhTXaNmrXndImAID2suzfw5zMpItkxvO9917JqRICAIhq81J22atwblk/DDy6BBmO+IyRG6UPLuOFRsxJqobW3MMB3l7mvnF7H4mg/qITuVyUaS84dGZjXKSLf5j/hnMFndBydclX7xw5MtDoEmQ44jNGvg8fVMbLKNfjr+DNgRnSq9zRHr9Vw6vtToqrIM1crguh7AC3v/MJlYeQUESXUEWykIY3FRSUtQOAqCL7TBBfuv2DMjSGPXb6+qO5lS0AACBurX14IngcSkRCDDFIwycrPKFyxou6ZXyGBEoOzv5Sm8BwrtHWQnFjmpthz+0lTLMJgl03miXFSQKt/tpEEUKiPLqEKpKFrLA559TyiHDX8G0nnkug4bKnMRujNlzP70AttGYdnOPvZ+kWMC109cIgPlpdhxhq9G34ADJeMJxLxKRVANTnX//lz7+bWp9s9rGidz/L/i4ih0wSa8/7iTy1m5p+Q0j6CjagimTpNUr/wnZnPkDOagcNasPZ4akiqDgR+l1/0ZEIxCeMouEDy3ghMKY1f19+w+vbm+O377iYXw/w8tzK8XK5X+oEn+M2d2bs0ZtvoeNxgqnC1rRe9BtCQm24YiRL7+vwib4J1dB0YZ5WP6N0LivmShkAvMlPTtrkbm+uTtlsBOKTRI1Howd1Gz7gjBdCa9a5N1CyRhqQxh4nOFUBbefnWSrurNTySa6FppM+1AkQ/W9v7Cu6hCqSpbfh0oCnuVpUGS/SmkdwvbzXHTtX0AjQnpU4/yvUnyOGGD0MH0TGi4HO6qcguu0hy0s2WHylEx6scVCsQcvzbA00/yZ4V8P7ii6h2s7dq0JNx5+LQHIv2l6dKuOlZ6sYxoYb8gFK4mwVnkIgPmnUeDR6kBVp+KAyXjSnJT0DeHl+k4uru6FLyNJzFQAvNjpyMJzQMAldtXtT4IJgB0Gwd8yBS9UA1Wf5/WS8qBBR0Ed0Sf+GPzu40lkQ5Blz6GotQMUpezYLw6lCYzAiYP2pI1GLQ75387HyiYhOrYXOnPnmaAMMYmghZ/hgM144E8MOpz0ng0vEdcV3doRKL+BH8OL2pz+vJjP+W1/nXEr0nMzpN+NFhRASxegSKsPp3NAfM8vqOshkldq8lD1OZnLjcCWhMercoI3XCquF0ieqnt7cEjRVYWICgfjEUePR6MFWinfLEAjEcAAZjkAMZ+SvwxEIxHBDjUejB1sjwxGI4QkyHIEYziDDEYjhjBqPRg9BhiMQwxTUhyMQwxn5Plx5xguGs7Qc1yRlV7UDQGfdwz932smltdAN/FdcLKyTAEjqH6dsnyKXfDySv+95jxU0uX5G/W8vQyAQ/xBqPBo9lDScKuOFu+T3RmjLOxzg42sbvDulFjofbCX3bGNMh9B7QmjJ2REV7hF1+E4LtKev1e3aoTHa/dRreLl1tpd0GawDfyzavIFAfDh6XIcry3hhfbMoS9y974L15ZwrTVC1x4WL4YSm0+FSaE8Nt6HjBIazv1t0pw1ebZvWdeSt35XmzixvgwE2a7y98+YLd0ubJAAA4qbye6sdpRWOsFi4/krxWwCQ1D9J+9nVQrarlD1u5qaf0x4U1TSTy2ShITfaTvqsBnf28uRHr0QA0FlTcDnWZzLaCor4PJDrw3vQI+OFzYwrAHg0z0SW6/JDLkDGUhsaztZZVQCQF2jhHHGvqSlvp5F13H2AHOnB3axvljwQt94KnDrl37oqD86ZdgGpDQBvbx3dNi8kdFrg4sCYWPJwQprBvH2VAOWpMYtCXRfvPluhcIQwvDz0wwoP/7l2vsEzwxfq6xEYTtD0/XY+B+HTs0sXBE72iVx7vQ5E2QutDVRtDwIxhOnb8N4ZL5pOh14A5O8L1p7Awphmun5JRQA5MXbqOMd0XyU0pzpwvXdVANSesTFZkNwKLxJmaOIEhhtNWptRVt/aCQDQWZZxIsDWuN+dJ2M8f68BcfoaR4UN6mxm7COAknjpXnRiJD+hECBD+m2i7AhhNmNFXqcwY3bXljia0bJrHfAont/nDlkEYnihxqPRw6x5cg/1mfHCMLNYf6NU0jVf1gEAoktzzDGZ4ZMIDba9joERpi9veBdMU52Zaw4VS6D2D8d+do8a6m96DvBovoniPk0zh5QWqD5lLdvcJs1ymKeFE8oNN516oVlhyxy8/sV31Mf/9BGI9w1puIoZLzoWOG+arom1waYigPzFVgaYbJRuLBWSbhJ3HyA3xl7xQnfMjN+qofm0L3UChOGkDcUAD+coM7zmtLzhif0bbuaQ0gJvLvg6u7LtZbjoGXP7HU0gEEOfHqP0fjJeMJzAcNYou3VXW6ExNeJbbQLDCU3nw6XQfimMR860fbuwx0ybPFqeZ1QwnNDyTK4F0a0Y/he9nyJH6S/iHQY2Stde+VACFTvdTJHSiM8PecMpMl4Yxgy+r/38uJijd19KoLPgiKPsfrgOP+yeEJqztkQudItMutUM7ffipXfLJnlHJewODg3hC4K9Y5JSq0GFUTqB6fBDbrUAvL31y7Y5QSHTAsNnrdjg/z0Hwwmawbz9lQDll1ctDvdYuvePVwozbX0YTtBYgXtKAVrzj2yOnRkY7BqyKuqHRUwd1T8jBGLoosaj0cMm95vxMnHWT5UAovpnuVd2r5rL6AX+UYUAAApQSURBVHmqgbphQHRKUT0AQOOTP3fYdq14UTcO3nbz2es2Mku5Ju/yfm8blcbGtImO7tv/zCgnDyOA5sqHCXMmk1EzIyzCN14vaQQAaPr7+j53S9ndMqWGYzihzgmM/C27hLwe72wourGTM+Gjf/QIxAdAcaYNgUAMH5DhCMRwBhmOQAxnyOtwZDgCMTxBhiMQwxlkOAIxnFHj0egLh7fh6tywvXdzk3zNPnpLEIgPzmdgeO+TCRGIzwj5Ufp4vvfeKzlVQgAAUW1eyi57jsLicIYpd11GE8CzXW5d+1JYo22jdt0pbQIAaC/L/j3MyYxcnTLG81ydwhKaml/9Rn/YN4kMR3zGyPfhTHvBoTMb4yJd/MP8N5wr6ISWq0u+Ysi/msNak14vqpc3nEbMSaqG1tzDAd5e5r5xex+JoP6ikwELwwm6vqP5DH+bmSSBnj8+FkHt8QU2Hzh9ARmO+IxR49Ho4X2N0s1crguh7AC3e4Eq+z/+p0ta8tcJwk/Udxs+yvX4K3hzYIYx+bLRHr9Vw6vtTr13nqibLEtuhPJf5vybQdkg/aBzrZAd/T1d7sFxoVkdLWl8fQIbVMZLD8O1rewSCzs6C7d5WZK/Qnn8C1VoDAIxROjTcKbZBMGuG82S4iSBVteDGmYrztfVJS+y09ALPCZnuLplfIYESg7O/lKbwHCu0dZCcWOam2HP7SUMc7sTtVB/yd2ov9N5J3hur5AU73EfibM0uY56psY03HDiuqKOsv2c8YPMeOk2nGkz/WCRSJi/ZZYVqTdl/IvSChGIoYMaj0YP53Ubzv4uIqeT3CqS95MV0SUq037+rcbKs2FfaxNYT8MxnEvEpFUA1Odf/+XPv5tan2z2saL3/DUa1uvui+HBBmeFDaEKaE+ZmyduOD9XS3vK7EwxFGyawDSefLxWmLn8G8bgMl6khv8VERCWWiN+e3uZk1nX7hfq+BeqrSwIxBBBjUejL+LZdD+kTvA5bnNnxh69+RY6HieY6hEYzv42+Epdww1fMpWhl+FMa/6+/IbXtzfHb99xMb8e4OW5leN15X8Hh5tQDm1/+XD768BxAsNNvj9TL86Lw02irrUDiB+GWNrMyhC+Pu47epAZL1LDQQggyY+2k798oI5/QYYjhgEKhsvQ8kmuhaaTPqYYY7J/pqII0JEXz2QSWrPOvYGSNdJ+lT1OcKoC2s7Ps+zeJTrR58cqaLwYPFalBrGZcQUdFUenR6XXPEzakd+Uvjpk80thRuQU+iAzXqSGF548c78NOp4ccui+UqCOf0GGI4YBFIZ7nq2B5t8EphjO/pfV9G4HXGIvtkD5sUUcKwsN3EBn9VMQ3faQ5SUbLL7SCQ/WOMhSYjSdDpVC27k5qk5lj/FMrhUVXyysu7XMXndlXsPz20/bq35y5Q4240V2HW45akrsyUqQFB93kt4FpI5/QYYjhgFqPBp9kY0NgeGEhknoqt2bAhcEOwiCvWMOXKoGqD7LV4xk6TlK15yW9Azg5flNLq7uhi4hS89VALzY6CgbDBvorn0K8HC+qSpDdALDCbpJTDoAtN70NGLRTVZcEwF0ZvgYsbDBZrzIz6V/YRF1sho6HieQUwyU8S/IcMQwQM7wEby4/enPq8lbQ62vcy4lek7m9NG59Z5p40wMO5z2nLygFdcV39kRKhfSipvaJTfCmzM81Wehx8/YXAY1p2Zr4QTGsHA63wjPdup3hS4NIuOl1/3wUfyd2WKoSQ7/WpvAqOJfkOGIYYAaj0ZfbNPXKB2BQAx95PpwBAIx7EB9OAIxnEF9OAIxnFHj0egRyHAEYpiixqPRlyDDEYhhCjIcgRjOIMMHB8PS4VipqK1ggzP34zcGgVCKvOFMK6vY0zdKGjoBoPPtk7QEJxODrtcpDXLppo/4F4Ju4L/iYmGdBEBS/zhl+xRDVVe2feow7RZkigFaVV+Ni0B8DNR4NHrEFHJNm+22+3UlyXvXzAwIFaw/XygB4d0YnElglEEuXfQR/4IxHULvCaElZ0dUuEfU4Tst0J6+Vnpo4dBHnXCymD51DHWgBQLxkZEzHMNZGrqyPtZkyqm30JhiN4nA+g9y6Tv+RdPpcCm0p4bbkAcPf7dI6cHDPWGPnb7+aG4leS6huLX24YngcQwCw4mRjvtLoPnULOn5xGMXZAIULecZYjhB54bsyXhRTZ6C2FGbe3G3o4mhrM4BB7kwJvvcEkGt3GLb8R4bSqH9ZsRXDDYe3X2Co0I4lNLGY4MKqEEg3o0ehsuhbeN/WwgF2ybpEFh/QS5K4l/YOqsKAPICLZwj7jU15e00so67D5Aj3QqmHD2/A7XQmnVwjr+fpVvAtNDVC4P4I3ACozScXHxedGCFk2CBR3TS1TcA5Sfs2CxskEEu7G8XZXTA690u0svsEfY/FoHoajiPjhMarKmEvauR3/5CRcOVN35wATUIxLvRt+Ec/ZW36qH8R2+Lrp0nyoNclMa/cEz3VUJzqgPXe1cFQO0ZG5MFya3wImGGJnWb2OGpIqg4Efqdwni+X8O7t5c4H3gOkvQVduqDDXKhm6y43gGl+7w0cQLDOUZ7yqD1xkyj7gsTDav1DxQNV9r4QQbUIBDvhqLhDDOTH+7WQ+3vkXJbxJQGuVDEv3QZPonQYNvrGBhh+qoZjnNZMVfKAOBNfnLSJnd7c1mfr7rhXeEQc7UGHeTCsPa81g6vjphNJLAJXjsq4O0f8+VDLPo2XGnjBxlQg0C8G2o8Gj3CVma4tgVv18M2qDgaZj9C7nVKg1yo4l+6RunG0s6TbhJ3HyC331E6TmA4MYLr5b3u2LmCRoD2rMT5XzEJDCdG8hOLoTXZT3p6CZXhE30TqqHpwjytwQe5sMYKLr6F2kQPEy2vszVQtdfVWP4F6lLDLVVr/CADahCId6OH4QaMJTcaoPJosK1GjxdRBLlQxL8Qms6HS6H9UhiPnGn7dqGKM21yMIwNN+QDlMTZGmI4oW6+NgvgUbwj2TwKw7+w3ZkPkLPaQeNdglwmeG0vh8ZLq8JutEkKtk7S6fEs3SQmAyA3VvkXVo/GDzKgBoF4N0jDpxAYTmB6fvtqoPHqGp6jB0eK+wS2AdZ/kEsXvcIhdPhh94TQnLUlcqFbZNKtZmi/F9//3TIiYP2pI1GLQ75387HyiYhOrYXOnPnmbAwnMB3HpQ8k0Jy5NXIhXxDsv/9FL8Nbck4tX7rYfdH2X0sAGtK8jNnYOwW5GIxf/bATAKD1zzCb3vf/J3jtfAVQ+seSkPBZKzbOJjMelTd+cAE1CMS7ocaj0ZeShn9hs/WJwng7M2oKHSf6C3Lponf8C6FuGBCdUlQPAND45M8dtiqseFHnBm28VlgtJH+/sOrpzS1BU2UVjrAI3/pXWZP0yfrirJNuxmysy/Cmv4tedwJAx6ucM0H87k570EEuNHbQiXqA8kNmExWfZX8t2HfjlQgAxG8LEmdb01Vo/EADahCId6PXdfiQBR1dhED0hRqPRl+GDEcghilyo/QhDTIcgeiL4TJKRyAQffH/iZN5U1fLu70AAAAASUVORK5CYII=" alt="" />
core 对应的进程是Storm UI
Jps 对应的进程是Java jps
nimbus 对应的进程是Storm nimbus
supervisor 对应的进程是Storm supervisor
worker 对应的线程是Storm main函数里面设置的 conf.setNumWorkers() ,所以本例中有2个worker。
QuorumPeerMain 对应的进程是zkServer.sh 其中在nimbus上nimbus、 core和 QuorumPeerMain 这三个进程必须启动,如果启动失败,需要研究一下日志中失败的原因,按照上述的顺序再启动一次。否则 会导致下一步的topology提交失败,切记。
3 UI查看
浏览器输入 本机Ip:, 即可
4 注意事项
zeromq和jzmq的安装过程中,需要依赖很多文件,请保持联网状态。若编译失败,请根据说明自行安装相关的依赖包。
5 问题汇集
down vote
favorite I'm trying to setup storm 0.9.2 in CentOS 5.8 before I install dependency
jzmq, zeromq 4.0. this is my error log File "./storm", line
normclasspath = cygpath if sys.platform == 'cygwin' else identity
^
SyntaxError: invalid syntax linux centos storm
shareimprove this question edited Mar at :
skaffman
248k56563620 asked Jul '14 at 2:15
user3462081 i try storm 0.9. is work! – user3462081 Jul '14 at 2:37 It's not necessary to install zeromq since 0.9.0.1. – halfelf Jul 31 ' at : ---------------------------------------------- Answers
active
oldest
votes
up vote down vote This worked for my Redhat install on Python 3.4. I changed the hashbang in the /bin/storm file from: #!/usr/bin/python to: #!/usr/bin/env python
shareimprove this answer edited Mar at : answered Feb at :
billz add a comment
up vote down vote This is a python version issue. The storm file is a python script file. Seems storm updated the python version in 0.9.. Python 2.6 or higher could resolve this problem.
shareimprove this answer answered Aug '14 at 7:02
DeepNightTwo
, i install python 2.7 and reruning 0.9. but same error – user3462081 Sep '14 at 5:51 make sure you are using python2.. Type python -version to check the current python version. If it's not 2.7, you can sudo move python27 python. – DeepNightTwo Sep 5 ' at :
Python version
6 参考资料
0 storm 入门 http://storm.apache.org/releases/0.9.6/Setting-up-a-Storm-cluster.html
1 storm 官方安装文档 http://storm.apache.org/documentation/Documentation.html
2 storm 启动 http://www.blogjava.net/paulwong/archive/2013/09/11/403942.html
3 storm 配置 http://www.xuebuyuan.com/1932716.html
4 storm 原理 http://my.oschina.net/zhangglin/blog/352032?fromerr=DlnSzaed
5 storm 相关软件网盘下载地址 http://pan.baidu.com/s/1ntXpqdz
7 zookper配置 http://zookeeper.apache.org/doc/r3.3.3/zookeeperAdmin.html
8 zookper配置 http://zookeeper.apache.org/doc/r3.3.3/zookeeperProgrammers.html#ch_zkSessions
Storm 单机版环境搭建的更多相关文章
- mac10.9下eclipse的storm开发环境搭建
--------------------------------------- 博文作者:迦壹 博客地址:http://idoall.org/home.php?mod=space&uid=1& ...
- Spark+IDEA单机版环境搭建+IDEA快捷键
1. IDEA中配置Spark运行环境 请参考博文:http://www.cnblogs.com/jackchen-Net/p/6867838.html 3.1.Project Struct查看项目的 ...
- Kafka单机版环境搭建
使用版本:kafka_2.10-0.8.1.1 安装: -0.8.1.1.tgz -C ~/app/ 添加环境变量:.bash_profile export KAFKA_HOME=/home/spar ...
- Storm —— 单机环境搭建
1. 安装环境要求 you need to install Storm's dependencies on Nimbus and the worker machines. These are: Jav ...
- 0029redis单机版环境搭建
linux环境下安装单机版redis,主要分为如下几步: 1. 安装gcc 2.下载安装包 3.解压安装包 4.进入解压目录并执行make和make install命令 5.查看默认安装目录 6.更改 ...
- MongoDB_单机版环境搭建
linux上安装MogoDB http://www.runoob.com/mongodb/mongodb-linux-install.html 在https://www.mongodb.com/dow ...
- 【原】Storm环境搭建
2.Storm环境搭建 单机 ... 集群 ... 搭建Storm开发环境 搭建Storm开发环境主要概括为以下两步: 1.下载Storm发行稳定版,然后解压,最后把解压后的bin/文件所在目录添加到 ...
- 【Apache Pulsar】Apache Pulsar单机环境及Go语言开发环境搭建
0x01 简介 Apache Pulsar是一个开源的分布式发布-订阅消息系统,与Kafka类似,但比后者更加强大.Pulsar最初由Yahoo开发并维护,目前已经成为Apache软件组织的一个孵化子 ...
- storm环境搭建
备注——使用: 1.单机版本: 启动zkServer.nimbus.supervisor.ui服务: zkServer.sh start zkServer.sh status #查看zkserver是 ...
随机推荐
- Nagios监控平台搭建
Nagios是一款开源的免费网络监视工具,能有效监控Windows.Linux和Unix的主机状态,交换机路由器等网络设置,打印机等.在系统或服务状态异常时发出邮件或短信报警第一时间通知网站运维人员, ...
- CODEVS3037 线段覆盖 5[序列DP 二分]
3037 线段覆盖 5 时间限制: 3 s 空间限制: 256000 KB 题目等级 : 钻石 Diamond 题解 题目描述 Description 数轴上有n条线段,线段的 ...
- 第二章 spring
一.Bean作用域 spring容器创建的时候,会将所有配置的bean对象创建出来,默认bean都是单例的.代码通过getBean()方法从容器获取指定的bean实例,容器首先会调用Bean类的无参构 ...
- Java 8简明教程
本文由 ImportNew 欢迎阅读我编写的Java 8介绍.本教程将带领你一步一步地认识这门语言的新特性.通过简单明了的代码示例,你将会学习到如何使用默认接口方法,Lambda表达式,方法引用和重复 ...
- 禁用datagridview中的自动排序功能
把datagridview中的自动排序功能禁用自己收集的两种方法,看看吧①DataGridView中的Columns属性里面可以设置.进入"EditColumns"窗口后,在相应的 ...
- 解决win8 下 eclipse 中文字体太小的问题
一.把字体设置为Courier New 操作步骤:打开Elcipse,点击菜单栏上的“Windows”——点击“Preferences”——点击“Genneral”——点击“Appearance”— ...
- Gson解析json字符串
// 解析传递过来的json字符串 JsonParser parser = new JsonParser(); JsonObject jsonObj = parser.parse(strJson).g ...
- jquery版楼层滚动特效
<!DOCTYPE html><html> <head> <meta charset="UTF-8"> <title>楼 ...
- C#-WebForm-WebForm开发基础、如何给控件注册事件?——事件委托写法、http无状态性、三层结构
(小知识 - xml:可扩展的标记语言 html:超文本标记语言) 一.创建WebForm:新建→网站 此时文件夹中只有一个 config 文件,打开后 二.在项目下右键添加新项 在设计页面中打开 从 ...
- bzoj1616
水水啊,直接搜就行,不过bfs好像会mle(一定是我太菜了QAQ) #include<iostream> #include<algorithm> #include<cst ...