安装配置Jstorm集群

准备工作

配置hostname

hostname c-storm01.prod

hostname c-storm02.prod

hostname c-storm03.prod

配置hosts文件

vim /etc/hosts

172.16.100.27   c-storm01.prod

172.16.100.34   c-storm02.prod

172.16.100.35   c-storm03.prod

1. 安装JDK
http://blog.csdn.net/u013619834/article/details/38894649
2. 下载并安装jstorm

wget http://42.121.19.155/jstorm/jstorm-0.9.6.3.zip
unzip jstorm-0.9.6.3.zip

mv jstorm-0.9.6.3 /usr/local/jstorm

3. 修改配置文件

cd /usr/local/jstorm

vim conf/storm.yaml

 storm.zookeeper.servers:

     - "172.16.100.30"

     - "172.16.100.31"

     - "172.16.100.32"

# supervisor.slots.ports.base: 6800

# supervisor.slots.port.cpu.weight: 1

# supervisor.slots.ports: null

 supervisor.slots.ports:

     - 6800

     - 6801

     - 6802

     - 6803

     - 6804

     - 6805

     - 6806

     - 6807

4. 复制jstorm程序到其他supervisor节点

scp -r /usr/local/jstorm 172.16.100.34:/usr/local/jstorm

scp -r /usr/local/jstorm 172.16.100.35:/usr/local/jstorm

5. 设置环境变量

echo "export JSTORM_HOME=/usr/local/jstorm" >> /etc/profile.d/app.sh

echo "export PATH=\$JSTORM_HOME/bin:\$PATH" >> /etc/profile.d/app.sh

source /etc/profile

6. 自启动脚本

nimbus节点添加自启动脚本

vim /usr/local/jstorm/start.sh

#!/bin/bash

nohup /usr/local/jstorm/bin/jstorm nimbus > /usr/local/jstorm/logs/start.log &

supervisor节点添加自启动脚本

vim /usr/local/jstorm/start.sh

#!/bin/bash

nohup /usr/local/jstorm/bin/jstorm supervisor > /usr/local/jstorm/logs/start.log &

echo "source /etc/profile && /usr/local/jstorm/start.sh" >> /etc/rc.local

7. 常用命令

查看Topology列表

jstorm list

启动Storm Topology

jstorm jar xx.jar org.me.xx.xx

停止 Storm Topology

jstorm kill {Toponame}

8. 安装jstorm web ui

安装tomcat

安装nginx

安装jstorm web ui

mkdir /root/.jstorm

cp /usr/local/jstorm/conf/storm.yaml /root/.jstorm

cp /usr/local/jstorm/jstorm-ui-0.9.6.3.war /usr/local/tomcat/webapps

/etc/init.d/tomcatd restart

mv /usr/local/tomcat/webapps/jstorm-ui-0.9.6.3 /usr/local/tomcat/webapps/ROOT

rm -rf /usr/local/tomcat/webapps/jstorm-ui-0.9.6.3

rm -rf /usr/local/tomcat/webapps/jstorm-ui-0.9.6.3.war