centos7下安装storm步骤

  前言

真是后知后觉，最近忙也要学习，把以前丢的都要拾起来。原理懂不懂也把环境搭起来学习。

  环境 

centos7

jdk 1.8

zookeeper 3.4.13

storm 1.2.2

安装

    1.zookeeper安装

         我装了三台虚拟机,配置如下：

jdk配置

vi /etc/profile

#java config
export JAVA_HOME=/opt/jdk/jdk1..0_201
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=$JAVA_HOME/lib:$JRE_HOME/lib:$CLASSPATH
export PATH=$JAVA_HOME/bin:$JRE_HOME/bin:$PATH

设置静态ip

vi /etc/sysconfig/network-scripts/ifcfg-ens33 

TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=static
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=ens33
UUID=--454f--d09dfde88267
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.5.201/202/203
GATEWAY=192.168.5.1
DNS1=114.114.114.114
DNS2=8.8.8.8

设置hosts，方便使用

vi /etc/hosts

192.168.5.201 centos01
192.168.5.202 centos02
192.168.5.203 centos03

机器配置好了，我们开始安装zookeeper

vi zoo.cfg

# The number of milliseconds of each tick
tickTime=
# The number of ticks that the initial
# synchronization phase can take
initLimit=
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/opt/zookeeper/data
# the port at which the clients will connect
clientPort=
# the maximum number of client connections.
# increase this if you need to handle more clients
#maxClientCnxns=
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=
# Purge task interval in hours
# Set to "" to disable auto purge feature
#autopurge.purgeInterval=
server.=centos01::
server.=centos02::
server.=centos03::

vi /etc/profile

# zookeeper
export ZK_HOME=/opt/zookeeper/zookeeper-3.4.
export PATH=$ZK_HOME/bin:$PATH

           2.storm安装

nimbus上的配置

########### These MUST be filled in for a storm configuration
storm.zookeeper.servers:
     - "centos01"
     - "centos02"
     - "centos03"
#
# nimbus.seeds: ["host1", "host2", "host3"]
#
#
# ##### These may optionally be filled in:
storm.local.dir: "/usr/data/storm"
supervisor.slots.ports:
     - 6700
     - 6701
     - 6702
nimbus.host: "centos01"

## List of custom serializations
# topology.kryo.register:
#     - org.mycompany.MyType
#     - org.mycompany.MyType2: org.mycompany.MyType2Serializer
#
## List of custom kryo decorators
# topology.kryo.decorators:
#     - org.mycompany.MyDecorator
#
## Locations of the drpc servers
drpc.servers:
     - "centos01"
#     - "server2"
worker.childopts: "-Xmx2048m"

supervisor上的配置

########### These MUST be filled in for a storm configuration
storm.zookeeper.servers:
     - "centos01"
     - "centos02"
     - "centos03"
#
# nimbus.seeds: ["host1", "host2", "host3"]
#
#
# ##### These may optionally be filled in:
storm.local.dir: "/usr/data/storm"
supervisor.slots.ports:
     - 6700
     - 6701
     - 6702
nimbus.host: "centos01"

## List of custom serializations
# topology.kryo.register:
#     - org.mycompany.MyType
#     - org.mycompany.MyType2: org.mycompany.MyType2Serializer
#
## List of custom kryo decorators
# topology.kryo.decorators:
#     - org.mycompany.MyDecorator
#
## Locations of the drpc servers
drpc.servers:
     - "centos01"
#     - "server2"
worker.childopts: "-Xmx2048m"
## Metrics Consumers
## max.retain.metric.tuples
## whitelist / blacklist
## - you can specify multiple whitelist / blacklist with regular expression
## expandMapType: expand metric with map type as value to multiple metrics
## - set to true when you would like to apply filter to expanded metrics
## - default value is false which is backward compatible value
## - only effective when expandMapType is set to true
# topology.metrics.consumer.register:
     - "centos02"
     - "centos03"
#
# nimbus.seeds: ["host1", "host2", "host3"]
#
#
# ##### These may optionally be filled in:
storm.local.dir: "/usr/data/storm"
supervisor.slots.ports:
     - 6700
     - 6701
     - 6702
nimbus.host: "centos01"

## List of custom serializations
# topology.kryo.register:
#     - org.mycompany.MyType
#     - org.mycompany.MyType2: org.mycompany.MyType2Serializer
#
## List of custom kryo decorators
# topology.kryo.decorators:
#     - org.mycompany.MyDecorator
#
## Locations of the drpc servers
drpc.servers:
     - "centos01"
#     - "server2"
worker.childopts: "-Xmx2048m"

vi /etc/profile

# storm
export STORM_HOME=/opt/apache-storm-1.2.
export PATH=${STORM_HOME}/bin:$PATH

配置好后，我们开始启动吧！

先启动zookeeper

zkServer.sh start

[root@centos03 bin]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper/zookeeper-3.4./bin/../conf/zoo.cfg
Mode: leader

再启动storm

nimbus上启动

./storm nimbus >> /dev/null &
storm drpc >> /dev/null &
storm ui >> /dev/null &

supervisor上启动

storm supervisor >> /dev/null &

在我实体电脑上访问http://192.168.5.201:8080时找不到网页，是防火墙的事

firewall-cmd --zone=public --add-port=/tcp --permanent

firewall-cmd --reload

好了！