Kafka自我学习2-Zookeeper cluster
Test enviroment : zoo1, zoo2, zoo3 cluster
1. Install zookeeper, package in kafka
[root@zoo1 ~]# pwd
/root
[root@zoo1 ~]# ls -l kafka_2.-1.1..tgz
-rw-r--r--. root root Mar : kafka_2.-1.1..tgz
[root@zoo2 ~]# pwd
/root
[root@zoo2 ~]# scp 192.168.1.51:/root/kafka_2.-1.1..tgz .
[root@zoo2 ~]# tar -xvf kafka_2.-1.1..tgz
[root@zoo2 ~]# mv kafka_2.-1.1. kafka
[root@zoo2 ~]# yum -y install java-1.8.-openjdk.x86_64
2.Configure hosts files
[root@zoo2 ~]# vim /etc/hosts
192.168.1.51 zoo1
192.168.1.52 zoo2
192.168.1.53 zoo3
3.Create uniq myid
[root@zoo2 ~]# vim /tmp/zookeeper/myid
4.Update zookeeper configuration files
[root@zoo2 ~]# vim /root/kafka/config/zookeeper.properties
dataDir=/tmp/zookeeper
clientPort=
maxClientCnxns=
tickTime=
initLimit=
syncLimit=
server.=zoo1::
server.=zoo2::
server.=zoo3::
5.Start zookeeper services on zoo1, zoo2, zoo3
[root@zoo2 ~]# systemctl stop firewalld
[root@zoo2 ~]# systemctl disable firewalld
[root@zoo2 ~]# /root/kafka/bin/zookeeper-server-start.sh /root/kafka/config/zookeeper.properties
6.Check Zookeeper running status
[root@zoo1 zookeeper]# ss -a -t |grep 192.168.1.51
ESTAB ::ffff:192.168.1.51:ciphire-serv ::ffff:192.168.1.52:
ESTAB ::ffff:192.168.1.51:ciphire-serv ::ffff:192.168.1.53:
ESTAB ::ffff:192.168.1.51:spcsdlobby ::ffff:192.168.1.53:
ESTAB ::ffff:192.168.1.51:spcsdlobby ::ffff:192.168.1.52:
[root@zoo1 zookeeper]# cat /etc/services |grep ciphire-ser
ciphire-serv /tcp # Ciphire Services
ciphire-serv /udp # Ciphire Services
[root@zoo1 zookeeper]# cat /etc/services |grep spcsd
spcsdlobby /tcp # SPCSDLOBBY
spcsdlobby /udp # SPCSDLOBBY
7.Repeat steps1-6 on zoo1, zoo2,zoo3
8.Check zookeeper cluster status by telnet server 2181 port
[root@zoo1 zookeeper]# telnet 192.168.1.51
Trying 192.168.1.51...
Connected to 192.168.1.51.
Escape character is '^]'.
conf
clientPort=
dataDir=/tmp/zookeeper/version-
dataLogDir=/tmp/zookeeper/version-
tickTime=
maxClientCnxns=
minSessionTimeout=
maxSessionTimeout=
serverId=
initLimit=
syncLimit=
electionAlg=
electionPort=
quorumPort=
peerType=
Connection closed by foreign host.
[root@zoo1 zookeeper]# telnet 192.168.1.52
Trying 192.168.1.52...
Connected to 192.168.1.52.
Escape character is '^]'.
conf
clientPort=
dataDir=/tmp/zookeeper/version-
dataLogDir=/tmp/zookeeper/version-
tickTime=
maxClientCnxns=
minSessionTimeout=
maxSessionTimeout=
serverId=
initLimit=
syncLimit=
electionAlg=
electionPort=
quorumPort=
peerType=
Connection closed by foreign host.
[root@zoo1 zookeeper]# telnet 192.168.1.53
Trying 192.168.1.53...
Connected to 192.168.1.53.
Escape character is '^]'.
conf
clientPort=
dataDir=/tmp/zookeeper/version-
dataLogDir=/tmp/zookeeper/version-
tickTime=
maxClientCnxns=
minSessionTimeout=
maxSessionTimeout=
serverId=
initLimit=
syncLimit=
electionAlg=
electionPort=
quorumPort=
peerType=
Connection closed by foreign host.
1 leader, 2 follower by default
[root@zoo1 zookeeper]# telnet 192.168.1.51
Trying 192.168.1.51...
Connected to 192.168.1.51.
Escape character is '^]'.
srvr
Zookeeper version: 3.4.-39d3a4f269333c922ed3db283be479f9deacaa0f, built on // : GMT
Latency min/avg/max: //
Received:
Sent:
Connections:
Outstanding:
Zxid: 0x100000000
Mode: leader
Node count:
Connection closed by foreign host.
[root@zoo1 zookeeper]# telnet 192.168.1.52
Trying 192.168.1.52...
Connected to 192.168.1.52.
Escape character is '^]'.
srvr
Zookeeper version: 3.4.-39d3a4f269333c922ed3db283be479f9deacaa0f, built on // : GMT
Latency min/avg/max: //
Received:
Sent:
Connections:
Outstanding:
Zxid: 0x1e5
Mode: follower
Node count:
Connection closed by foreign host.
[root@zoo1 zookeeper]# telnet 192.168.1.53
Trying 192.168.1.53...
Connected to 192.168.1.53.
Escape character is '^]'.
srvr
Zookeeper version: 3.4.-39d3a4f269333c922ed3db283be479f9deacaa0f, built on // : GMT
Latency min/avg/max: //
Received:
Sent:
Connections:
Outstanding:
Zxid: 0x100000000
Mode: follower
Node count:
Connection closed by foreign host.
Ctrl+c on zoo1, zoo3 change to leader auto(1 leader, 1 follower)
[root@zoo1 zookeeper]# telnet 192.168.1.51
Trying 192.168.1.51...
telnet: connect to address 192.168.1.51: Connection refused
[root@zoo1 zookeeper]# telnet 192.168.1.52
Trying 192.168.1.52...
Connected to 192.168.1.52.
Escape character is '^]'.
srvr
Zookeeper version: 3.4.-39d3a4f269333c922ed3db283be479f9deacaa0f, built on // : GMT
Latency min/avg/max: //
Received:
Sent:
Connections:
Outstanding:
Zxid: 0x100000000
Mode: follower
Node count:
Connection closed by foreign host.
[root@zoo1 zookeeper]# telnet 192.168.1.53
Trying 192.168.1.53...
Connected to 192.168.1.53.
Escape character is '^]'.
srvr
Zookeeper version: 3.4.-39d3a4f269333c922ed3db283be479f9deacaa0f, built on // : GMT
Latency min/avg/max: //
Received:
Sent:
Connections:
Outstanding:
Zxid: 0x200000000
Mode: leader
Node count:
Connection closed by foreign host.
ZooKeeper Commands: The Four Letter Words refer: http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_zkCommands
Kafka自我学习2-Zookeeper cluster的更多相关文章
- Kafka自我学习3-Scalable
1.After created the zookeeper cluster, we found all broker cluster topic can be find in zoo1, zoo2, ...
- Kafka自我学习1-Multi-broker cluster
====================================Testing environment =========================================== ...
- Kafka自我学习-报错篇
1. kafka启动出现:Unsupported major.minor version 52.0 错误, 具体的错误输出: Exception in thread "main" ...
- Why do Kafka consumers connect to zookeeper, and producers get metadata from brokers?
Why do Kafka consumers connect to zookeeper, and producers get metadata from brokers? Ask Question u ...
- How to set an Apache Kafka multi node – multi broker cluster【z】
Set a multi node Apache ZooKeeper cluster On every node of the cluster add the following lines to th ...
- kafka集群和zookeeper集群的部署,kafka的java代码示例
来自:http://doc.okbase.net/QING____/archive/19447.html 也可参考: http://blog.csdn.net/21aspnet/article/det ...
- 安装 zookeeper cluster
安装 zookeeper cluster zookeeper-3.4.5.tar.gz n0 10.69.10.193 n1 10.69.10.188 n2 10.69.10.192 n0 上解压 z ...
- UFLDL教程笔记及练习答案三(Softmax回归与自我学习***)
:softmax回归 当p(y|x,theta)满足多项式分布,通过GLM对其进行建模就能得到htheta(x)关于theta的函数,将其称为softmax回归. 教程中已经给了cost及gradie ...
- CentOS7 搭建Kafka(一)zookeeper篇
CentOS7 搭建Kafka(一)zookeeper篇 近几年当红小生Kafka备受各路英雄好汉追捧,一点不比老前辈RabbitMQ和ActiveMQ差,因为流行,所以你就得学啊:我这么懒,肯定是不 ...
随机推荐
- (数据科学学习手札03)Python与R在随机数生成上的异同
随机数的使用是很多算法的关键步骤,例如蒙特卡洛法.遗传算法中的轮盘赌法的过程,因此对于任意一种语言,掌握其各类型随机数生成的方法至关重要,Python与R在随机数底层生成上都依靠梅森旋转(twiste ...
- CentOS搭建Sqoop环境
Sqoop是一个用来将Hadoop(Hive.HBase)和关系型数据库中的数据相互转移的工具,可以将一个关系型数据库(例如:MySQL ,Oracle ,Postgres等)中的 ...
- stm32--FatFs调试过程(SPIFlash)
移植方法参见我的另一篇博客:<stm32--FatFs移植(SPIFlash)>. 本文仅记录在初次移植完成后,遇到的问题,和解决的过程. 调试记录: 问题1:f_open返回3,即磁盘没 ...
- Java重写构造方法
public class TestSuper { public static void main(String[] args) { new ChildClass("alex", 1 ...
- 台湾ML笔记--1.2 formalize the learning probelm
Basic notations input: x∈χ (customer application) output: y∈y (good/bad after approving cred ...
- Solution to LeetCode Problem Set
Here is my collection of solutions to leetcode problems. Related code can be found in this repo: htt ...
- (原)一段看似美丽的for循环,背后又隐藏着什么
之前很长一段时间,潜心修炼汇编,专门装了一个dos7,慢慢玩到win32汇编,再到linux的AT&A汇编,尝试写mbr的时候期间好几次把centos弄的开不了机,又莫名其妙的修好了,如今最大 ...
- json 处理日期格式
@JsonFormat(pattern="yyyy-MM-dd HH:mm:ss",timezone="GMT+8") private Date createT ...
- 虚拟现实-VR-UE4-获取UE4
UE4现在虽然是开源,但是并不是免费的,在你的游戏成功后,回收取5%费用和每个月19美元的费用 所以,第一步,进去UE4官网:https://www.unrealengine.com/zh-CN/wh ...
- 切换pip源的简便方法
网上大部分帖子讲的都是打开配置文件修改,那样太麻烦了,其实只要一行命令搞定: pip config set global.index-url https://pypi.tuna.tsinghua.ed ...