Kafka之--自动启动zookeeper & kafka 脚本

1) 首先配置SSH免密登录，在这里我用kafka（151）这台机器来作为启动脚本的存放和执行机器

[root@kafaka3 .ssh]# pwd

#生成SSH KEY
/root/.ssh
[root@kafaka .ssh]# ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
a7:82:b2:ce:c2:e0:21:7d:4e:63:7c:03:d5:3c:98:25 root@kafaka
The key's randomart image is:
+--[ RSA 2048]----+
|      E*.        |
|      +.+        |
|     .   .       |
|    .            |
| . . .  S .      |
|o.. *.o  o       |
|= o=.o...        |
|.+ o.  .         |
| o+              |
+-----------------+
[root@kafaka .ssh]# ls -l
total 8
-rw------- 1 root root 1675 Jul 13 20:12 id_rsa
-rw-r--r-- 1 root root  393 Jul 13 20:12 id_rsa.pub

#复制到另外两台机器上
[root@kafaka .ssh]# ssh-copy-id -i ~/.ssh/id_rsa.pub root@192.168.56.152
The authenticity of host '192.168.56.152 (192.168.56.152)' can't be established.
ECDSA key fingerprint is e6:c4:48:fa:0d:76:3e:2c:3b:60:e7:61:90:ad:9a:ee.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@192.168.56.152's password:

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@192.168.56.152'"
and check to make sure that only the key(s) you wanted were added.

[root@kafaka .ssh]# ssh-copy-id -i ~/.ssh/id_rsa.pub root@192.168.56.153
The authenticity of host '192.168.56.153 (192.168.56.153)' can't be established.
ECDSA key fingerprint is e6:c4:48:fa:0d:76:3e:2c:3b:60:e7:61:90:ad:9a:ee.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@192.168.56.153's password:

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@192.168.56.153'"
and check to make sure that only the key(s) you wanted were added.

#修改kafka2 & kafka3目录和文件的权限。如果不修改，可能无法正常免密登录成功
#kafka2文件权限修改
[root@kafaka2 .ssh]# chmod 700 ~/.ssh
[root@kafaka2 .ssh]# chmod 600 ~/.ssh/authorized_keys
#kafka3文件权限修改
[root@kafaka3 .ssh]# chmod 700 ~/.ssh
[root@kafaka3 .ssh]# chmod 600 ~/.ssh/authorized_keys

#免密登录测试
[root@kafaka .ssh]# ssh 192.168.56.152
Last login: Tue Jul 13 20:04:08 2021 from 192.168.56.1
[root@kafaka2 ~]# exit
logout
Connection to 192.168.56.152 closed.

2）启动脚本内容

2.1）启动zookeeper脚本

[root@kafaka ~]# cat zooman.sh
#! /bin/bash
case $1 in
"start"){
       echo " --------Start 192.168.56.151 Zookeeper-------"
       zkServer.sh start

        for i in 192.168.56.152 192.168.56.153
        do
                echo " --------Start $i Zookeeper-------"
                ssh $i "source /etc/profile; zkServer.sh start"
        done
};;
"stop"){
       echo " --------Stop 192.168.56.151 Zookeeper-------"
       zkServer.sh stop
        for i in 192.168.56.152 192.168.56.153
        do
                echo " --------Stop $i Zookeeper-------"
                ssh $i "source /etc/profile; zkServer.sh stop"
        done
};;
"status"){
       echo " --------192.168.56.151 Zookeeper Status-------"
       zkServer.sh status
        for i in 192.168.56.152 192.168.56.153
        do
                echo " --------$i Zookeeper status-------"
                ssh $i "source /etc/profile; zkServer.sh status"
        done
};;
esac

可以用zooman.sh start启动。启动完后，可以用zooman.sh status查看zookeeper状态

[root@kafaka ~]# ./zooman.sh status
 --------192.168.56.151 Zookeeper Status-------
ZooKeeper JMX enabled by default
Using config: /usr/local/apache-zookeeper-3.7.0-bin/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: follower
 --------192.168.56.152 Zookeeper status-------
/usr/bin/java
ZooKeeper JMX enabled by default
Using config: /usr/local/apache-zookeeper-3.7.0-bin/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: leader
 --------192.168.56.153 Zookeeper status-------
/usr/bin/java
ZooKeeper JMX enabled by default
Using config: /usr/local/apache-zookeeper-3.7.0-bin/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: follower

4）kafka启动停止脚本

[root@kafaka ~]# cat kfman.sh
#! /bin/bash
case $1 in
"start"){
        echo " --------Start 192.168.56.151 Kafka Broker $j-------"
        # 用于KafkaManager监控
        export JMX_PORT=9988 && /usr/local/kafka_2.13-2.7.0/bin/kafka-server-start.sh -daemon /usr/local/kafka_2.13-2.7.0/config/server.properties

        for i in 192.168.56.152 192.168.56.153
        do
                echo " --------Start $i Kafka Broker $j-------"
                # 用于KafkaManager监控
                ssh $i "export JMX_PORT=9988 && /usr/local/kafka_2.13-2.7.0/bin/kafka-server-start.sh -daemon /usr/local/kafka_2.13-2.7.0/config/server.properties "
        done
};;
"stop"){
        echo " --------Stop 192.168.56.151 Kafka-------"
        /usr/local/kafka_2.13-2.7.0/bin/kafka-server-stop.sh stop

        for i in 192.168.56.152 192.168.56.153
        do
                echo " --------Stop $i Kafka-------"
                ssh $i "/usr/local/kafka_2.13-2.7.0/bin/kafka-server-stop.sh stop"
        done
};;
esac

5）启动完成后，可以用如下命令查看brokers

(注：因为用daemon启动，一台物理服务器只能启动一个实例，所以这里我只启动了3个broker。

至于能否多个我还没研究透，如果有知道的朋友也请回复告知我一声）

[zk: localhost:2181(CONNECTED) 0] ls /
[admin, brokers, cluster, config, consumers, controller, controller_epoch, feature, isr_change_notification, latest_producer_id_block, log_dir_event_notification, zookeeper]
[zk: localhost:2181(CONNECTED) 1] ls /brokers
[ids, seqid, topics]
[zk: localhost:2181(CONNECTED) 2] ls /brokers/ids
[0, 2, 4]
[zk: localhost:2181(CONNECTED) 3]

最后说明，因为我为了节约一台机器，所以脚本放在了其中的一台机器。

如果放在另一台不同的机器上，脚本可以写得更简洁，不需要分开本地与远程机器分别处理。