zmq导致master收不到minion的key

问题：

官网方式yum安装完saltstack之后，master与minion都成功启动后，但是却发现怎么都收不到minion的key。（zmq版本不一致所致，困扰了我好几天，希望能帮到大家。）

分析：

master上的状态：

# 查看master 上的配置文件,只修改了interface：

[root@master doubles]# cat /etc/salt/master

interface: 192.168.188.128

[root@master doubles]# systemctl status salt-master

● salt-master.service - The Salt Master Server

   Loaded: loaded (/usr/lib/systemd/system/salt-master.service; disabled; vendor preset: disabled)

   Active: active (running) since Tue 2019-01-08 09:55:59 HKT; 7min ago

     Docs: man:salt-master(1)

           file:///usr/share/doc/salt/html/contents.html

           https://docs.saltstack.com/en/latest/contents.html

 Main PID: 9331 (salt-master)

   CGroup: /system.slice/salt-master.service

           ├─9331 /usr/bin/python /usr/bin/salt-master

           ├─9340 /usr/bin/python /usr/bin/salt-master

           ├─9345 /usr/bin/python /usr/bin/salt-master

           ├─9348 /usr/bin/python /usr/bin/salt-master

           ├─9349 /usr/bin/python /usr/bin/salt-master

           ├─9350 /usr/bin/python /usr/bin/salt-master

           ├─9351 /usr/bin/python /usr/bin/salt-master

           ├─9352 /usr/bin/python /usr/bin/salt-master

           ├─9353 /usr/bin/python /usr/bin/salt-master

           ├─9354 /usr/bin/python /usr/bin/salt-master

           ├─9361 /usr/bin/python /usr/bin/salt-master

           ├─9362 /usr/bin/python /usr/bin/salt-master

           └─9364 /usr/bin/python /usr/bin/salt-master

Jan 08 09:55:54 master.doubles.cn systemd[1]: Starting The Salt Master Server...

Jan 08 09:55:59 master.doubles.cn systemd[1]: Started The Salt Master Server.

[root@master doubles]# salt-key -L

Accepted Keys:

Denied Keys:

Unaccepted Keys:

Rejected Keys:

# 始终看不到minion的key。

[root@master doubles]# salt-key -a 192.168.188.129

The key glob '192.168.188.129' does not match any unaccepted keys.

[root@master doubles]# salt '*' test.ping

Salt request timed out. The master is not responding. You may need to run your command with `--async` in order to bypass the congested event bus. With `--async`, the CLI tool will print the job id (jid) and exit immediately without listening for responses. You can then use `salt-run jobs.lookup_jid` to look up the results of the job in the job cache later.

看下minion上的salt状态：

# 查看minion上的配置文件,发现只修改了master与id如下：

[root@slave doubles]# vim /etc/salt/minion

master: 192.168.188.128

id: 192.168.188.129

# salt-minion开启调试模式

[root@slave doubles]# salt-minion -l debug

...

[DEBUG   ] SaltReqTimeoutError, retrying. (1/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (2/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (3/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (4/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (5/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (6/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (7/7)

[DEBUG   ] Re-init ZMQ socket: Message timed out

[DEBUG   ] Trying to connect to: tcp://192.168.188.128:4506

[ERROR   ] Error while bringing up minion for multi-master. Is master at 192.168.188.128 responding?

[DEBUG   ] Connecting to master. Attempt 1 of 1

[DEBUG   ] Master URI: tcp://192.168.188.128:4506

[DEBUG   ] Re-using AsyncAuth for (u'/etc/salt/pki/minion', u'192.168.188.129', u'tcp://192.168.188.128:4506')

[DEBUG   ] Generated random reconnect delay between '1000ms' and '11000ms' (7456)

[DEBUG   ] Setting zmq_reconnect_ivl to '7456ms'

[DEBUG   ] Setting zmq_reconnect_ivl_max to '11000ms'

[DEBUG   ] Re-using AsyncZeroMQReqChannel for (u'/etc/salt/pki/minion', u'192.168.188.129', u'tcp://192.168.188.128:4506', 'clear')

[DEBUG   ] salt.crypt.get_rsa_pub_key: Loading public key

[DEBUG   ] SaltReqTimeoutError, retrying. (1/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (2/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (3/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (4/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (5/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (6/7)

[DEBUG   ] SaltReqTimeoutError, retrying. (7/7)

[DEBUG   ] Re-init ZMQ socket: Message timed out

[DEBUG   ] Trying to connect to: tcp://192.168.188.128:4506

[ERROR   ] Error while bringing up minion for multi-master. Is master at 192.168.188.128 responding?

...

在这里，本机上的master也是无法收到本机上的minion的key。找了好久，有的说是配置里的master与id没有配对，有的说是增大线程数，有的说是防火墙，有的说是删掉pki下的id，试了都没有用。最后，认真思考一下，其实是minion无法与master 通信，偶然对比了一下minion与master的版本：

master上：

[root@master doubles]# salt-master --versions-report

Salt Version:

           Salt: 2018.3.3

Dependency Versions:

           cffi: 1.6.0

       cherrypy: Not Installed

       dateutil: Not Installed

      docker-py: Not Installed

          gitdb: Not Installed

      gitpython: Not Installed

          ioflo: Not Installed

         Jinja2: 2.7.2

        libgit2: Not Installed

        libnacl: Not Installed

       M2Crypto: 0.21.1

           Mako: Not Installed

   msgpack-pure: Not Installed

 msgpack-python: 0.5.6

   mysql-python: Not Installed

      pycparser: 2.14

       pycrypto: 2.6.1

   pycryptodome: Not Installed

         pygit2: Not Installed

         Python: 2.7.5 (default, Oct 30 2018, 23:45:53)

   python-gnupg: Not Installed

         PyYAML: 3.10

          PyZMQ: 14.3.1

           RAET: Not Installed

          smmap: Not Installed

        timelib: Not Installed

        Tornado: 4.2.1

            ZMQ: 3.2.2

System Versions:

           dist: centos 7.6.1810 Core

         locale: UTF-8

        machine: x86_64

        release: 3.10.0-957.1.3.el7.x86_64

         system: Linux

        version: CentOS Linux 7.6.1810 Core

minion上：

[root@slave doubles]# salt-minion --versions-report

Salt Version:

           Salt: 2018.3.3

Dependency Versions:

           cffi: Not Installed

       cherrypy: Not Installed

       dateutil: Not Installed

      docker-py: Not Installed

          gitdb: Not Installed

      gitpython: Not Installed

          ioflo: Not Installed

         Jinja2: 2.7.2

        libgit2: Not Installed

        libnacl: Not Installed

       M2Crypto: Not Installed

           Mako: Not Installed

   msgpack-pure: Not Installed

 msgpack-python: 0.4.6

   mysql-python: Not Installed

      pycparser: Not Installed

       pycrypto: 2.6.1

   pycryptodome: Not Installed

         pygit2: Not Installed

         Python: 2.7.5 (default, Oct 30 2018, 23:45:53)

   python-gnupg: Not Installed

         PyYAML: 3.11

          PyZMQ: 15.3.0

           RAET: Not Installed

          smmap: Not Installed

        timelib: Not Installed

        Tornado: 4.2.1

            ZMQ: 4.1.4

System Versions:

           dist: centos 7.6.1810 Core

         locale: UTF-8

        machine: x86_64

        release: 3.10.0-957.1.3.el7.x86_64

         system: Linux

        version: CentOS Linux 7.6.1810 Core

发现master与minion上的ZMQ版本不一样，这应该就是问题所在了。

解决：

尝试更新master上的zmq版本。

master上：

[root@master doubles]# yum install *zmq* –y

# 再对比版本

[root@master doubles]# salt-master --versions-report

Salt Version:

           Salt: 2018.3.3

Dependency Versions:

           cffi: 1.6.0

       cherrypy: Not Installed

       dateutil: Not Installed

      docker-py: Not Installed

          gitdb: Not Installed

      gitpython: Not Installed

          ioflo: Not Installed

         Jinja2: 2.7.2

        libgit2: Not Installed

        libnacl: Not Installed

       M2Crypto: 0.21.1

           Mako: Not Installed

   msgpack-pure: Not Installed

 msgpack-python: 0.5.6

   mysql-python: Not Installed

      pycparser: 2.14

       pycrypto: 2.6.1

   pycryptodome: Not Installed

         pygit2: Not Installed

         Python: 2.7.5 (default, Oct 30 2018, 23:45:53)

   python-gnupg: Not Installed

         PyYAML: 3.10

          PyZMQ: 15.3.0

           RAET: Not Installed

          smmap: Not Installed

        timelib: Not Installed

        Tornado: 4.2.1

            ZMQ: 4.1.4

System Versions:

           dist: centos 7.6.1810 Core

         locale: UTF-8

        machine: x86_64

        release: 3.10.0-957.1.3.el7.x86_64

         system: Linux

        version: CentOS Linux 7.6.1810 Core

此时发现zmq版本已经和minion一致了。重启master再试一下：

master:

[root@master doubles]# systemctl restart salt-master

[root@master doubles]# systemctl status salt-master

● salt-master.service - The Salt Master Server

   Loaded: loaded (/usr/lib/systemd/system/salt-master.service; disabled; vendor preset: disabled)

   Active: active (running) since Tue 2019-01-08 11:01:43 HKT; 17s ago

     Docs: man:salt-master(1)

           file:///usr/share/doc/salt/html/contents.html

           https://docs.saltstack.com/en/latest/contents.html

 Main PID: 15436 (salt-master)

   CGroup: /system.slice/salt-master.service

           ├─15436 /usr/bin/python /usr/bin/salt-master

           ├─15445 /usr/bin/python /usr/bin/salt-master

           ├─15450 /usr/bin/python /usr/bin/salt-master

           ├─15453 /usr/bin/python /usr/bin/salt-master

           ├─15454 /usr/bin/python /usr/bin/salt-master

           ├─15455 /usr/bin/python /usr/bin/salt-master

           ├─15456 /usr/bin/python /usr/bin/salt-master

           ├─15457 /usr/bin/python /usr/bin/salt-master

           ├─15458 /usr/bin/python /usr/bin/salt-master

           ├─15459 /usr/bin/python /usr/bin/salt-master

           ├─15460 /usr/bin/python /usr/bin/salt-master

           ├─15461 /usr/bin/python /usr/bin/salt-master

           └─15462 /usr/bin/python /usr/bin/salt-master

Jan 08 11:01:42 master.doubles.cn systemd[1]: Stopped The Salt Master Server.

Jan 08 11:01:42 master.doubles.cn systemd[1]: Starting The Salt Master Server...

Jan 08 11:01:43 master.doubles.cn systemd[1]: Started The Salt Master Server.

minion上，重启：

[root@slave doubles]# salt-minion -l debug

...

[DEBUG   ] Trying to connect to: tcp://192.168.188.128:4506

[DEBUG   ] Initializing new AsyncZeroMQReqChannel for (u'/etc/salt/pki/minion', u'192.168.188.129', u'tcp://192.168.188.128:4506', u'aes')

[DEBUG   ] Initializing new AsyncAuth for (u'/etc/salt/pki/minion', u'192.168.188.129', u'tcp://192.168.188.128:4506')

[DEBUG   ] Connecting the Minion to the Master URI (for the return server): tcp://192.168.188.128:4506

[DEBUG   ] Trying to connect to: tcp://192.168.188.128:4506

[INFO    ] Minion is ready to receive requests!

[DEBUG   ] Minion of '192.168.188.128' is handling event tag '/salt/minion/minion_schedule_delete_complete'

[DEBUG   ] Minion of '192.168.188.128' is handling event tag '/salt/minion/minion_schedule_add_complete'

[DEBUG   ] Minion of '192.168.188.128' is handling event tag '/salt/minion/minion_schedule_delete_complete'

[DEBUG   ] Minion of '192.168.188.128' is handling event tag '/salt/minion/minion_schedule_delete_complete'

...

# 跟之前不一样了

看下master上能否收到key了。

master上：

[root@master doubles]# salt-key -L

Accepted Keys:

Denied Keys:

Unaccepted Keys:

192.168.188.129

Rejected Keys:

[root@master doubles]# salt-key -a 192.168.188.129

The following keys are going to be accepted:

Unaccepted Keys:

192.168.188.129

Proceed? [n/Y] y

Key for minion 192.168.188.129 accepted.

[root@master doubles]# salt-key -L

Accepted Keys:

192.168.188.129

Denied Keys:

Unaccepted Keys:

Rejected Keys:

[root@master doubles]# salt "*" test.ping

192.168.188.129:

    True

发现已经OK了。

zmq导致master收不到minion的key的更多相关文章

The Salt Master has rejected this minion's public key!
salt查看日志: salt --log-level=all "10.199.165.244" state.highstate 进入调试模式: salt-minion -l deb ...
记录一个奇葩的问题：k8s集群中master节点上部署一个单节点的nacos,导致master节点状态不在线
情况详细描述; k8s集群,一台master,两台worker 在master节点上部署一个单节点的nacos,导致master节点状态不在线(不论是否修改nacos的默认端口号都会导致master节 ...
自动化运维工具saltstack01 -- 之SaltStack介绍、安装与基础使用
SaltStack介绍官网地址:http://www.saltstack.com 官方文档地址:http://docs.saltstack.com Github:http://Github.com/ ...
Linux记录-salt分析
salt-master建立分组如dn: 'L@dnxxx,dyyy' salt -N dn state.apply hadoop test=true salt -N dn cmd.run ' ...
学习saltstack （一）
salt介绍 Salt是一个基础平台管理工具 Salt是一个配置管理系统,能够维护预定义状态的远程节点 Salt是一个分布式远程执行系统,用来在远程节点上执行命令和查询数据 salt的核心功能是命令 ...
jquery插件源码
下面是对Jquery几个经常用到的地方进行的增强. 功能是参考百度七巧板JS框架来完成的. 一.页面属性 $.page.getHeight():获取页面高度 $.page.getWidth():获取页 ...
SaltStack Syndic配置
参考URL: http://www.ttlsa.com/saltstack/saltstack-syndic-example/ 虽然中心master看不到 minion的key 但是还是可以直接指导m ...
Salt初识和安装
Salt Salt是一个配置管理系统,能够根据定义的状态,配置远程节点,比如保证远程节点上指定的安装包安装,运行指定的服务.Salt也是一个分布式远程执行系统,用于在远程节点上执行命令和请求数据,不论 ...
saltstack中如何实现多个master来管理minion
背景: 公司有多个部门,有一些机器有本部门的业务,这些机器也有其他部门的业务,所以本部门需要一个master服务器来管理这批机器,其他部门也需要一个master服务器来管理这个机器,所以就需要多个ma ...

随机推荐

linux命令-passwd
修改密码 #passwd 新密码重新输入密码 #passwd dennywang ////命令+用户名 ////////////////////////////////////////////// ...
DAY9-python并发之多进程
一 multiprocessing模块介绍 python中的多线程无法利用多核优势,如果想要充分地使用多核CPU的资源(os.cpu_count()查看),在python中大部分情况需要使用多进程.P ...
tomcat使用manager管理app时需要身份验证问题
我们可以通过图形用户界面来管理tomcat,启动tomcat,在地址栏中输入: Java代码 http://localhost:8080 就可以看见tomcat的欢迎页面,点击左边的tomcat ma ...
Linux 控制台/终端/tty/shell
一.简介使用linux已经有一段时间,却一直弄不明白这几个概念之间的区别.这些概念本身有着非常浓厚的历史气息,随着时代的发展,他们的含义也在发生改变,它们有些已经失去了最初的含义,但是它们的名字却被 ...
hive的not in
最近项目需要对数据做打平操作,原有的sql使用了not in,但是hive 不支持 not in,晚上搜索了下使用 left outer join select * from lefttbl a le ...
Adb无法连接Genymotion
后来注意到Genymotion启动的时候adb无法正常使用,反复调用adb启动新的server也无法解决解决起来很简单.打开Genymotion设置界面,进入ADB标签,选中Use custom A ...
ipmitool查询服务器功耗
通过ipmitool查看服务器功耗 ipmitool -H $ip -I lanplus -U $user -P $password sdr elist | grep "Pwr Consum ...
Delphi和C#数据类型对应表
Delphi DataType C# datatype ansistring string boolean bool byte byte char char comp double currency ...
Owin password
一.什么是OAuth OAuth是一个关于授权(Authorization)的开放网络标准,目前的版本是2.0版.注意是Authorization(授权),而不是Authentication(认证). ...
fiddler扩展模拟弱网络环境设置
今天在qq群中有人问到怎么模拟app弱网络环境,我查了下资料,记得之前做测试的时候是设置fiddler断点,app请求后止于fiddler断点,app一直拿不到响应结果就应该要给出网络请求失败的提示, ...

zmq导致master收不到minion的key

问题：

分析：

解决：

zmq导致master收不到minion的key的更多相关文章

随机推荐

热门专题