04_Returners组件：返回jobid的结果到mysql

1、前期调研

0、环境

salt 2019

python3.6  很重要

[root@IP ~]# salt-call --versions-report
Salt Version:
           Salt: 2019.2.0

Dependency Versions:
           cffi: Not Installed
       cherrypy: 5.6.0
       dateutil: Not Installed
      docker-py: Not Installed
          gitdb: Not Installed
      gitpython: Not Installed
          ioflo: Not Installed
         Jinja2: 2.8.1
        libgit2: Not Installed
        libnacl: Not Installed
       M2Crypto: Not Installed
           Mako: Not Installed
   msgpack-pure: Not Installed
 msgpack-python: 0.5.6
   mysql-python: 1.4.6
      pycparser: Not Installed
       pycrypto: 2.6.1
   pycryptodome: Not Installed
         pygit2: Not Installed
         Python: 3.6.8 (default, Aug  7 2019, 17:28:10)
   python-gnupg: Not Installed
         PyYAML: 3.11
          PyZMQ: 15.3.0
           RAET: Not Installed
          smmap: Not Installed
        timelib: Not Installed
        Tornado: 4.4.2
            ZMQ: 4.1.4

System Versions:
           dist: centos 7.3.1611 Core
         locale: UTF-8
        machine: x86_64
        release: 3.10.0-514.el7.x86_64
         system: Linux
        version: CentOS Linux 7.3.1611 Core

[root@IP ~]# 

[root@IP ~]# find / -name salt
/run/salt
/etc/logrotate.d/salt
/etc/salt
/var/lib/mysql/salt
/var/log/salt
/var/cache/salt
/usr/bin/salt
/usr/lib/python3.6/site-packages/salt
/home/sre/soms/media/salt
/srv/salt

1、相关文档

官方文档 https://docs.saltstack.com/en/latest/ref/returners/index.html#full-list-of-returners

对应中文翻译

Salt Returners-作业结果数据返回器的使用与定制开发方法  https://blog.csdn.net/watermelonbig/article/details/90634759

【SaltStack官方版】—— returners——返回器  https://www.cnblogs.com/zuoyang/p/9220647.html

--return mysql的3种方法

https://www.cnblogs.com/nmap/p/6219816.html

https://blog.51cto.com/q2012/2062953

https://www.jianshu.com/p/a655447ad7c6

https://www.jianshu.com/p/2b013833ab39

https://blog.csdn.net/qq_42303254/article/details/88998744

某些error问题解决：

https://blog.51cto.com/molewan/1899474

升级版本解决此问题：http://www.dongcoder.com/detail-656041.html

2、jobid问题

1、异步执行，maseter返回jobid，前端何时，去查看该jobid的结果。此时如果有个回调函数就更好了。

2、研究salt发现 --return 模块，可以自动把异步执行的结果写入数据库，这样就不需要查询了，直接从数据库里面取值即可。

参考

https://www.cnblogs.com/evilliu/articles/6137336.html

1、centos7.3，salt2019，python3.6下的安装

1、安装MySQL

安装参考  https://www.cnblogs.com/venicid/p/11956731.html

成功

2、安装MySQLdb模块

安装参考 https://www.cnblogs.com/venicid/p/11950519.html

对于，该环境来说。此处必须指定位置安装，MySQLdb与salt包位置，一样，

详情请见  https://www.cnblogs.com/venicid/p/11958498.html

[root@IP salt]# pip3 install --target=/usr/lib/python3.6/site-packages/ mysql-client

成功

2、建立数据库表

官网：https://docs.saltstack.com/en/latest/ref/returners/all/salt.returners.mysql.html

建立三个表

CREATE DATABASE  `salt`
  DEFAULT CHARACTER SET utf8
  DEFAULT COLLATE utf8_general_ci;

USE `salt`;

--
-- Table structure for table `jids`
--

DROP TABLE IF EXISTS `jids`;
CREATE TABLE `jids` (
  `jid` varchar(255) NOT NULL,
  `load` mediumtext NOT NULL,
  UNIQUE KEY `jid` (`jid`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
CREATE INDEX jid ON jids(jid) USING BTREE;

--
-- Table structure for table `salt_returns`
--

DROP TABLE IF EXISTS `salt_returns`;
CREATE TABLE `salt_returns` (
  `fun` varchar(50) NOT NULL,
  `jid` varchar(255) NOT NULL,
  `return` mediumtext NOT NULL,
  `id` varchar(255) NOT NULL,
  `success` varchar(10) NOT NULL,
  `full_ret` mediumtext NOT NULL,
  `alter_time` TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
  KEY `id` (`id`),
  KEY `jid` (`jid`),
  KEY `fun` (`fun`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

--
-- Table structure for table `salt_events`
--

DROP TABLE IF EXISTS `salt_events`;
CREATE TABLE `salt_events` (
`id` BIGINT NOT NULL AUTO_INCREMENT,
`tag` varchar(255) NOT NULL,
`data` mediumtext NOT NULL,
`alter_time` TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
`master_id` varchar(255) NOT NULL,
PRIMARY KEY (`id`),
KEY `tag` (`tag`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

授权

mysql> grant all on salt.* to salt@"%" identified by "XXXXX";
Query OK, 0 rows affected, 1 warning (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.11 sec)

成功

3、master配置

[root@IP ~]# vim /etc/salt/master

mysql.host: '192.168.23.21'
mysql.user: 'salt'
mysql.pass: 'XXXXX'
mysql.db: 'salt'
mysql.port: 3306
return: mysql
master_job_cache: mysql

重启master

[root@IP ~]# systemctl restart salt-master

4、执行salt命令，查看

先查看下

同步执行下

[root@IP ~]# salt "192.168.23.21" test.ping
192.168.23.21:
    True

异步执行下，5个都存在

[root@IP ~]# salt --async  \*  cmd.run "hostname -I"
Executed command with job ID: 20191129210622671777

5、安装ERROR解决

https://www.cnblogs.com/venicid/p/11958498.html

https://www.cnblogs.com/venicid/p/11957562.html