附9 elasticsearch-curator + Linux定时任务

官网教程入口：https://www.elastic.co/guide/en/elasticsearch/client/curator/current/index.html

一、下载安装

• 下载：sudo pip install elasticsearch-curator
• 更新：sudo pip install -U elasticsearch-curator

版本：curator4.1.0

二、配置文件

1、config.yml

 # Remember, leave a key empty if there is no value.  None will be a string,
 # not a Python "NoneType"
 client:
   hosts: ["127.0.0.1:9200"]
   url_prefix:
   use_ssl: False
   certificate:
   client_cert:
   client_key:
   aws_key:
   aws_secret_key:
   aws_region:
   ssl_no_validate: False
   http_auth:
   timeout: 30
   master_only: False

 logging:
   loglevel: INFO
   logfile:
   logformat: default
   blacklist: ['elasticsearch', 'urllib3']

说明：https://www.elastic.co/guide/en/elasticsearch/client/curator/current/configfile.html

2、action.yml

 ---
 # Remember, leave a key empty if there is no value.  None will be a string,
 # not a Python "NoneType"
 #
 # Also remember that all examples have 'disable_action' set to True.  If you
 # want to use this action as a template, be sure to set this to False after
 # copying it.
 actions:
   1:
     action: delete_indices
     description: "Delete indices older than 45 days (based on index name), for logstash- prefixed indices.
                   Ignore the error if the filter does not result in an actionable list of indices (ignore_empty_list) and exit cleanly"
     options:
       timeout_override:
       continue_if_exception: False
       disable_action: False
     filters:
     - filtertype: pattern
       kind: prefix
       value: logstash-
       exclude:
     - filtertype: age
       source: name
       direction: older
       timestring: '%Y.%m.%d'
       unit: days
       unit_count: 5
       exclude: 

注意：action上边那个1是action id，必须得有

说明：

• 例子：https://www.elastic.co/guide/en/elasticsearch/client/curator/current/examples.html#ex_delete_indices
• https://www.elastic.co/guide/en/elasticsearch/client/curator/current/actionfile.html

三、测试

curator --config ~/Desktop/server/elk/es-curator-4.1.0/config.yml ~/Desktop/server/elk/es-curator-4.1.0/action.yml

四、做成Linux定时任务

1、编写sh脚本：curator-delete-index.sh

#!/bin/sh
/usr/local/bin/curator --config /Users/enniu1/Desktop/server/elk/es-curator-4.1.0/config.yml /Users/enniu1/Desktop/server/elk/es-curator-4.1.0/action.yml
echo "delete index success"

注意：最好使用命令的全路径名，否则可能找不到。

2、赋予权限

• chmod 777 /Users/enniu1/Desktop/server/elk/es-curator-4.1.0/curator-delete-index.sh

3、创建定时任务：crontab

• crontab -e：打开了vi，输入：

  • 30 16 * * * /Users/enniu1/Desktop/server/elk/es-curator-4.1.0/curator-delete-index.sh，之后保存退出vi

• crontab -l：查看所有的root用户的定时任务

附：crontab的文件格式

分 时 日 月 星期 要运行的命令

• 第1列分钟1～59
• 第2列小时1～23（0表示子夜）
• 第3列日1～31
• 第4列月1～12
• 第5列星期0～7（0和7表示星期天）
• 第6列要运行的命令