Filebeat的安装和使用(Linux)

安装 filebeat-7.9.3（与Elasticsearch版本一致）

考虑到Elasticsearch 比较费硬盘空间，所以目前项目中只上传error的日志。详细日志还是去具体服务器查看（没有专门运维）

普通安装：

1. 上传并解压filebeat-7.9.3-linux-x86_64.tar.gz，
2. 修改 filebeat.yml，
3. 启动 ./filebeat -c filebeat.yml -e

Docker 安装

docker pull elastic/filebeat:7.9.3

将 filebeat.yml 文件传到linux 服务器 /opt/filebeat 目录中

filebeat.inputs:

# Each - is an input. Most options can be set at the input level, so
# you can use different inputs for various configurations.
# Below are the input specific configurations.

- type: log
  enabled: true
  paths:
    - /opt/logs/ai_api_dev/*.log
    # - /opt/logs/ai_api_dev/*error*.log # 只看error
    #- D:\Projects\logs\*.log

  fields:
    # 额外添加的字段
    project-name: ai_api_dev
  exclude_lines: ['DEBUG']
  tags: ["ai_api_dev"]

- type: log
  enabled: true
  paths:
    - /opt/logs/ai_schedule_dev/*.log
  fields:
    project-name: ai_ecgreport_schedule_dev
  exclude_lines: ['DEBUG']
  tags: ["ai_schedule_dev"]

# ---------------------------- Elasticsearch Output ----------------------------

output.elasticsearch:
  # Array of hosts to connect to.
  hosts: ["172.16.3.61:9200"]
  indices:
    - index: "ai_api_dev_%{[agent.version]}-%{+yyyy.MM.dd}"
      when.contains:
        tags: "ai_api_dev"
    - index: "ai_schedule_dev_%{[agent.version]}-%{+yyyy.MM.dd}"
      when.contains:
        tags: "ai_schedule_dev"

processors:
  - drop_fields:
      fields: ['agent']
      when.contains:
        tags: "ai_api_dev"
  - drop_fields:
      fields: ['agent']
      when.contains:
        tags: "ai_schedule_dev"

文件权限 755 ，不能是777，否则会报

Exiting: error loading config file: config file ("filebeat.yml") can only be writable by the owner but the permissions are "-rwxrwxrwx" (to fix the permissions use: 'chmod go-w /usr/share/filebeat/filebeat.yml')

#运行
docker run --name filebeat --restart always --privileged=true -d \
	-v /opt/filebeat/logs/:/logs/ \
	-v /opt/filebeat/filebeat.yml:/usr/share/filebeat/filebeat.yml   \
	-v /data/tenant/service/:/data/tenant/service \
	-v /opt/logs/:/opt/logs/ \
	elastic/filebeat:7.9.3

#查看日志
docker logs --tail=100 -f d69

Observability => 日志